Forum Discussion
Dataflow problem with appending to existing table
Dataflow gen 2 with On Premise SQL is troublesome. The scenario is that 1. I have a Dataflow Gen 2 (DF2) which loads data from on premise SQL (by using gateway the latest version) to lakehouse ...
It turned out that it wa because I didnt pay good attention to the message.
When pulling data from source and to create a table in Lakehouse, Lakehouse will automatically change the column type to whole number if the column has only 0 value even you set the column type as decimal. Because of that, the second append dataflow will cause a column type inconsistency. Meaning this particular column in your dataflow is set as decimal type, but the existing table in lakehouse is actually whole number. Coumn type inconsisency. this was the main issue cuasing the error.
So, eventually instead of