Missing Columns in Dataflow Gen2

Hi Mohammed- 

Welcome to Microsoft Fabric platform and thanks for posting your question here.

As I understand that you want to create a dataflow and publish the data from SQL server DB to warehouse as a destination.

While I tried to do the repro from my side, I am able to see all the columns which are successfully displayed in the destination target. For reference, please find the screenshots attached.

Source Data - all columns will present.

While working with steps -

Whatever data you are seeing here is not Source Data, it is just a data preview (data present in that selected table)

Attached screenshots for reference.

THIS IS ACTUALLY MISGUIDING YOU IN YOUR CASE.

After successfully completing the configuration step please wait for dataflow gen 2 to run successfully. Please find the attached screenshot for reference.

Attached screenshot of final destination - warehouse.

Please follow the troubleshooting steps below to overcome the issues:

• The newly created table is not showing in Dataflow Gen2 because it has not yet been ingested by the dataflow. You can manually refresh a dataflow to force it to ingest data immediately.
• The columns were missing in the first time you published in the dataflow and showing in the warehouse because When you publish a dataflow, the dataflow tries to infer the schema of the source data source automatically. If the dataflow is not able to infer the schema of the source data source correctly, it may not be able to ingest all of the data from the source data source. This can result in columns being missing in the dataflow, even though they are present in the source data source.

I hope this information is helpful. Please do let us know if you have any questions.