Forum Discussion

christianunr's avatar
christianunr
Icon for Helper I rankHelper I
1 year ago
Solved

New column added from a Dataflow is not appearing when adding a Destination Source

EDIT: I seem to be facing the same issue as this person: https://community.fabric.microsoft.com/t5/Dataflow/Overwrite-a-table-with-different-schema-in-Dataflow-Gen2/m-p/3752099   Hello, I am trying...
Dataflow
Need Help
  • christianunr's avatar
    christianunr
    1 year ago

    Thanks. What I ended up doing is creating a staging lakehouse where I copy the data to first from SQL Server and then in the Dataflow, add the source destination into a "production" lakehouse.

NetaZimut's avatar
NetaZimut
New Member
1 year ago

Also encountered this issue with a client using a Dataflow connected to a Delta Sharing catalog from Databricks; 

The dataflow would show the full table with up to date data but the PBIX would not pick up the missing columns but kept the data up to date for the displayed ones.

 

 

Here's another fix that worked for us :

  • Open PowerQuery
  • Delete table that is not refreshing columns from the queries
  • Save PBIX & Close
  • Recreate query to the table

Cheers