Get certified in Microsoft Fabric—for free! For a limited time, the Microsoft Fabric Community team will be offering free DP-600 exam vouchers. Prepare now
I work with Power BI Desktop and Service and have began using DataFlows to extract data from Dynamics 365. I noticed that my reports would not refresh if a field was added to the entity in Dynamics 365. The error stated that there were more columns than expected, which caused all my reports to crash.
Here is what I have found works.
1. Go to Power BI service and enter into the dataflow and exit, which validates all the queries.
2. Go to the report in Power BI Desktop and clear all permissions under data source settings on the desktop report
3. Refresh the data flow
4. Wait ~20 mins
5. Refresh the power BI report on desktop and publish to the service
This has worked for me. Please message me if you have any faster ways to do this!
I had the same problem but figured out the root cause....its the model.JSON file that gets updated with the schema of your dataflow. If you have a new column that gets added to your dataflow from the source (whether its another unlinked dataflow or a select * statement from a database), dataflows doesnt seems to auto-support schema drift.
High level process of what's happening
If you are using disable load to consume data from other dataflows, using premium linked entities would likely fix the problem since metadata is linked instead of duplicated. But in your scenario it sounds like in Dynamics the scema drifted and Dataflows doesn't yet support source schema drift since the model.JSON is only compiled at validation of your dataflow when you save.
Workaround IF the source of your dataflow changes (i.e. more/less columns)
You can validate all of this happens by reviewing the exported JSON file before valdiating and saving your dataflow and then viewing again after saving...you'll noticed that before the JSON did not having the new column and after, it will.
I made a copy of an existing report, removed one column, and got this error when I refreshed on PBI desktop.
Where do I go to edit dataflow ?
I can confirm that this worked for me.
Hi @Anonymous,
Thanks for your kindly sharing. It might help more users having similar problem.
Best regards,
Yuliana Gu
Check out the October 2024 Power BI update to learn about new features.
Learn from experts, get hands-on experience, and win awesome prizes.