Forum Discussion
Dataflow Refresh Error (Merge Queries)
- Anonymous4 years ago
Anyone experiencing Dataflow refresh failures should try this fix. Edit the DF settings and disable the "Enhanced compute engine settings." Then apply and let it make the changes. Then try a refresh.
Same issue. Microsoft, this needs to be fixed fast. My dataflow suddenly stopped loading some days back, and navigating through the error log, it looks like the query thinks a MDI-table in the dataflow itself should be fetched from the SQL server. In the steps pane i see that "merge queries" is set to query folding. Is that a bit strange considering that the merged table is not from the SQL database?
It works when I turn off enchanted computing, but I need that for my downstream dataflows to function correctly, so still my solution is broken..
UPDATE:
Found a solution for this problem that works in my scenario.
I both loaded the tables and did transformations in the same dataflow. This is not best practice according to the Microsoft documentation on dataflows. Rather, one should split these flows into two different dataflows, one for stage and one for transformation (splitting the etl process).
After altering the design by having dataflow #2 referencing the enteties in the stage dataflow, there are no errors occurring. Another benefit is that the load on the source seems to be significantly lighter as well, as all dataflows in my output layer (step #3) now only reference the second dataflow and not the source directly.
Hope this can help someone else too 🙂