Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.
When saving, Premium Dataflows almost consistently add two steps to my logic - Table.TransformColumnTypes and Table.ReplaceErrorValues. These appear without my request and cover multiple columns in the table. The UI will simply add them at the end of my logic. Although sometimes they cause no harm, there are instances where they consistently create problems.
For example, if using the enhanced compute engine, the performance-based recommendation is to have a staging or landing zone dataflow that simply pulls data from sources in their raw format (see "Using the enhanced compute engine" of the article "Premium features of dataflows"). Downstream dataflows then link to the staged dataflow tables rather than going to original sources. We have a large Smartsheet that undergoes structural (column insert/update or rename) modifications more than once a week. When I stage the smartsheet, my logic has only Source and Navigation steps, but then the dataflow UI Save operation adds the TransformColumnTypes and ReplaceErrorValues on every column in the table. This results in frequent daily failures when a column gets removed from or renamed in the smartsheet.
By the way, when an error occurs due to these additions, I open the dataflow UI and delete the two steps. Upon saving, the dataflow UI then rebuilds the two steps with only the available columns.
Thank you in advance for your help.
Solved! Go to Solution.
Hi @RandyPgh ,
It is by design, you may contact the support or submit an idea.
https://ideas.powerbi.com/ideas/ .
Best Regards,
Jay
For those curious, any column that does not have a non-Variant data type seems to be automatically set to a text type if you save and leave the designer. The two steps are added for that purpose - to set any Variants to text and to replace errors.
Hi @RandyPgh ,
It is by design, you may contact the support or submit an idea.
https://ideas.powerbi.com/ideas/ .
Best Regards,
Jay
Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City
Check out the April 2024 Power BI update to learn about new features.