Dataflow failed to refresh when missing columns

[msksenthil]

Everyone,

I have a data flow connected to the SharePoint Excel table. It has been failing if there are changes in the table columns. It's basically hierarchy stuff, the LastUpdatedDateTime will there for sure. There will be a difference in the number of children.

I have made them dynamically, but no luck.

Any advice, please?

[msksenthil]

Thanks, @lbendlin . Actually, I have done those transformations in Excel power query as we have some manual changes requirements. Post that, we are referring to excel in Dataflow. Here, the Dataflow throws an error if there is a change in the number of columns like missing columns.

Anyhow, I have created some buffer columns (20 columns by default) to avoid the issues.

[lbendlin]

I would still recommend giving the unpivoting some thought. It will be a more robust solution.

[lbendlin]

Datasets and Dataflows do not take kindly to meta data changes in the data sources.  Instead of messing with columns can you unpivot the "children" data and add more rows instead?