Forum Discussion

msksenthil's avatar
msksenthil
Helper III
4 years ago

Dataflow failed to refresh when missing columns

Everyone,

I have a data flow connected to the SharePoint Excel table. It has been failing if there are changes in the table columns. It's basically hierarchy stuff, the LastUpdatedDateTime will there for sure. There will be a difference in the number of children.

 

I have made them dynamically, but no luck.

Any advice, please?

 

 

3 Replies

  • Datasets and Dataflows do not take kindly to meta data changes in the data sources.  Instead of messing with columns can you unpivot the "children" data and add more rows instead?

  • Thanks, lbendlin . Actually, I have done those transformations in Excel power query as we have some manual changes requirements. Post that, we are referring to excel in Dataflow. Here, the Dataflow throws an error if there is a change in the number of columns like missing columns.

    Anyhow, I have created some buffer columns (20 columns by default) to avoid the issues.

    • lbendlin's avatar
      lbendlin
      Super User

      I would still recommend giving the unpivoting some thought. It will be a more robust solution.