Source Data structure from Sharepoint Folder has changed

[ryan_b_fiting]

Hello Community - 

I have data that I am sourcing from a Sharepoint folder and over time the structure of the files has slightly changed.  We added a new column in the extracts to start 2022 and another in 2023.  With those additions, when my tables are combined, the columns are not lining up properly with the columns from past files.

I am wondering if there is a function, or way to fix this without going into each file from the past and adding the new column(s).  Or manually moving the new columns to the end of the file each month.

Any tips on this would be appreciated.

Thanks

Ryan

[BA_Pete]

Hi Ryan,

If you're using the folder connector, then the simplest (not necessarily the cleanest) way would probably be to update the sample file query in the helper queries to point at a file with the latest (most columns) structure.

Any transformation you need to do on the new column(s) can then be done post-append, so you don't get errors during the Transform & Combine process.

Pete