Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
ryan_b_fiting
Post Patron
Post Patron

Source Data structure from Sharepoint Folder has changed

Hello Community - 

 

I have data that I am sourcing from a Sharepoint folder and over time the structure of the files has slightly changed.  We added a new column in the extracts to start 2022 and another in 2023.  With those additions, when my tables are combined, the columns are not lining up properly with the columns from past files.

 

I am wondering if there is a function, or way to fix this without going into each file from the past and adding the new column(s).  Or manually moving the new columns to the end of the file each month.

 

Any tips on this would be appreciated.

Thanks

Ryan

1 REPLY 1
BA_Pete
Super User
Super User

Hi Ryan,

 

If you're using the folder connector, then the simplest (not necessarily the cleanest) way would probably be to update the sample file query in the helper queries to point at a file with the latest (most columns) structure.

Any transformation you need to do on the new column(s) can then be done post-append, so you don't get errors during the Transform & Combine process.

 

Pete



Now accepting Kudos! If my post helped you, why not give it a thumbs-up?

Proud to be a Datanaut!




Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.