Forum Discussion

WalkerGBG's avatar
WalkerGBG
Frequent Visitor
7 years ago

Sharepoint Multiple File Upload - File layout changes

I currently use PowerBI as a talented amateur and take almost everything I do from the helpfiles and community posts so in no way an expert   Current Situation I've created using the PowerBI deskt...
Need Help
v-piga-msft's avatar
v-piga-msft
Icon for Resident Rockstar rankResident Rockstar
7 years ago

Hi WalkerGBG ,

I have a little confused about your scenario.

Do you have the refresh issue in Power BI Desktop?

In addition, what about changing your query like below?

= Table.TransformColumnTypes(#"Expanded Table Column1",{{"Source.Name", type text}, {"Date", type datetime}, {"OrgID", Int64.Type}, {"Parent", Int64.Type}, {"ProductID", Int64.Type}, {"CustomerName", type text},{"NewFIELD", Int64.Type},COMMENT - etcetcetc, {"", type any}})

If it is convenient, could you share your M query in the Advanced Editor?

Best Regards,

Cherry

 

WalkerGBG's avatar
WalkerGBG
Frequent Visitor
7 years ago

Thanks for the response.  

 

Don't actually know what you mean when you say M Query :(

 

To better explain with an example 

  • I have a folder in a sharepoint location that contains (say) 10 files
  • The format of the 10 files contains identical 10 columns
  • I currently import all of these using Sharepoint Folder which imports them all into one file (using a process similar to the one on this URL - https://powerbi.microsoft.com/en-us/blog/combining-excel-files-hosted-on-a-sharepoint-folder/)
  • But now there's an 11th file with 11 columns.
  • The import process when it was created didn't know about that column so doesn't pull it in.

So I'm looking for a way for this type of import/transform to cater for changes in the individual files.  Happy to hear that it's not possible, but if it might be possible I'd like to try

  • WalkerGBG's avatar
    WalkerGBG
    Frequent Visitor
    7 years ago

    In the meantime I'm trying the potential solution mentioned earlier.

     

    Am loading historic files before change using one Sharepoint Folder & Combine to create a table

    Am loading new files after chagne from a new location using one SHarepoint Folder & Combine to create a table

     

    Am trying to Append them into a new table now but there's about 12 million rows so might take a while.  Hoping that will fulfil the requirement