Forum Discussion

jonathankapoor's avatar
jonathankapoor
Frequent Visitor
6 years ago

files missing from sharepoint folder ONLY when using PQ in dataflows

Hi all,

 

For the last 12 months I have had a dataflow that connects to a sharepoint online folder and combines the files. Has worked very well! However today when it refreshed to include last months file it is missing not only last months file but all files going back to July 2019! (one file per month).

 

The strange thing is when I copy the query from Dataflows to PQ in PBI Desktop the query returns all files and combines successfullu. I have checked a few other dataflows that use a sharepoint folder connector and they too are now under reporting on the files in the sharepoint folder...

 

The issue isn't at the combine stage, it's when PQ lists all the files in the Sharepoint root and isn't brining through every file.

 

This is bizzare and has completely broken all models that uses these dataflows. Any idea what's happening??!

 

Jon

9 Replies

  • Im having the same issue at the moment which is really frustrating

     

    I found a work around that seems to be working for while the other method doesnt seem to work

    You can use SharePoint.Contents instead.. Then you have to drill through each folder to your folder contents

     

    let
    Source = SharePoint.Contents("https://xxxx.sharepoint.com/sites/xxxx/", [ApiVersion = 15]),
    #"Shared Documents" = Source{[Name="Shared Documents"]}[Content],
    #"Reporting & Analysis" = #"Shared Documents"{[Name="Reporting & Analysis"]}[Content]
    in 
    #"Reporting & Analysis"

    This works if you have all the source files in one directory. You'd have to do some more work if you have subfolders as well because you'd need to navigate through