files missing from sharepoint folder ONLY when using PQ in dataflows

[jonathankapoor]

Hi all,

For the last 12 months I have had a dataflow that connects to a sharepoint online folder and combines the files. Has worked very well! However today when it refreshed to include last months file it is missing not only last months file but all files going back to July 2019! (one file per month).

The strange thing is when I copy the query from Dataflows to PQ in PBI Desktop the query returns all files and combines successfullu. I have checked a few other dataflows that use a sharepoint folder connector and they too are now under reporting on the files in the sharepoint folder...

The issue isn't at the combine stage, it's when PQ lists all the files in the Sharepoint root and isn't brining through every file.

This is bizzare and has completely broken all models that uses these dataflows. Any idea what's happening??!

Jon

[jeremyking77]

Im having the same issue at the moment which is really frustrating

I found a work around that seems to be working for while the other method doesnt seem to work

You can use SharePoint.Contents instead.. Then you have to drill through each folder to your folder contents

let
Source = SharePoint.Contents("https://xxxx.sharepoint.com/sites/xxxx/", [ApiVersion = 15]),
#"Shared Documents" = Source{[Name="Shared Documents"]}[Content],
#"Reporting & Analysis" = #"Shared Documents"{[Name="Reporting & Analysis"]}[Content]
in 
#"Reporting & Analysis"

This works if you have all the source files in one directory. You'd have to do some more work if you have subfolders as well because you'd need to navigate through

[jonathankapoor]

To be clear it is Sharepoint Online

[GilbertQ]

Hi there

No idea why it should be happening.

What happens when the dataset is refreshed?

[jonathankapoor]

Appears I'm not the only one having this issue.

https://community.powerbi.com/t5/Issues/idb-p/Issues

[v-lid-msft]

Hi @jonathankapoor ,

Does there any change applied to the  queries used in Data flow recently? Does the data flow and power bi desktop use the same credential? Could you please try to verify if this issue also occur in a new dataflow?

Best regards,

[jonathankapoor]

My responses are in red.

Does there any change applied to the  queries used in Data flow recently?

Nope no changes to the query.

Does the data flow and power bi desktop use the same credential?

Nope same credentials

Could you please try to verify if this issue also occur in a new dataflow?

Occurs in other existing dataflows using Sharepoint Online Folder connector. Also occurs in brand new dataflows.

[v-lid-msft]

Hi @jonathankapoor ,

Sorry for that, We cannot reproduce the issue here and also not found an effective solution. We suggest you to open a ticket here for help if you are a pro user: https://powerbi.microsoft.com/en-us/support/

Best regards,

[jeremyking77]

I've raised a support ticket. so will let you guys know the outcome once its resolved

[jeremyking77]

@jonathankapoor @GilbertQ @v-lid-msft 

looks like Microsoft have found the issue and its going to be fixed next week

See https://community.powerbi.com/t5/Issues/Dataflows-failing-to-find-Sharepoint-files/idc-p/941788#M538...