Incremental Processing with Excel and Sharepoint Lists as a Data Source

[DebbieE]

Ive been trying to help someone sort out incremental processing. When I asked about the data source, its a mix of Excel spreadsheets and Sharepoint Lists

I immediately thought that due to Query folding, this would cause an issue

We get the message

Two Questions. Is it both Sharepoint lists and Excel that means we cant query fold because neither are relational?

Its not recommended. But does that means it still doable and it would still work. Its not saying you cant do it but what would be the issues?

[nickyvv · Accepted solution]

@DebbieE,

According to the documentation, SharePoint lists is one of the Sources that support folding. However, Excel is not.

This means that incremental refresh is not happening, because the engine needs to read the whole Excel sheet(s), and then perform the delta load. Depending on how you used the 2 sources together, it can be the case that also QF on the SharePoint list is not happening (for example if you combine the 2 sources).