Best way to handle large dataset connected from sharepoint folder

[Ramendra]

I have created multiple Power BI report and whole data is connected to sharepoint folder. The data will be keep increasing month on month.

The reports are not an one time creation as I will have to keep modifying in future in case of modifications or new requirements in same dataset.

The challenge is if I will modify the reports in power bi desktop then it will load the newly added data as well from sharepoint and the size of pbix file will increase because the more data addition in sharepoint folder each month.

Is there any way to keep the size of pbix file small and keep editing or modifying the original pbix file without loading newly added data and then publish.
After then we can update data set in Power BI service to get updated data.

[selimovd · Accepted solution]

Hey @Ramendra ,

if you just want to update the latest added data you can use incremental refresh. With that you can tell Power Query to only load the last x days and how much data it should keep. For example load every day the last 7 days and keep the data of the last 2 years in the data set.

But you need a data source that supports query folding like a SQL Server. I'm not sure if Sharepoint supports query folding.

You can see all the details about incremental refresh on the docu website:

Incremental refresh for datasets in Power BI - Power BI | Microsoft Docs

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic