Forum Discussion
Solutions for reducing refresh time on PowerBI Desktop
Hi Anonymous ,
You can refer the following links to reduce the refresh time:
1. Find the reason for the long refresh time
Why is my Power BI refresh so SLOW?!? 3 Bottlenecks for refresh performance
My dataset is taking too long to refresh!
There are 3 places where the refresh might be slow:
- Data source
- Power Query engine
- Analysis Services engine
2. Connect the file with the latest data only just as suggested by amitchandak
Power BI: How to Connect Most Recent File from a Folder
Power BI - Connect to Most Recent File in a Folder
3. Use incremental refresh
How you can incrementally refresh any Power BI data source (This example is a CSV File)
Incremental data load from CSV
You can use the same M code and create a Dataflow. Dataflows DO enable incremental refresh on sources like .csv flat files.When the dataflow refreshes, it will only pick up the newest data, perform the transformations, and load that newly shaped data into the Azure Data Lake.
If you do all of your transformations in the dataflow, the Power BI just has to read from the Data Lake to pull data into the model. That read is usually much faster than reading from .csv files in SharePoint and performing transformations.
I'm pretty sure you can also enable incremental refresh for pulling data from the dataflow.
Best Regards
Hi Anonymous ,
You can refer the following links to reduce the refresh time:
1. Find the reason for the long refresh time
Why is my Power BI refresh so SLOW?!? 3 Bottlenecks for refresh performance
My dataset is taking too long to refresh!
There are 3 places where the refresh might be slow:
- Data source
- Power Query engine
- Analysis Services engine
2. Connect the file with the latest data only just as suggested by amitchandak
Power BI: How to Connect Most Recent File from a Folder
Power BI - Connect to Most Recent File in a Folder
3. Use incremental refresh
How you can incrementally refresh any Power BI data source (This example is a CSV File)
Incremental data load from CSV
You can use the same M code and create a Dataflow. Dataflows DO enable incremental refresh on sources like .csv flat files.When the dataflow refreshes, it will only pick up the newest data, perform the transformations, and load that newly shaped data into the Azure Data Lake.
If you do all of your transformations in the dataflow, the Power BI just has to read from the Data Lake to pull data into the model. That read is usually much faster than reading from .csv files in SharePoint and performing transformations.
I'm pretty sure you can also enable incremental refresh for pulling data from the dataflow.
Best Regards