Dataset schedule refresh time very slow.

[ns152154185]

Hi Everyone,
I have a dataset in service which uses a dataflow as its datasource. Dataflow refresh takes about a minute but what concerning here is my dataset is taking about 40-43 mins in every refresh. Table in dataset has around 60-70 million records. Also I am using Premium license.
Also dataset contains no other transformation or anything.
Any suggestions to optimize and decrease in refresh time will be appreciated.

Thanks in advance.

[Anonymous]

Hi @ns152154185 

I have a few other ideas for you to consider:

1. Query Optimization: Ensure your queries are efficient. Use Query Diagnostics in Power BI to identify and optimize any slow-performing steps.

2. Data Partitioning: Split your large dataset into smaller, manageable chunks. This can help in refreshing only the necessary portions of the data.

3. Off-Peak Scheduling: Schedule your refreshes during off-peak hours to minimize the impact on business operations and ensure more resources are available for the refresh process.

Best Regards,

Jayleny

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[lbendlin]

Does the dataflow refresh use incremental Refresh?