Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply

Refresh taking long time for single table containg large data

Hi,

 

We have Power Bi dataset and the file size is 900MB. But when i refreshed full report, one of the table loading 10GB data. Because of that the refresh is taking more than 5hrs and it is getting failed in Power BI Service. Kindly adivce the what are the solutions in these situations.

 

Thanks,

Vamsi

2 REPLIES 2

Can you help me out how can we enable native query when data is coming from D365 CRM ONLINE(Import mode)?

v-tangjie-msft
Community Support
Community Support

Hi @VamsiKrishna98 ,

 

There are several possible reasons why your dataset refresh is taking too long and failing in Power BI Service. Some of them are:

- Your data source is slow or busy on network or refresh.
- Your dataset contains heavy transformation steps that require a lot of memory and CPU.
- Your dataset size exceeds the limit of your Power BI license or the maximum refresh duration.

 

To troubleshoot and optimize your refresh process, you can try some of the following steps:

- Use SQL Server Profiler to trace the Command Begin and Command End events and identify the command that took the longest time.
- Replace any joins or appends in Power Query with SQL queries or views that can be executed on the data source side.
- Use incremental refresh or aggregations to reduce the amount of data that needs to be refreshed.
- Use dataflow to separate the data preparation and data modeling steps and improve performance.

 

You can refer to the following documents that may be helpful to you:

How to Use Dataflow to Make the Refresh of Power BI Solution FASTER! - RADACAD

Optimization guide for Power BI - Power BI | Microsoft Learn

 Data Refresh takes a very long time - Microsoft Power BI Community

 

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.

Top Solution Authors
Top Kudoed Authors