Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Incremental Refresh takes much time compared to full load in the PBI service

Type - PBI dataset

Data source - Snowflake

Mode - Import

Total records - 20M 

Incremental Setup - 120 Quarters (Data goes upto 2005 year records)

Detect date changes - Used "last udate" column from Snowflake source

 

Full load - 20M records

Time taken - 30 mins

 

Incremental records refreshed- 3M records 

Incremental refresh time taken - 45 mins

 

Could anyone please assist me in determining the cause of this problem and how to investigate it?

 

Status: Investigating

Hi @rajas2406 ,

Firstly we should verify if the refresh actually performs an incremental refresh, please refer to the video:

Verify Incremental Refresh in Power BI Service (21/30) - Bing video

Then verify if the datasource is supported and query folding is required, refer to:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

 

Best regards,

Community Support Team_kalyj

Comments
v-yanjiang-msft
Community Support
Status changed to: Investigating

Hi @rajas2406 ,

Firstly we should verify if the refresh actually performs an incremental refresh, please refer to the video:

Verify Incremental Refresh in Power BI Service (21/30) - Bing video

Then verify if the datasource is supported and query folding is required, refer to:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

 

Best regards,

Community Support Team_kalyj