Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Incremental Refresh takes much time compared to full load in the PBI service

Type - PBI dataset

Data source - Snowflake

Mode - Import

Total records - 20M 

Incremental Setup - 120 Quarters (Data goes upto 2005 year records)

Detect date changes - Used "last udate" column from Snowflake source

 

Full load - 20M records

Time taken - 30 mins

 

Incremental records refreshed- 3M records 

Incremental refresh time taken - 45 mins

 

Could anyone please assist me in determining the cause of this problem and how to investigate it?

 

Status: Investigating

Hi @rajas2406 ,

Firstly we should verify if the refresh actually performs an incremental refresh, please refer to the video:

Verify Incremental Refresh in Power BI Service (21/30) - Bing video

Then verify if the datasource is supported and query folding is required, refer to:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

 

Best regards,

Community Support Team_kalyj

Comments
v-yanjiang-msft
Community Support
Status changed to: Investigating

Hi @rajas2406 ,

Firstly we should verify if the refresh actually performs an incremental refresh, please refer to the video:

Verify Incremental Refresh in Power BI Service (21/30) - Bing video

Then verify if the datasource is supported and query folding is required, refer to:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

 

Best regards,

Community Support Team_kalyj