Incremental Refresh takes much time compared to full load in the PBI service

[rajas2406]

Type - PBI dataset

Data source - Snowflake

Mode - Import

Total records - 20M 

Incremental Setup - 120 Quarters (Data goes upto 2005 year records)

Detect date changes - Used "last udate" column from Snowflake source

Full load - 20M records

Time taken - 30 mins

Incremental records refreshed- 3M records 

Incremental refresh time taken - 45 mins

Could anyone please assist me in determining the cause of this problem and how to investigate it?

[v-yanjiang-msft]

Hi @rajas2406 ,

Firstly we should verify if the refresh actually performs an incremental refresh, please refer to the video:

Verify Incremental Refresh in Power BI Service (21/30) - Bing video

Then verify if the datasource is supported and query folding is required, refer to:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

Best regards,

Community Support Team_kalyj