Forum Discussion

automation's avatar
automation
Frequent Visitor
5 months ago

Help needed: Detect Data Changes on Modified column with Incremental Refresh

Hi, I’ve configured incremental refresh on a Power BI dataset. The source is SQL views, and the underlying tables contain both Created and Modified date columns. In Power Query, I applied the...
Show and Tell
automation's avatar
automation
Frequent Visitor
5 months ago

Hi Natarajan_M ,

I've implemented a last 60 months incremental refresh with data detect changes on my dataset. However, with Power BI Premium Per User (PPU) license, the dataset is not refreshing completely and I'm encountering timeout errors.

Could you please help me resolve this issue?

Thanks!

Natarajan_M's avatar
Natarajan_M
Super User
5 months ago

Hi automation ,

After you publish the PBIX file, the first load will involve a complete refresh, meaning that all partitions will be processed. Please verify whether the size of the semantic model exceeds the capacity limits.


To overcome the size issue you can follow the below approach : 

define a parameter as LoadAllData 

 

 

 


In Power Query step 

Let
....
SampleData = Table.FirstN(Source, 10),
Check = if LoadAllData then Source else SampleData

in
Check




Keep the default value as False and publish the model to service and do the first refresh .

The first refresh will take care of creating all the partitions in the servivce , now set the LoadAllData to True and process the partitions one by one using ssms or fabric notebook.

 

 

Thanks

 

If this response was helpful in any way, I’d gladly accept a kudo.
Please mark it as the correct solution. It helps other community members find their way faster