Forum Discussion
Incremental refresh is getting failed with Power BI Premium per user Capacity
As you might already aware, during the initial load or first load, a semantic model with incremental refresh policy will load all the data into the table. For example if you have set the data archival policy as last 2 years then that much amount of data will be loaded into the table and data will be splitted into multiple partitions. During that time, a significant number of queries will hit the db depending on the incremental policy you might have implemented.
If your source db could not handle those many queries then the refresh operation might throws time out erros. In order to avoid such scenarios, I would suggest you to
1. Bootstrap your fact table, (remove all the records by adding a filter, make sure queries are folding)
2. Publish the dataset and perform the refresh operation. During the first refresh power bi will create an empty table with empty partitions.
3. After the first refresh you can load the data into these paritions one after the other.
This approach is a well documented and tested. I myself have performed this activity many times. I guess it would your problem as well. I am sharing the microsoft doc, it contains more info about this process, please go through it
Connect on LinkedIn
Did I answer your question? Mark my post as a solution! If I helped you, click on the Thumbs Up to give Kudos.
Proud to be a Super User!
Super UserAs you might already aware, during the initial load or first load, a semantic model with incremental refresh policy will load all the data into the table. For example if you have set the data archival policy as last 2 years then that much amount of data will be loaded into the table and data will be splitted into multiple partitions. During that time, a significant number of queries will hit the db depending on the incremental policy you might have implemented.
If your source db could not handle those many queries then the refresh operation might throws time out erros. In order to avoid such scenarios, I would suggest you to
1. Bootstrap your fact table, (remove all the records by adding a filter, make sure queries are folding)
2. Publish the dataset and perform the refresh operation. During the first refresh power bi will create an empty table with empty partitions.
3. After the first refresh you can load the data into these paritions one after the other.
This approach is a well documented and tested. I myself have performed this activity many times. I guess it would your problem as well. I am sharing the microsoft doc, it contains more info about this process, please go through it
Connect on LinkedIn
|
