Forum Discussion
Helper IIncremental Load in Power BI On-Premises
Hi,
We need to implement Incremental load in Power BI on-premises.
We have one table 'Table A' with huge data. we created other table 'Table B' where we are loading only latest date data from Table 'A'.
We need to refresh 'Table A' only once in a week and need to refresh Table 'B' on daily basis.
Can anyone please suggest how we can implement that in on premises environment? The data source we are using is SQL Server.
Thanks,
Poonam
Hi patilpoonam21 ,
I want to validate the valuable input provided by lbendlin . Their initial thoughts helped guide my approach. However, I've noticed that more detail is needed to fully understand the issue.
The "Start incremental refresh data before refresh date" setting determines the incremental refresh period, where all rows with dates/times within this period are included in the refresh partition and are refreshed each time a refresh operation is performed.
For example, if you specify a refresh period of three days, the service overrides the RangeStart and RangeEnd parameters at each refresh to create a query for rows with dates/times within three days, whose start and end times depend on the current date and time. Rows with dates/times within the last three days up to the time of the current refresh operation will be refreshed. Depending on your needs, you can set the period to 7 days.
More details can be found in the documentation: Incremental refresh for semantic models and real-time data in Power BI - Power BI | Microsoft Learn.
If your Current Period does not refer to this, please clarify in a follow-up reply.
Best Regards,
Clara Gong
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
2 Replies
- lbendlin
Super User
Incremental Refresh doesn't have a concept of "weeks". Your partitions can only be by day, month, quarter and year.
Hi patilpoonam21 ,
I want to validate the valuable input provided by lbendlin . Their initial thoughts helped guide my approach. However, I've noticed that more detail is needed to fully understand the issue.
The "Start incremental refresh data before refresh date" setting determines the incremental refresh period, where all rows with dates/times within this period are included in the refresh partition and are refreshed each time a refresh operation is performed.
For example, if you specify a refresh period of three days, the service overrides the RangeStart and RangeEnd parameters at each refresh to create a query for rows with dates/times within three days, whose start and end times depend on the current date and time. Rows with dates/times within the last three days up to the time of the current refresh operation will be refreshed. Depending on your needs, you can set the period to 7 days.
More details can be found in the documentation: Incremental refresh for semantic models and real-time data in Power BI - Power BI | Microsoft Learn.
If your Current Period does not refer to this, please clarify in a follow-up reply.
Best Regards,
Clara Gong
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
