Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
pradeep1427
New Member

Incremental Refresh Partitions - Missing Data for last day of each month

Hi,
We have Incremental Refresh Configured for different tables in a dataset. The paritions are created on monthly basis. The backend tables are updated every morning for the previous date. 

For example, on 30-Sep morning at 4.00am, the backend tables gets the data for 29-Sep.

 

As Monthly partitions are created, last day of the month is missing in the data.

Example:

On 30-Sep, the scheduled refresh happens and brings in 29-Sep data.

On 1-Oct, The scheduled refresh creates a new partition for October and skipping the 30-Sep refresh. (This is my assumption based on the missing data for last day of each month)

I am not sure, if I am missing anything here. Please suggest.

 

Thank you!

1 ACCEPTED SOLUTION
v-henryk-mstf
Community Support
Community Support

Hi @pradeep1427 ,

 

Refer to the following documentation steps to see if you have set up the wrong parameters, filtered data or defined policies.

For more details, you can read below document:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

Troubleshoot incremental refresh and real-time data in Power BI - Power BI | Microsoft Learn


If the problem is still not resolved, please provide detailed error information and related operation screenshots. Looking forward to your reply.


Best Regards,
Henry


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

4 REPLIES 4
SaraPulgarin
Frequent Visitor

Where you able to solve this issue?

v-henryk-mstf
Community Support
Community Support

Hi @pradeep1427 ,

 

Refer to the following documentation steps to see if you have set up the wrong parameters, filtered data or defined policies.

For more details, you can read below document:

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

Troubleshoot incremental refresh and real-time data in Power BI - Power BI | Microsoft Learn


If the problem is still not resolved, please provide detailed error information and related operation screenshots. Looking forward to your reply.


Best Regards,
Henry


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

amitchandak
Super User
Super User

@pradeep1427 , Are you refreshing only one day of data? You can refresh for more than a day or month

Hi @amitchandak,
My table is archiving 5-years of data (60 Months).
I have Detect Data Changes enabled and I am Incrementally Refreshing for all the 60 Months, so that it can detect any change in data in the last 60 months. 
Everything else is working fine, except for the last day of each month, which is being missed out once the month changes and creates a new partition.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

AugPowerBI_Carousel

Power BI Monthly Update - August 2024

Check out the August 2024 Power BI update to learn about new features.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.