Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes! Register now.

Reply
RobertSlattery
Responsive Resident
Responsive Resident

How does incremental refresh work on staging tables

I need to add an index column to a table in a dataset but, incremental refresh breaks this.  I created a staging table and configured it for incremental refresh to load three years of data then refresh one day.  I reference that table in a second query and add the index column there.  I set the RangeStart and RangeEnd parameters to one year so it is manageable for testing in the desktop.

I publish the report and refresh the dataset in the service.

In the service, I can see the full three years of data in the staging table but only one year in the referencing table.  There is no filter on the referencing table.  Why is this?  I don't see any query folding in the referencing query, folding stops in subsequent steps in the staging query after the filter step for IR.

1 ACCEPTED SOLUTION

RangeStart and RangeEnd.

 

Depends on the partition size. When you refresh individual partitions it must not result in duplicate indexes across all partitions.

View solution in original post

3 REPLIES 3
lbendlin
Super User
Super User

Your index must be a composite key including the partition name.

Interesting!

How can I get the partition name in a column?  I couldn't find any other way so, I just added a hash column based on the RangFrom and RangeTo parameters.

RangeStart and RangeEnd.

 

Depends on the partition size. When you refresh individual partitions it must not result in duplicate indexes across all partitions.

Helpful resources

Announcements
September Power BI Update Carousel

Power BI Monthly Update - September 2025

Check out the September 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors