Forum Discussion
katushka_enko
1 year agoFrequent Visitor
How to exclude large historical table from refresh in Power BI?
Hi Power BI Community,
I’m facing an issue with refresh performance in my Power BI report due to a large historical dataset. I’ve tried the Hot & Cold Data approach, but the historical table is still being queried during refresh, even though it’s marked as "not included in report refresh."
My setup:
- Historical Table (COLD): ~200 million rows, 93 columns, stored in an SQL database.
- Enable Load: Enabled
- Include in Report Refresh: Disabled
- Current Table (HOT): ~17 million rows, but growing every month.
- Enable Load: Enabled
- Include in Report Refresh: Enabled
- Final Table (APPEND): Combining both tables in Power Query using Table.Combine({Historical, Current}).
The issue:
- Even though Historical is excluded from refresh, Power BI still queries it when updating the final appended table.
- The Incremental Refresh approach is not feasible due to file size constraints and the number of columns (93).
- The SQL queries are simple SELECT statements, but they take too long due to the large data volume.
- The goal is to only refresh the Current table while keeping the Historical table static in the model.
What I’ve tried so far:
- Disabled refresh for Historical – but Power BI still queries it during Append.
- Table.Buffer() – didn’t work, as Power BI still re-executes the SQL query.
- Using Dataflows – not an option at the moment.
- DirectQuery for Historical – makes queries slower due to large data volume.
My Question:
1 - How can I append the Current and Historical tables while ensuring that Power BI does NOT re-query the Historical data during refresh?
2 - Is there a way to store the Historical table in the model without it being queried every time the Current table refreshes?
Any advice or workarounds would be greatly appreciated!