Forum Discussion
Reversed hybrid table with incremental refresh
- 1 year ago
Hi dmkblesser ,
Thanks for your response. You're looking for a Reverse Hybrid Table where recent data is in Import mode and historical data is in DirectQuery.
Have you tried this approach.
-
Set up Incremental Refresh in Power BI to create partitions.
-
Use Tabular Editor or TOM API to convert older partitions to DirectQuery.
-
Apply dataCoverageDefinition to specify which partitions should be Import vs. DirectQuery.
-
Validate Queries to ensure smooth performance.
Have you tried modifying partitions after setting up incremental refresh? Let us know where you're facing challenges.
Helpful References : Use hot and cold table partitions to optimize very large Power BI data models | Microsoft Learn.
Regards,
Yugandhar. -
It's also possible to convert an Import table to a hybrid table by adding a DirectQuery partition using Tabular Model Scripting Language (TMSL) or the Tabular Object Model (TOM) or by using a third-party tool. For example, you can partition a fact table such that the bulk of the data is left in the data warehouse while only a fraction of the most recent data is imported. This approach can help to optimize performance if the bulk of this data is historical data that is infrequently accessed. A hybrid table can have multiple Import partitions, but only one DirectQuery partition.
Is that what you are trying to do?
- dmkblesser1 year ago
Advocate II
Hi lbendlin, thanks for the reply. The part you refered to, it covers the hybrid table part but not the incremental refresh part. what I'm trying to achieve is say I have data from 2020 till now.
I want 2020-01-01 - 2023-12-31 in DQ and 2024-01-01 to 7 days before today in archive (Import) and incrementally refresh the past 7 days data (import).
- lbendlin1 year ago
Super User
Use your favorite tool to set the partition refresh policy and the partition type