Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join us for an expert-led overview of the tools and concepts you'll need to become a Certified Power BI Data Analyst and pass exam PL-300. Register now.

Reply
AnandGNR
Helper I
Helper I

Reduce dataset size Options - Large datasets format -mixed mode, hybrid tables

Hi ,

 

I have a "large dataset" formatted dataset that is apprx 10 gb and growing which is hitting memory constraints even with incremental refresh enabled on a P1 SKU on a import model. 

 

I am looking at exploring options on reducing dataset size. 

 

Is there a way to use hybrid tables inverted so that historical data is in direct query mode and current data is in Import mode?

That would fit my needs since historical will be sparsely used and I dont need "real time" levels of latency. So looking at caching new data for performance.

Alternatively, Can the same be achieved using composite models or any other ideas?

 

 

Hybrid_1.jpeg

 

Thanks,

Anand

1 REPLY 1
Anonymous
Not applicable

Hi @AnandGNR,

In fact, direct query not suitable to handle that stores large amount of records. They will exceed to the limit when use table fields on visual.

Use DirectQuery in Power BI Desktop - Power BI | Microsoft Learn

I'd like to suggest you split these records to two dataset and one used to store these historical data and you create a report with multiple datasets.

Regards,

Xiaoxin Sheng

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 Power BI Update Carousel

Power BI Monthly Update - June 2025

Check out the June 2025 Power BI update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.