Forum Discussion
Redshift DB views Incremental Refresh Solution In Power BI
- 8 months ago
Hi Koritala ,
In Power BI, a Hybrid table is a single table that combines both Import mode and DirectQuery for different parts of its data. Usually, historical data is imported and stored in memory, while the most recent data is kept in DirectQuery mode, allowing Power BI to access the latest records directly from the source. This setup is automatically created when incremental refresh is enabled on a Premium or Fabric capacity, together with real-time data access.
As a result, most of the table is imported, and only a small, recent section stays in DirectQuery, giving users the benefits of both Import performance and DirectQuery freshness in one table. This is referred to as a Hybrid table in Power BI.
I'm also providing the Microsoft links for your reference--https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview?utm_source.
Thank you.
Hi Tejrama,
Thanks for your response.
I just want to clarify onething that as you are saying instead of Redshift views, convert those to either to redshiaft tables or Materilized views. then connect those tables or materialized views connect with Import mode. then Foldinf will be enabled.
Here my problem is we are using PPU license and most of the base tables/views pulling more than 10 MB data that is the maximum limit support from power bi. So no way I can use Import mode of tables or Materilized views.
What are your suggestions in this scenario.
Appriciate if you can provide any solution.
Thanks,
Sri
Hello again Koritala ,
The 10 MB warning you are seeing is specific to Power Query’s preview and Desktop query limits, and does not restrict your Import model. For production, model size is determined by your license: Pro allows up to 1 GB per dataset, Premium Per User (PPU) supports up to 100 GB, and Premium capacities can be increased further with Large semantic model storage.
Converting complex Redshift views to tables or materialized views that support query folding enables loading via Import or Hybrid tables on PPU/Premium, and you can set up incremental refresh for efficient updates. Essentially, the preview warning does not prevent Import; ensure your workspace license and query folding capabilities align with your required model size and performance.
Thank you.
- Koritala8 months agoPost Patron
Hi Tejrama,
Thanks for your response.
Thing is like, when I try to import the redshift view to power bi desktop using getdata option and selected the view and clickon load option, after few seconds or a minutes it is throwing a message saying that view has a maximum row limit in size and connect in direct query mode. selected view is not loading into power bi memory if i choose Import mode.
Please sugest in this case how to takle the situation.
Thanks,
Sri
- v-tejrama8 months agoCommunity Support
Hi Koritala ,
Thank you Shubham_rai955 for the helpful input!
Were you able to resolve the issue? If the response addressed your query, kindly confirm. This helps keep the community informed and improves solution visibility.
Thank you for your support!