Forum Discussion
Incremental load with pre filter data
I want to import data from table, but I want to apply filter before importing the data to Power BI. Is it possible with Import option? Once I imported the data. I want to schedule incremntal refresh on modified date. So with pre filter is it possible to setup incremental refresh?
Note: Incremental refresh should be automatic, based on modified date
Might be an option. Enabling DirectQuery for an ODBC-based Power Query connector - Power Query | Microsoft Learn
For Hive ODBC, install the Cloudera driver, setup your connection in the ODBC manager, and consume it. Nothing special, really.
3 Replies
You are describing the concept of "Query Folding", pushing computation upstream. It is generally a desired (but not mandatory) part of the incremental refresh setup.
lbendlin Thanks for your reply. I am using HIVE as data source. It seems it doesn’t support query folding. I even tried to enable query folding manually as mentioned in below video but it doesn't work
https://www.youtube.com/watch?v=8hjdOCni_ZY
Is there other way around. One way I found we can use ODBC drivers, but I am not sure how it will work in HIVE data source
Might be an option. Enabling DirectQuery for an ODBC-based Power Query connector - Power Query | Microsoft Learn
For Hive ODBC, install the Cloudera driver, setup your connection in the ODBC manager, and consume it. Nothing special, really.