Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
rob_vander
Helper I
Helper I

Incremental load with pre filter data

I want to import data from table, but I want to apply filter before importing the data to Power BI. Is it possible with Import option? Once I imported the data. I want to schedule incremntal refresh on modified date. So with pre filter is it possible to setup incremental refresh? 

Note: Incremental refresh should be automatic, based on modified date

1 ACCEPTED SOLUTION

Might be an option.  Enabling DirectQuery for an ODBC-based Power Query connector - Power Query | Microsoft Learn

 

For Hive ODBC, install the Cloudera driver, setup your connection in the ODBC manager, and consume it. Nothing special, really.

View solution in original post

3 REPLIES 3
rob_vander
Helper I
Helper I

@lbendlin Thanks for your reply. I am using HIVE as data source. It seems it doesn’t support query folding. I even tried to enable query folding manually as mentioned in below video but it doesn't work

https://www.youtube.com/watch?v=8hjdOCni_ZY

 

Is there other way around. One way I found we can use ODBC drivers, but I am not sure how it will work in HIVE data source

Might be an option.  Enabling DirectQuery for an ODBC-based Power Query connector - Power Query | Microsoft Learn

 

For Hive ODBC, install the Cloudera driver, setup your connection in the ODBC manager, and consume it. Nothing special, really.

lbendlin
Super User
Super User

You are describing the concept of "Query Folding", pushing computation upstream.  It is generally a desired (but not mandatory) part of the incremental refresh setup.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

Jan25PBI_Carousel

Power BI Monthly Update - January 2025

Check out the January 2025 Power BI update to learn about new features in Reporting, Modeling, and Data Connectivity.

Jan NL Carousel

Fabric Community Update - January 2025

Find out what's new and trending in the Fabric community.