can I Apply Conditions/query to data flow?

[Anonymous]

is there a way I can apply a query before I pull the data from the data flow created?

I have an Azure table with every second new row updated and which is built in dataflow as now but while refresh it takes 10m - 15m and I want to increase the performance. can I apply a query before pull in my data like we do in APIs? 

I want to apply date created within 4 months.

[Anonymous]

Thanks, but as you mentioned it's only with a premium license.

[v-xiaoyan-msft · Accepted solution]

Hi @Anonymous ，

If you want to refresh only the most recent months, maybe you can try manually adding a filter to the power query to filter the last four months and then recopy the whole query into dataflow. This is the easiest way to do it.

Hope it helps,

Community Support Team _ Caitlyn Yan

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

[v-xiaoyan-msft]

Hi @Anonymous ，

According to your description, you can use incremental refresh for the data flow.

Incremental refresh, which provides the following benefits for dataflows:

• Refresh occurs faster: Only data that's changed needs to be refreshed. For example, refresh only the last five days of a 10-year dataflow.
• Refresh is more reliable: For example, it's not necessary to maintain long-running connections to volatile source systems.
• Resource consumption is reduced: Less data to refresh reduces overall consumption of memory and other resources.

When using incremental refresh, the Power BI service dynamically partitions the data and separates the data that needs to be refreshed frequently from the data that is refreshed infrequently. In each subsequent refresh, the query will filter and return only those records within the refresh period dynamically defined by the parameters.
Because less data needs to be refreshed, the overall use of memory and other resources in Power BI and the data source system is reduced.

Incremental refresh is available in dataflows created in Power BI and dataflows created in Power Apps.

Using incremental refresh in dataflows created in Power BI requires that the dataflow reside in a workspace in Premium capacity.  You need to have a Power BI Premium or Power BI Premium Per User license.

For more information,Please see: Using incremental refresh with dataflows 

Hope it helps,

Community Support Team _ Caitlyn Yan

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.