Datalfow refresh ignores filter

Question

Hi all,I hope someone can help. I have Pro license and working on getting a premium or ppu license. I have one specific dataflow that pulls from a SQL database and within my query I have the data filtered specifically by the RFP date after 1/1/2021. I have the dataflow on a scheduled refresh but for some reason when it is on a scheduled refresh, it ignores this particular filter and only provides the first 2021 data only.&nbsp;It is a weird because I am pulling from the same SQL database but different tables and don't have any issues. It is only when I pull data and filter from the Deals table.&nbsp;Can someone shed some light? I really appreciate it.&nbsp;&nbsp;

v-xiaosun-msft · Accepted Answer

Hi&nbsp;ysherriff&nbsp;
&nbsp;
Dataflow will perform two kinds of refresh: full refresh and incremental refresh. Incremental refresh applies to Premium only.
Full refresh will perform a complete flush.
When using incremental refresh, it processes a subset of your data based on time-based rules, expressed as a filter, that you configure. The filter on the date column is used to dynamically partition the data into ranges in the Power BI service. After incremental refresh is configured, the dataflow automatically alters your query to include filtering by date.
&nbsp;
Please reference the following document.
Understanding and optimizing dataflows refresh - Power BI | Microsoft Learn
&nbsp;
Best Regards,Community Support Team _ xiaosun
If this post&nbsp;helps,&nbsp;then please consider&nbsp;Accept it as the solution&nbsp;to help the other members find it more quickly.

Forum Discussion

Datalfow refresh ignores filter

2 Replies

Related content

Refresh dataset api

Scheduled refresh - ignore tables without connection

Increment Refresh

ValueFormatter ignoring culture

Refresh issue