Filtering dataflow

[StephenF]

Anyway to request only certain rows from a dataflow like you can with a direct sql datasource?

I only want to get the most recent days data from a rather large dataflow table.

[rdnguyen]

Yes, it is possible to siphon segment of datatable instead of take all using Power Query with filter condition.

I tried loading 2.5M records in two test dataflow, one load full and the other one has filter either by datetime or certain condition.

The full load from On primes to Power BI service took 30 sec for full load and 11 sec for filtered data into the second flow.

[Anonymous · Accepted solution]

Hi @StephenF,

I check the document of the rest API but did not find the corresponding API to achieve your requirement.

Dataflows - REST API (Power BI Power BI REST APIs) | Microsoft Docs

If you are working with the power bi dataset, you can enable the XMLA endpoint to accurately manage these.

Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Docs

For this scenario, maybe you can try to use query parameter with your dataflow:

parameters-dataflows-power-bi-service-power-query-powerbi (p3adaptive.com)

Regards,

Xiaoxin Sheng

[lbendlin]

Begs the question why you use a dataflow in the first place? A dataset might have been a better solution.

Sadly, Microsoft are actually working on offering Direct Query for dataflows, by using an Azure SQL server database  as a front to the dataflow. Truly messed up, in my opinion.

[StephenF]

Because I am working remotely and cant directly query the DB and dont have a vpn tunnel.