Refresh Dataflows REST API processType parameter not working

[drscott1]

Hello, 

There is an unexpected behaviour when using a URI parameter when using the Dataflows - Refresh Dataflow REST API:

https://learn.microsoft.com/en-us/rest/api/power-bi/dataflows/refresh-dataflow#uri-parameters

Specifically, when I add the URI parameter "processType" = "processFull", it does not trigger a full refresh, and still applies the incremental refresh policy.

This is based on the definition of "processType" listed in Microsoft's GitHub here: 

Merged PR 113595: Add Transactions, Update Dataflow, processType to r… · microsoft/PowerBI-CSharp@6b...

There is another related ticket below, however, the response from v-deddai1-msft did not answer the question fully. i.e. how can you bypass the dataflow incremental refresh policy using the "processType" URI parameter. The response from v-deddai1-msft was to manually turn off incremental refresh in the GUI which is time consuming. A programmatic approach should be supported.

Trigger full refresh on a dataflow with incrementa... - Microsoft Power BI Community

What I would like to see is the URI parameter "processType" = "processFull" to work. I would expect a similar behaviour to the way that the Dataset Refresh "type" = "full" and "applyRefreshPolicy" = "false" works to bypass the incremental refresh for a dataset (although this is specified in the body, not as a URI parameter)

https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/refresh-dataset#request-body

@v-deddai1-msft  - would it be possible to relook at this?

Thank you for your help in advance.

[Anonymous]

Hi @drscott1 

Based on the above information, if you are a Power BI Pro licensee, you can create a support ticket for free and a dedicated Microsoft engineer will come to solve the problem for you.

It would be great if you continue to share in this issue to help others with similar problems after you know the root cause or solution.

The link of Power BI Support: https://powerbi.microsoft.com/en-us/support/

For how to create a support ticket, please refer to https://community.powerbi.com/t5/Community-Blog/How-to-create-a-support-ticket-in-Power-BI/ba-p/6830...

Best Regards,
Community Support Team _ Ailsa Tao

[BenFord]

I am also having this issue?  Is there any update on this?

[drscott1]

Hi - I raised a support ticket and in a nutshell this is expected behaviour. Details below.

• From the issue description we understood that you wanted to implement Full Refresh Policy by giving ‘ProcessType’ = ’ProcessFull’ in Refresh Dataflow REST API.
• We have gone through the community page that you have attached on the case and reproduced the scenario in our test environment.
• We connected on call and checked with the dataflows on your workspace.
• We saw that you have incremental refresh enabled in the dataflows.
• When it was enabled, even if you use ‘ProcessType’ = ’ProcessFull’ in Refresh Dataflow REST API, incremental refresh policy will not be bypassed which is an expected behavior.
• Unlike Refresh Dataset REST API, we cannot use ‘applyRefreshPolicy’ in request body for dataflows.
• We also informed you that these features will be updated soon in the upcoming Power BI releases.

[littlemojopuppy]

@drscott1 very helpful.  Seems like a big miss though that you can't override the incremental refresh on a dataflow like you can a dataset.  😑

[gtzanakis]

@littlemojopuppy Thanks for opening this issue, it was imensely helpful for me as well, after trying to overcome the same problem for hours. Indeed a huge miss! We need to perform incremental updates and every so often do a full refresh to make sure that we cover retrospective changes and corrections to the source data and this is a big blow. Did you find any workaround?

@drscott1 do we have any updates on when a full refresh policy akin to "applyRefreshPolicy" = "false" for Datasets may be implemented?

Thank you.