Dataflow stuck in publishing loop

[ftuomey]

Hi,

I have a Gen 2 Dataflow stuck in a publishing loop.  This is a little bit different to other issues where dataflows have a problem refreshing.  Mine doesn't get to the refreshing stage.  It has been stuck in this loop for 24 hours.  

This workspace has Fabric capacity and I want to delete the dataflow to remove the Fabric capacity.  But I cannot delete it.  I paused the Fabric capacity service but that didn't help.  Screenshot below shows the problem.

Thanks in advance,

Fergus

[ftuomey · Accepted solution]

Hi @v-shex-msft ,

I was eventually able to raise a support ticket on this.  The solution turned out to be to use the Power BI API calls and raise a DELETE dataflow call for this dataflow.

For others that may need to do this the API can be found here:

Dataflows - Delete Dataflow - REST API (Power BI Power BI REST APIs) | Microsoft Learn

You will need the workspace id and dataflow id to run the API.

Use Groups - Get Groups - REST API (Power BI Power BI REST APIs) | Microsoft Learn to get the workspace id.

Use Dataflows - Get Dataflows - REST API (Power BI Power BI REST APIs) | Microsoft Learn to get the dataflow id.

Hope this helps someone else.

Fergus

[ftuomey]

Hi,

This is still trying to publish.  Anyone got any ideas?

Thanks

[ftuomey]

Hi,

I moved dataflows from "My Workspace" to another workspace with Fabric Capacity.  I did this by exporting templates of the dataflows in "My Workspace" and then using those to create dataflows in the Fabric workspace.  There were a number of these running at the same time.

The dataflow shown here has two queries.  These queries move data from a "silver" warehouse database to a "gold" warehouse database.  At the time this was created these two databases existed in "My Workspace".  The dataflow was successfully created using the templace in the Fabric capacity workspace, and returned data.  I clicked Publish and it has been stuck at publishing for the last 48 hours.  Additional screenshot below.

Thanks,

Fergus

[v-shex-msft]

Hi @ftuomey,

What type of data source are you worked? Have you assign the fabric capacity to 'my workspace'?

BTW, some of fabric features may not work properly on my workspace. have you try to test these operation on other workspace?

Regards,

Xiaoxin Sheng

[ftuomey]

Hi Xiaoxin,

This is not "My Workspace".  This is a development workspace that has F2 capacity.  This dataflow works correctly on other workspaces we have.

I cannot delete dataflow or remove the F2 capacity from this workspace.

It is still stuck at "publishing" this morning.

Thanks,

Fergus

[v-shex-msft]

HI @ftuomey,

Did this dataflow destination (Lakehouse) is added? AFAIK, current there are some known issues about dataflow refresh and creating staging lakehouse, perhaps you can take a look at the following links and official known issue if they meet to your scenario.

Known issue - Dataflow Gen2 refresh fails due to missing SQL analytics endpoint - Microsoft Fabric |...

Microsoft Fabric Known Issues

Regards,

Xiaoxin Sheng

[ftuomey]

Hi,

It is stuck at the "Publish in Progress" stage.  Does it require the staging lakehouse at that point?

I've read the articles on the two links you sent.  I'm not sure if the first one applies.  It hasn't got to the refresh stage yet.  It is still publishing.

And I've look at all the known issues. I couldn't find one that quite matched my situation.

Thanks,

Fergus

[v-shex-msft]

Hi @ftuomey ,

Can you please share some more detail information about this issue? They should help us clarify your scenario and test to troubleshoot.

Regards,

Xiaoxin Sheng