topic Re: No refreshing in Dataflow

No refreshing

ebjim — Wed, 20 Sep 2023 15:18:04 GMT

Is there anyone who is not able to refresh dataflows? I get the spinning circles next to the DF name after publishing it, but it dies off (no spinning circles next to the date). If I try to refresh from the workspace, nothing happens. For me, it started this morning (last night was fine). I am on US central time, in the US north central Fabric region.

Re: No refreshing

HankoSwart — Wed, 20 Sep 2023 15:19:56 GMT

Same here - Dataflows Gen 2 are not refreshing whether they are triggered manually or from within a Pipeline. This is also true across all our workspaces

Re: No refreshing

ebjim — Wed, 20 Sep 2023 15:54:40 GMT

I hope the forum admins take note. If this is systemic, a support ticket would not suffice.

Re: No refreshing

jbxfd — Wed, 20 Sep 2023 19:26:50 GMT

I am having the same problem. Saw one other post on reddit, but other than that, I have not seen any acknowledgement that this is a widespread issue.

Re: No refreshing

HankoSwart — Wed, 20 Sep 2023 20:27:30 GMT

The Reddit post titled "Data Flow Gen 2 Stops refreshing without error" was also me. Shows you how deperate I am to get it working.

Re: No refreshing

miguel — Wed, 20 Sep 2023 21:31:13 GMT

hi folks,

You can check the status of any service outtages, degradation or issues by visiting the Status website (link below):

https://support.fabric.microsoft.com/support/

In that same page you should be able to find the links to raise a support ticket. I can't really tell what could be happening for your scenario, but the best way is to have an engineer have a closer look at it to determine what could be happening and provide a fix.

You should be able to refresh your Dataflow.

Re: No refreshing

Anonymous — Thu, 21 Sep 2023 08:14:24 GMT

Hi ebjim , All,

We are seeing an increase in failures related to upcoming billing and thorttling changes to Fabric artifact's handling of usage > than 24 hours of capacity. At the moment, this applies to US North and UK regions and we're rolling back changes that react to over used capacities ASAP to provide relief in the short term.

I recommend reading the following article, and updating your capacity Metrics apps to better prepare for the eventual enablement of throttling.

Fabric Capacities – Everything you need to know about what’s new and what’s coming | Microsoft Fabric Blog | Microsoft Fabric

We are also accelerating better handling and experiences to help Dataflow customers understand when capacities are over-loaded.

Thank you,

Ben

Re: No refreshing

HankoSwart — Thu, 21 Sep 2023 10:04:38 GMT

Seems like this issue solved itself. Had comms with Microsoft and could not find any issues.

For future reference, as suggested by Microsoft:

In these cases, as a next action, we would proceed to collect Browser Traces while recreating the issue for further investigation. Which I think is not possible now.

So, if you see this kind of behavior in future, please try to collect the traces in below way and provide us:

Here is the process to collect the browser logs:

Navigate to ellipse icon on the browser (3 horizontal/vertical dots)

> More tools > Developer tools > Then find network tab > clear all the pre collected traces (if any) by clicking on clear option

> on the same line Enable preserve log and Disable cache > Then start try refreshing the dataset till it throws an error. > Then export the logs by clicking on export HAR. (download Icon)

Re: No refreshing

BDobbins — Thu, 21 Sep 2023 10:49:03 GMT

Having the same issue, refreshing a Gen2 shows no change in refresh history. All pipelines using Gen2 connection show "in progress" but only for Gen2 and never changes, but actual connection shows untouched. Everything else refreshes fine.

Even got a notification that a Gen2 refresh failed this morning but no reason or signs that dataflow was actually triggered in refresh history.

This started yesterday morning around 8am for us, flows were working right up to that point.

Ticket made with Microsoft but no resolution yet.

Re: No refreshing

BDobbins — Thu, 21 Sep 2023 12:35:30 GMT

As of 8am EST today, the issue resolved itself and we are getting successful refreshes again.

No changes were made from our side.

Re: No refreshing

ebjim — Thu, 21 Sep 2023 13:20:14 GMT

Anonymous Would the failures you're referring to include problems with Warehouses (e.g. the inability of Warehouse UI to launch, long running queries terminating with no results, etc.) and Lakehouses (e.g. slow to no synchronization of SQL endpoint with the Lakehouse)?