topic Re: Dataflow Gen2 with lots of queries Crashing in Dataflow

Dataflow Gen2 with lots of queries Crashing

AnthonyGenovese — Wed, 23 Aug 2023 18:18:51 GMT

I have a dataflow gen2 with 46 queries in it. (Loads a bunch of small dimension tables to the lakehouse).

When I open the dataflow editor, it opens with the mouse spinning. Then after 5 minutes it crashes to an error as seen below.

Session ID: 0670394e-d031-4928-9088-e00ec56c722d

Re: Dataflow Gen2 with lots of queries Crashing

DennesTorres — Thu, 24 Aug 2023 07:37:45 GMT

Hi,

I suggest you report it as an issue (https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues) or open a support ticket, there is not enough to reach a conclusion.

However, would it be possible to break this down in multiple dataflows ? You can still orchestrate all of them using a pipeline.

Kind Regards,

Dennes

Re: Dataflow Gen2 with lots of queries Crashing

Anonymous — Mon, 28 Aug 2023 23:31:09 GMT

AnthonyGenovese Are you still seeing this issue? We believe it's transient and shouldn't be showing up anymore. If you're still seeing it, I'd suggest hard reloading the page with your Dataflow Gen2:

- Press F12 to bring up your browser's developer tools window

- Click and hold your brower's refresh button to bring up more options. Click on "Empty cache and hard refresh":

If this doesn't fix the issue, let us know.

Re: Dataflow Gen2 with lots of queries Crashing

AnthonyGenovese — Wed, 20 Sep 2023 22:00:24 GMT

It looks like this issue no longer happens. It is slow and takes a while to load or interact with, but it doesn't crash.

I think best practice at this point is to make sure you limit your queries to something more managable, because having 46 in one dataflow did now work well. Maybe there should be some best practices published on this! It allows me to select *all* the tables I want in the wizard.