Dataflow Gen2 with lots of queries Crashing

[AnthonyGenovese]

I have a dataflow gen2 with 46 queries in it. (Loads a bunch of small dimension tables to the lakehouse).

When I open the dataflow editor, it opens with the mouse spinning. Then after 5 minutes it crashes to an error as seen below.

Session ID: 0670394e-d031-4928-9088-e00ec56c722d

[DennesTorres · Accepted solution]

Hi,

I suggest you report it as an issue (https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues) or open a support ticket, there is not enough to reach a conclusion.

However, would it be possible to break this down in multiple dataflows ? You can still orchestrate all of them using a pipeline.

Kind Regards,

Dennes

[Anonymous · Accepted solution]

@AnthonyGenovese Are you still seeing this issue? We believe it's transient and shouldn't be showing up anymore. If you're still seeing it, I'd suggest hard reloading the page with your Dataflow Gen2:

- Press F12 to bring up your browser's developer tools window

- Click and hold your brower's refresh button to bring up more options. Click on "Empty cache and hard refresh":

If this doesn't fix the issue, let us know.

[AnthonyGenovese · Accepted solution]

It looks like this issue no longer happens. It is slow and takes a while to load or interact with, but it doesn't crash. 

I think best practice at this point is to make sure you limit your queries to something more managable, because having 46 in one dataflow did now work well.   Maybe there should be some best practices published on this! It allows me to select *all* the tables I want in the wizard. 

[Anonymous · Accepted solution]

@AnthonyGenovese Are you still seeing this issue? We believe it's transient and shouldn't be showing up anymore. If you're still seeing it, I'd suggest hard reloading the page with your Dataflow Gen2:

- Press F12 to bring up your browser's developer tools window

- Click and hold your brower's refresh button to bring up more options. Click on "Empty cache and hard refresh":

If this doesn't fix the issue, let us know.

[DennesTorres · Accepted solution]

Hi,

I suggest you report it as an issue (https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues) or open a support ticket, there is not enough to reach a conclusion.

However, would it be possible to break this down in multiple dataflows ? You can still orchestrate all of them using a pipeline.

Kind Regards,

Dennes