topic Dataflow Gen2 failing continously in Data Engineering

Dataflow Gen2 failing continously

Symmonds — Mon, 31 Mar 2025 09:22:08 GMT

Hi Helpers,

I have a Dataflow Gen2 without git integaration. Which is continously getting failed. I know beyond 1hour of try it will get failed.

Is there any option that will automatically trigger refresh when ever there is any failure ?

Thanks in advance.

Re: Dataflow Gen2 failing continously

mabdollahi — Mon, 31 Mar 2025 09:52:44 GMT

Hi @Symmonds
There’s no built-in auto-retry for Dataflow Gen2 in Microsoft Fabric, but you can set up a workaround using Fabric Pipelines with adding dataflow step.

Re: Dataflow Gen2 failing continously

Anonymous — Tue, 01 Apr 2025 09:00:36 GMT

Hi @Symmonds ,

Thank you for posting in the Microsoft Fabric Community.

@mabdollahi answer is correct in suggesting Fabric Pipelines with a Dataflow step, as this gives you flexibility in handling retries and orchestration. If you are looking for a direct retry mechanism within Dataflow Gen2 itself, this feature is not built-in, but the workaround via Fabric Pipelines is the most viable solution. You can also enhance this by using monitoring, alerts, and performance optimizations.

If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.

Thankyou.

Re: Dataflow Gen2 failing continously

Anonymous — Mon, 07 Apr 2025 03:52:11 GMT

Hi @Symmonds ,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

Re: Dataflow Gen2 failing continously

Anonymous — Wed, 09 Apr 2025 09:36:59 GMT

Thank you.

Re: Dataflow Gen2 failing continously

Anonymous — Sun, 13 Apr 2025 14:29:06 GMT

Hi @Symmonds ,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.