Forum Discussion
Invoking dataflow with parameterised workflow and workspace id - fails
Have encountered an error where a pipeline executes a dataflow gen 2 action.
The dataflow is fully parameterised using parameters pulled from variables libraries.
The pipeline fails stating "Unexpected dataflow error". However when using fixed workspace and dataflow id's it works fine.
Inspecting the pipleine run shows the JSON inputs to the dataflow to be almost identical - but it's missing a key value "dataflowType": "DataflowFabric".
I was able to manually correct this by commiting the pipeline to source control and adding the missing key+value in the 'pipeline-content.json' file then re-syning back to fabric.
Would be great if the UI didn't miss this
Hello SayX-Inde ,
I've had the same problem for several months. I noticed that the line disappears when we're on the ‘PowerBI’ experience at the bottom left, so it removes the line, whereas if we take the ‘Fabric’ experience, the line doesn't disappear.
As you say, it should be fixed, but in the meantime, this is the only thing I've found that prevents the problem from occurring.
I hope this helps.
Please feel free to give me a little kudo or validate my answer as the solution.
Have a nice day,
Vivien
5 Replies
Hello SayX-Inde ,
I've had the same problem for several months. I noticed that the line disappears when we're on the ‘PowerBI’ experience at the bottom left, so it removes the line, whereas if we take the ‘Fabric’ experience, the line doesn't disappear.
As you say, it should be fixed, but in the meantime, this is the only thing I've found that prevents the problem from occurring.
I hope this helps.
Please feel free to give me a little kudo or validate my answer as the solution.
Have a nice day,
VivienHi SayX-Inde,
Thanks for sharing this.
Are you able to open a ticket with Microsoft about this? That way it can get reported through proper chains and be placed on the todo list for the engineers to fix.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
Hi SayX-Inde ,
Thank you for reaching out to the Microsoft Community Forum.
Hi tayloramy and vivien57 , Thank you for your prompt responses.
Hi SayX-Inde ,
When you configure a Pipeline --> Refresh Dataflow (Gen2) activity and parameterize the Workspace ID and/or Dataflow ID using Library Variables, the Fabric UI fails to emit a required property in the generated pipeline definition:
"dataflowType": "DataflowFabric"
As a result, The pipeline validates, The pipeline starts and the activity fails at runtime with “Unexpected dataflow error”.Note: By committing to source control and manually adding: "dataflowType": "DataflowFabric", you restore the missing contract expected by the Fabric runtime. Once re-synced: Pipeline runs successfully, Parameters resolve correctly and Gen2 dataflow executes as expected. This confirms the issue is UI-generation related, not configuration related.
As mentioned by tayloramy , Please raise support ticket in the below link.
How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn
Regards,
Dinesh
