Dataflow Not Running with dynamic variables from Variable Library in Fabric Pipeline

[Darshan22]

Hi Everyone,

I'm working with Microsoft Fabric pipelines and using a Variable Library to dynamically assign values to the Dataflow activity, specifically for workspaceId and dataflowId.

My Setup:

• I've created a Variable Library with the following variables:

  • env: contains the Workspace ID (GUID)

  • movex_customers: contains the Dataflow ID (GUID)

  • dataflow_type: contains the value "DataflowFabric"

  • 

In the pipeline Dataflow activity:

• Workspace ID:
  @pipeline().libraryVariables.env

• Dataflow ID:
  @pipeline().libraryVariables.movex_customers

• 

The Problem:

When I use these variables, the Dataflow activity fails with the following error:

{
  "error": {
    "code": "InvalidRequest",
    "message": "Unexpected dataflow error"
  }
}

Fabric doesn't know it should treat the activity as a Dataflow, so it throws a generic internal error instead of a clear validation failure. This error goes away only when I add the following field to the activity configuration manually in JSON view:

"dataflowType": "DataflowFabric"

However, the Fabric pipeline UI does not expose a field for dataflowType when using dynamic inputs — only when selecting a Dataflow statically.

---

What I’ve Tried:

1. Variable substitution via expression:

   • Created a variable: dataflow_type = "DataflowFabric"

   • Referenced in activity: @pipeline().libraryVariables.dataflow_type

   • → Field still missing in UI or has no effect

2. Set Variable / Script activity workaround:

   • Used a Set Variable or Script activity to define:

     resolved_dataflow_type = "DataflowFabric"

   • Referenced: @variables('resolved_dataflow_type')

   • → Still not picked up; there's no place to plug it in via UI

3. Hardcoding works:

   • Manually typing Workspace ID and Dataflow ID → activity runs successfully

   • Adding dataflowType via JSON works

   • When dynamic expressions are used for IDs and dataflowType is not set, it fails with “Unexpected dataflow error”

---

What I'm Looking For:

• Why is Fabric not recognizing the activity as a DataFlow?

• How can I dynamically set dataflowType = "DataflowFabric" when using a Variable Library?

• Is there a hidden property, advanced field, or workaround to inject this value in the UI?

• Is there a future update planned to make dataflowType configurable from the designer?

---

Happy to share screenshots or test results if needed.

Thanks in advance!

[v-prasare · Accepted solution]

Hi @Darshan22 ,If your blocked here in this scenario i suggest you to raise a support ticket here. so, that they can assit you in addressing the issue you are facing. please follow below link on how to raise a support ticket:

How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

Thanks,

Prashanth

[bsmithUI]

I am running into this exact same problem, feels like it should work given you can dynamically populate the Dataflow ID...but something isn't wired correctly. I noticed the only real difference is the missing dataflowType = "DataflowFabric" when you compare the inputs.

[v-prasare]

Hi @Darshan22,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

Thanks,

Prashanth Are

MS Fabric community support

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

[Darshan22]

Hi @v-prasare, 

The solution provided focus on dynamically setting Library variables. Whereas in this case the Library variables are static, they do not change. This query concerns with dynamically defining the Dataflow id and Workspace Id using Library variables. So no, it doesn't really answer my question.

Thanks,
Darshan 

[v-prasare]

Hi @Darshan22,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

Thanks,

Prashanth Are

MS Fabric community support

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

[v-prasare]

Hi @Darshan22,

Please refer to below similar solved thread from community and let me know if this helps?

https://community.fabric.microsoft.com/t5/Data-Pipeline/dynamic-library-variables/m-p/4663725/highli...

Thanks,

Prashanth Are

MS Fabric community support

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query