Forum Discussion

DennesTorres's avatar
DennesTorres
Power Participant
2 years ago
Solved

Can't find dataflow

Hi, After creating a dataflow, I'm adding a dataflow activity to my pipeline, but for some reason the pipeline can't find the dataflow. The image below illustrates the problem. What am I missin...
pipelines
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi DennesTorres 
    We haven’t heard from you on the last response and was just checking back to see if you can provide the details asked above. This helps us in understanding the issue and help you better.
    Thanks

  • DennesTorres's avatar
    DennesTorres
    2 years ago

    Hi,

    Your troubleshooting steps and some investigation with the support managed to solve the problem.

    The solution: Dataflows are not visible to the Dataflow activity in pipelines before they are published.

    Well, it seems to make sense, except for one detail: When the dataflow is "Published" it is Executed. Sometimes, like on the situation I have in hands, I had no intention to execute the dataflow outside the orchestration of the pipeline.

    Luckly, it was possible to workaround and execute, but I keep imagine situations where it wouldn't make sense.

    It seems a pending improvement.

     

    Kind Regards,

     

    Dennes

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi DennesTorres 
We haven’t heard from you on the last response and was just checking back to see if you can provide the details asked above. This helps us in understanding the issue and help you better.
Thanks

momajasa's avatar
momajasa
Regular Visitor
1 year ago

Hello Anonymous 

this issue still persists and it's causing my firm some big issue during a BC Go-Live in combination with MS Fabric Power BI Reports.

The Dataflow is supposed to run every 5 minute to load BC Data into Fabric, but it's not visible in the drop-down list of the data pipeline's dataflow activity.

 

I have tried all the mentioned steps several times without luck:

  • Dataflow Gen2 is published
  • Workspace is fabric enabled (even 3 different workspaces)
  • creating new dataflow didn't solve the problem

I have used dataflows in pipelines across several projects and never faced anything like this.

Please let me know of any Tenant Level Setup necessary to enable this - this is supposed to be a core feature and besides the fact that Microsoft has caused us a huge amount of shame facing our customers by not enabling git integration and other basic data engineering features for dataflows, such occurences make customers second guess if MS Fabric was the right way to go.

 

Please fix these things before implementing any new fancy features to MS Fabric, it's making life hell for us.

 

Thank you for your understanding