Forum Discussion

DennesTorres's avatar
DennesTorres
Power Participant
2 years ago
Solved

Can't find dataflow

Hi,

After creating a dataflow, I'm adding a dataflow activity to my pipeline, but for some reason the pipeline can't find the dataflow.

The image below illustrates the problem. What am I missing? The dataflow is in the workspace.

 

 



Kind Regards,

Dennes

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi DennesTorres 
    We haven’t heard from you on the last response and was just checking back to see if you can provide the details asked above. This helps us in understanding the issue and help you better.
    Thanks

  • DennesTorres's avatar
    DennesTorres
    2 years ago

    Hi,

    Your troubleshooting steps and some investigation with the support managed to solve the problem.

    The solution: Dataflows are not visible to the Dataflow activity in pipelines before they are published.

    Well, it seems to make sense, except for one detail: When the dataflow is "Published" it is Executed. Sometimes, like on the situation I have in hands, I had no intention to execute the dataflow outside the orchestration of the pipeline.

    Luckly, it was possible to workaround and execute, but I keep imagine situations where it wouldn't make sense.

    It seems a pending improvement.

     

    Kind Regards,

     

    Dennes

11 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi DennesTorres 
    Thanks for using Fabric Community.
    The issue you’re encountering where the pipeline can’t find the dataflow might be due to a few reasons:

    Dataflow Configuration: Ensure that you’ve correctly configured the dataflow activity in your pipeline.           Double-check that you’ve selected the correct dataflow from the dropdown list in the activity settings.

    Workspace and Permissions: Make sure you’re working in the correct Microsoft Fabric-enabled workspace (not the default “My Workspace”). 

    This might be an intermittent issue also. Please wait for sometime and retry. If the issue still persists please do let us know. Hope this helps.

    • DennesTorres's avatar
      DennesTorres
      Power Participant

      Hi,

      It's not during execution, the error happens when selecting the dataflow in the dropdown, so I can't select it.

      Yes, the dataflow is in the same workspace as the pipeline.

      I remember, from data factory, some name requirements on the dataflows, so I tried to rename it, removing spaces and leaving everything lowercase, but it didn't solve the problem. I still think it's some not so obvious requirement not fulfilled.

       

      Kind Regards,

       

      Dennes

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi DennesTorres 
        Is it the same in all the workspaces? Or this is happening only in this workspace? Is the Dataflow published successfully? If so, how recently?
        Try creating another dataflow and check. Is the Dataflow published recently?
        Please let me know if the issue persists. 

  • I have the same issue in our Fabric workspace. A pipeline is being cretaed but I can't find any of the dataflows even if they have been published.
    Any other things to look at? It's working for another customer though.

  • Hi, 

     

    I had the same problem yesterday and still having it today, so waiting is not the solution. The dataflow has been published many times and locates in the same workspace as the pipeline, but during the creation of the element in the pipeline does not list me dataflows in any workspace.

     

     

     

    thank you !...

     

    Sebastian A.