Forum Discussion

chris__1's avatar
chris__1
Advocate II
4 years ago

Deployment Pipelines and Dataflows

Hi,   I have a workspace that contains all my Dataflows. This Dataflow-Workspace has the deployment Pipeline enabled. The other workspaces contain reports and datasets that make use of the dataflo...
Dataflow
Need Help
Anonymous's avatar
Anonymous
Not applicable
3 years ago

Hi chris__1,
has your issue been resolved? What was the solution?


Thanks

Michael

chris__1's avatar
chris__1
Advocate II
3 years ago

Hi Michael,

 

unfortunatly this issue has not been resolved for me - hence no solution has been marked.

 

I suspect, that my workspace setup has not been fully understood here - most likely I did not explain very well.

 

Do you have the same setup as I do: 

- One Workspace containing ALL dataflows. This Workspace has deployment Pipelines activated.

- Multiple other workspaces containing reports and corresponding Datasets. Those Workspaces also have Deployment Pipelines activated.

- Trying to have the datasets in the stages "TEST", "DEV", "PROD" automatically connect to the datasets in the corresponding stage of the Dataflow-Workspace.

 

Right now I have all my datasets in *all* stages connected to the PROD stage of the dataflow workspace... which is not the ideal solution.

 

Please let me know if you manage to find a solution!

Thanks, Chris

  • LeeBenjamin's avatar
    LeeBenjamin
    Microsoft Employee
    3 years ago

    Hi  chris__1 

    As for your last point of:
    "Trying to have the datasets in the stages "TEST", "DEV", "PROD" automatically connect to the datasets in the corresponding stage of the Dataflow-Workspace."

    Please advise that the above-mentioned datasets in the stages "TEST", "DEV", "PROD", ARE NOT connected to the dataset on your Dataflows workspaces. they are connected to the dataflows themselves. With that, in order for things to work, please ensure the following:

    On your Datasets and Reports pipeline - Dev stage, select the dataset you'd like to deploy to Test environment and view its lineage. we expect to see that:

    1. It is connected to dataflows on your Dataflows pipeline Dev stage's workspace (I can't see on the lineage view screenshot you sent if this is the case because it is a lineage view of a different dataset than the one you wish to deploy. I can tell by the name). 
    2. Those connected dataflows are also on your Dataflows pipeline Test stage's workspace and are in sync (which is the case per your screenshot of your Dataflows pipeline).

    Once all the above are in place the deployment should be completed successfully. Otherwise, please open a support ticked do we could assist further.
    BR,

    Lee