CI/CD dataflow issue

[GeekAlfPro]

Hello,

In Fabric, i have 2 workspaces (tests and prod)

i have azure devops repos (tests and prod)

i use the pipeline deployment to switch between both.

i have a datapipeline that calls 4 dataflows Gen2 that write data in a datawarehouse.

so far so good.

To avoid time consuming, i tried to set up library variables with the workspaces and the warehouses.

i found this documentation that indicates how to modify the mashup.pq file to drive destination by variables
but despites all my efforts, my prod warehouse is not being populated by the prod dataflows, it is always linked to the testing WS
I publish all git updates
i opened/saved the prod datapipeline and dataflows
without success.

Any idea of what should be checked ?

Thanks !

[GeekAlfPro]

Hi,

i followed the instructions of microsoft here as mentionned

https://learn.microsoft.com/fr-fr/fabric/data-factory/dataflow-gen2-variable-references#set-variable...

and thanks to your help i corrected some syntaxes errors.

the only difference i can see is that i commit my code in azure devops with an account et launch the dataflow with another account.

[GeekAlfPro]

it's not consistent

i tried again and i have this generic error again

Un problème s’est produit lors de l’actualisation du flux de données. Code d’erreur : ModelBuilderOutputDestinationDestinationEvaluationExceptionResult. (ID de requête : 00000000-0000-0000-0000-000000000000).

[tayloramy]

Hi @GeekAlfPro , 

You can't do this natively with deployment pipelines, but you should be able to use variable libraries to achieve this. 
See this documentation: https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-variable-library-integration

Be sure that after you edit the mashup.pq file in DevOps, that you do a pull in the workspaces so they pull down the changes - modifying things in git will not change them in your workspace without doing a pull.

You can also look at this post: https://community.fabric.microsoft.com/t5/Fabric-platform/Deployment-using-dataflow-Gen-2/m-p/482006...

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.