Forum Discussion

sharathKumar's avatar
sharathKumar
New Member
10 months ago
Solved

Need Help: Making Dataflow Gen2 destination dynamic + syncing updated mashup.pq back to Fabric

Hi everyone,   I’ve built a Dataflow Gen2 pipeline in Fabric that connects to a Salesforce report using report id as the source and writes the data to a SharePoint folder as the destination.   Cu...
workspaces
  • sharathKumar's avatar
    sharathKumar
    9 months ago

    Thank you Vinodh247 for quick response. 

    I am thinking to build a notebook for SharePoint so that i can make it dynamic.

     

Vinodh247's avatar
Vinodh247
Super User
10 months ago

  1. Dynamic destination paths: Not supported yet in Dataflow Gen2. You can parameterize sources but destinations (like sharePoint paths, filenames or delimiters) are static in current Fabric dataflow gen2. Microsoft has not yet exposed destination parameters or runtime expressions for outputs, we can expect this soon I believe given the demand.

  2. Syncing updated mashup.pq back from Git to Fabric: Currently one way only (Fabric --> Git). There are no supported reverse sync. Editing mashup.pq in devops does not reflect in fabric automatically. The only workaround is to do manually by opening the dataflow in fabric -> Advanced Editor -> replace the mashup code -> and then save and refresh.

Potential workaround that you can try...

  • Use a notebook or data pipeline after the dataflow to dynamically move/rename the output file based on parameters

  • Alternatively you can use a lakehouse or onelake destination and then orchestrate file movement or renaming using a fabric pipeline activity