Forum Discussion

Swapnil_CR's avatar
Swapnil_CR
Regular Visitor
10 months ago
Solved

Fabrics to Dataverse - Dataflow Alternative

Hi, I have been using Dataflow in power apps to move data from Fabrics lakehouse to Dataverse table. Also mentioned in other posts as Reverse Integration. I am fully aware Dataflow does the job b...
  • AntoineW's avatar
    10 months ago

    Hello Swapnil_CR,

     

    For my understanding, for now, Dataflow is the only native option that fully supports mapping to lookup columns. You can try to optimize it by:

    • Using incremental refresh (if possible) to reduce the number of rows processed each run.

    • Splitting transformations so heavy shaping happens in Fabric (with notebooks and store gold data in a lakehouse), and Dataflow only handles the last step (merge + lookup mapping)

     

    Hope it can help you ! 

    Best regards,

    Antoine

     

  • Anonymous's avatar
    Anonymous
    10 months ago

    Hi Swapnil_CR ,

    Thank you for reaching out to the Microsoft fabric community forum and sharing your scenario in detail.

     

    Based on your requirements running 4–6 scheduled refreshes per day, supporting merge/upsert based on ID, and mapping lookup columns the only native option that fully meets these needs today is Dataflows, as they are the only mechanism that supports lookup column mapping in Dataverse as mentioned by AntoineW . While performance can be inconsistent, you can optimize this by enabling incremental refresh to reduce the number of rows processed each run and by handling heavy transformations in Fabric (e.g., preparing a clean Gold layer in your Lakehouse or using notebooks), leaving the Dataflow responsible only for the final merge and lookup mappings. This approach helps improve reliability and run time consistency.

    Alternatives like Fabric Copy Jobs or Power Automate may help for simple insert/update scenarios, but they do not provide full support for lookup mapping, which makes Dataflow the most viable option for your case at present.

    Hope this helps. Please feel free to rech out for any further questions.


    Thank you .