Forum Discussion

acenter41's avatar
acenter41
New Member
1 year ago
Solved

Azure SQL Mirror - Recommendation?

We have an Azure SQL Database that contains a large portion of our data.   I've been able to successfully set up a mirror of the database in a workspace.   I'm fairly new to Fabric and not sure h...
Data Pipeline
Mirrored Azure SQL Database
Warehouse
  • v-prasare's avatar
    v-prasare
    1 year ago

    acenter41, Thanks for reaching Fabric community support.

     

    • For straightforward transformations, Dataflows Gen2 offers a user-friendly interface with scheduling capabilities.

    • For efficient processing of large datasets with frequent changes,  Incremental Data Loads with CDC is recommended.

    • For complex transformations requiring advanced scripting, Notebooks provides the necessary flexibility.

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

     

  • v-prasare's avatar
    v-prasare
    1 year ago

    Since Data Pipelines/Dataflows don’t directly support Mirror as a source, use a Fabric Notebook to manually extract and load data.

acenter41's avatar
acenter41
New Member
1 year ago

Where you mention to move data to a Lakehouse or Warehouse for complex transformations, how would you move the data from the Mirror to the lh/wh?  The mirror does not seem to appear as a source when trying to move data from it using a pipeline or dataflow.

v-prasare's avatar
v-prasare
Community Support
1 year ago

Since Data Pipelines/Dataflows don’t directly support Mirror as a source, use a Fabric Notebook to manually extract and load data.