Forum Discussion

acenter41's avatar
acenter41
New Member
1 year ago
Solved

Azure SQL Mirror - Recommendation?

We have an Azure SQL Database that contains a large portion of our data.   I've been able to successfully set up a mirror of the database in a workspace.   I'm fairly new to Fabric and not sure h...
Data Pipeline
Mirrored Azure SQL Database
Warehouse
  • v-prasare's avatar
    v-prasare
    1 year ago

    acenter41, Thanks for reaching Fabric community support.

     

    • For straightforward transformations, Dataflows Gen2 offers a user-friendly interface with scheduling capabilities.

    • For efficient processing of large datasets with frequent changes,  Incremental Data Loads with CDC is recommended.

    • For complex transformations requiring advanced scripting, Notebooks provides the necessary flexibility.

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

     

  • v-prasare's avatar
    v-prasare
    1 year ago

    Since Data Pipelines/Dataflows don’t directly support Mirror as a source, use a Fabric Notebook to manually extract and load data.

nilendraFabric's avatar
nilendraFabric
Super User
1 year ago

Hello acenter41 


go for hybrid

 

Create views in the mirrored SQL endpoint to handle lightweight transformations like filtering, basic calculations, or aggregations. This minimizes data movement and leverages the existing mirrored database.

 

For more complex transformations (e.g., combining datasets, advanced calculations), move data to a Lakehouse or Warehouse.

Connect Power BI directly to the Lakehouse/Warehouse for reports requiring extensive transformations

For simpler reports, connect Power BI directly to SQL views using DirectQuery mode.