Best Approach for Real-Time Ingestion from Azure SQL CDC to Fabric

Hi PrachiJain_2025 ,

Let me answer your questions specifically.

1. For your scenario, I'd consider Fabric Mirroring of Azure SQL DB as your first option. Focusing on changes to your database tables, after an initial population of the Delta Lake tables in Fabric, this option will move your data in near real-time to Fabric.
   1. Note that documentation today says you are limited to 500 tables, but if you hit a limitation here you could possibly set up multiple mirrors to solve for this.
   2. Also note that Mirroring for Azure SQL DB currently requires using the public endpoint. It cannot be set up using a private endpoint currently.
2. Mirroring would account for schema evolution across multiple tables.
3. This approach theoretically would work, but having the Spark clusters up and running 24/7 might require more CUs than alternative options. It would also tie up some percentage of your Spark cluster, meaning other users would be limited in what Spark resources they can use. Without knowing the full details of your situation, Fabric has some other options to solve for this without requiring you to write a notebook. Here are other options I'd suggest:
   1. Mirroring - It is the simplest approach if you are working with Azure SQL DB as your source.
   2. Streaming Azure SQL DB CDC into a Real-time Hub - If you have CDC already set up, you could configure a Real-time Hub to ingest the CDC activities into a Fabric destination (documentation for this option can be found here: Add Azure SQL Database CDC as source in Real-Time hub - Microsoft Fabric | Microsoft Learn).
4. Again, I'd encourage you to consider the suggestions above before pursuing building your own solution to ingest data from Azure SQL DB CDC in real-time. This is a scenario Fabric is trying to make easier to solve without you having to write all of the code yourself. It would be fully automated and could run in the full parallelism your capacity allows (which, if you max out that usage in your capacity, you'd have to upgrade to a larger SKU to accomodate).
   1. If none of these options work and you have to write the tasks yourself, you'd want to look at Fabric solutions that support triggering activities based on events occuring (i.e. CDC events). Data Activator would be one option that allows you to kick off specific Fabric items when a process event or CDC is achieved. Check out this link for intro information on Data Activator: Introduction to Activator - Microsoft Fabric | Microsoft Learn

If the suggestions above do not provide you an acceptable solution, please provide examples of specific scenarios you are encountering and what challenges you are facing with the above solutions.