Oviwan
8 months agoAdvocate I
Status:
Completed
Ability to Exclude Specific Tables from SQL Database Replication to SQL Analytics Endpoint
Description:
Currently, when replicating tables from a SQL database to the SQL Analytics endpoint in Microsoft Fabric, all tables are included by default. However, not all tables are needed in the analytics endpoint. This creates unnecessary overhead and, in some cases, leads to lock situations in the SQL database during replication for certain tables.
Problem:
- Some tables are not required in the analytics endpoint.
- Replication of these tables can cause locking issues in the source SQL database.
- There is no built-in mechanism to exclude specific tables from replication.
Proposed Solution:
Introduce functionality to exclude specific tables from replication. This should include:
- Explicit Table Exclusion: Ability to define a list of tables to exclude.
- Pattern-Based Exclusion: Support for regex-based patterns to exclude tables dynamically.
- Example: Exclude all tables ending with __b.
- Regex equivalent: .*__b$
Benefits:
- Reduces unnecessary replication overhead.
- Prevents lock situations on source tables.
- Provides flexibility for administrators to manage replication scope efficiently.
5 Comments
- sukkaurMicrosoft EmployeeStatus changed:PlannedtoUnder Review
- sukkaurMicrosoft EmployeeStatus changed:Under ReviewtoPlanned
- sukkaurMicrosoft Employee
Oviwan,
Can I ask you to create a new Idea for this so that others can vote on this ask? I have shared this ask with the right team and this might get consideration in the future.
Thanks
sukhwant
- sukkaurMicrosoft EmployeeStatus changed:PlannedtoCompleted
Recent ideas
Allow External OneLake Data Shares to Be Accepted into Multiple Fabric Item Types
Fabric External Data Sharing provides an excellent zero-copy mechanism for sharing OneLake data across tenants. However, the receiving tenant currently has to accept the share into a Lakehouse. I w...Mourak14 hours agoNew MemberNew5Views0likes0CommentsAllow OneLake Shortcut Authentication Mode to Be Changed In Place
OneLake shortcuts support passthrough and delegated authentication, but changing the authentication model currently requires deleting and recreating the shortcut. I would like shortcut authenticatio...Mourak14 hours agoNew MemberNew7Views0likes0CommentsTenant-Wide OneLake Shortcut Lineage and Impact Analysis
This is grounded in a documented limitation: shortcut lineage is currently workspace-scoped, and Microsoft specifically says lineage for shortcuts to warehouses and semantic models isn't currently av...Mourak14 hours agoNew MemberNew14Views0likes1CommentAdd an End-to-End Production Reference Architecture for Microsoft Fabric Real-Time Intelligence
I would like to see a complete end-to-end Microsoft Fabric Real-Time Intelligence reference architecture that demonstrates how the individual RTI capabilities work together in a production-oriented s...Mourak14 hours agoNew MemberNew5Views0likes0CommentsImprove CI/CD consistency for Microsoft Fabric Real-Time Intelligence Eventstreams
Microsoft Fabric Real-Time Intelligence has made strong progress with Git integration and deployment pipelines, but lifecycle management can still be inconsistent across Eventstream sources, destinat...Mourak14 hours agoNew MemberNew3Views0likes0Comments