Ability to Exclude Specific Tables from SQL Database Replication to SQL Analytics Endpoint

[Oviwan]

Description:
Currently, when replicating tables from a SQL database to the SQL Analytics endpoint in Microsoft Fabric, all tables are included by default. However, not all tables are needed in the analytics endpoint. This creates unnecessary overhead and, in some cases, leads to lock situations in the SQL database during replication for certain tables.

Problem:

• Some tables are not required in the analytics endpoint.
• Replication of these tables can cause locking issues in the source SQL database.
• There is no built-in mechanism to exclude specific tables from replication.

Proposed Solution:
Introduce functionality to exclude specific tables from replication. This should include:

1. Explicit Table Exclusion: Ability to define a list of tables to exclude.
2. Pattern-Based Exclusion: Support for regex-based patterns to exclude tables dynamically.
   • Example: Exclude all tables ending with __b.
   • Regex equivalent: .*__b$

Benefits:

• Reduces unnecessary replication overhead.
• Prevents lock situations on source tables.
• Provides flexibility for administrators to manage replication scope efficiently.

[Oviwan]

@sukkaur I see that SQL Database now has a “Configuration replication” option to exclude tables from replication to the analytics endpoint. Supporting regex-based table selection there would make exclusion management much more flexible, especially for larger environments.

[sukkaur]

Oviwan,

   Can I ask you to create a new Idea for this so that others can vote on this ask? I have shared this ask with the right team and this might get consideration in the future.

Thanks

sukhwant