Oviwan
8 months agoAdvocate I
Status:
Completed
Ability to Exclude Specific Tables from SQL Database Replication to SQL Analytics Endpoint
Description:
Currently, when replicating tables from a SQL database to the SQL Analytics endpoint in Microsoft Fabric, all tables are included by default. However, not all tables are needed in the analytics endpoint. This creates unnecessary overhead and, in some cases, leads to lock situations in the SQL database during replication for certain tables.
Problem:
- Some tables are not required in the analytics endpoint.
- Replication of these tables can cause locking issues in the source SQL database.
- There is no built-in mechanism to exclude specific tables from replication.
Proposed Solution:
Introduce functionality to exclude specific tables from replication. This should include:
- Explicit Table Exclusion: Ability to define a list of tables to exclude.
- Pattern-Based Exclusion: Support for regex-based patterns to exclude tables dynamically.
- Example: Exclude all tables ending with __b.
- Regex equivalent: .*__b$
Benefits:
- Reduces unnecessary replication overhead.
- Prevents lock situations on source tables.
- Provides flexibility for administrators to manage replication scope efficiently.
5 Comments
- sukkaurMicrosoft EmployeeStatus changed:PlannedtoUnder Review
- sukkaurMicrosoft EmployeeStatus changed:Under ReviewtoPlanned
- sukkaurMicrosoft Employee
Oviwan,
Can I ask you to create a new Idea for this so that others can vote on this ask? I have shared this ask with the right team and this might get consideration in the future.
Thanks
sukhwant
- sukkaurMicrosoft EmployeeStatus changed:PlannedtoCompleted
Recent ideas
Deployment pipeline: Deployment rules for Direct Lake on OneLake semantic models
Currently, it is not possible to use deployment rules with Direct Lake on OneLake semantic models. The option is greyed out. Please enable this, so we can automatically change the data so...frithjof_v3 hours agoCommunity ChampionNew6KViews137likes17CommentsNative Master Data Management Solution
Microsoft Fabric currently lacks a native Master Data Management (MDM) capability, creating a gap for organizations that need to manage and govern business-critical reference data such as customers, ...bradcoles3 hours agoRegular VisitorNew212Views1like3CommentsCopy results as markdown from data grid
When copying results from a query on the SQL Endpoint or Data Warehouse I often have to convert from the tab delimited table to markdown for sharing the results via services like teams or github. It...Tom_Fosterbi4 hours agoRegular VisitorNew9Views0likes0Comments