The new Copy Job in Fabric is great. It lets you configure DELTA loads if you can specify the "Incremental column" for a table. BUT, the only data types it will accept are INT (and I assume BIG | SMALL, etc) and Date/Time.
What about ROWVERSION? In my opinion, this is the ABSOLUTE BEST data type for tracking incremental changes. Consider this: Any other type must be managed by the programming layer, either the application or a trigger. And, what happens if some other process breaks in and UPDATES those columns between runs? You will be in an inconsistent state.
ROWVERSION data type columns are, by definition: A) Managed by SQL (populated and updated automatically), B) immutable (they cannot be changed via an UPDATE statement like other columns.
Please add support for selecting ROWVERSION type columns (from SQL Server) to the CopyJob activity.
1 Comment
- Miwa1
Microsoft Employee
This is already supported, you should see it working by end of Dec 2025.
Recent ideas
Clone a workspace, including its data, to a new workspace
Description: Today there's no way to fully clone a Fabric workspace: git sync and Deployment Pipelines move item definitions only, not the underlying data; Warehouse's zero-copy CREATE TABLE ... AS ...gclements27 minutes agoHelper IINew2Views0likes0CommentsAllow NotebookUtils getSecret() to authenticate with Workspace Identity
Current behavior In Microsoft Fabric, notebookutils.credentials.getSecret() authenticates against Azure Key Vault using the identity of the user who executes the notebook. This behavior appli...tmihara6 hours agoNew MemberNew5Views0likes0CommentsSupport Synonyms in Fabric Warehouse
Microsoft SQL Server has a very powerful feature by the way of "synonyms." It allows users and DBAs to do all sorts of powerful magic such as rewiring objects under the hood (e.g. run the code agains...matthias-bi9 hours agoRegular VisitorNew1.3KViews18likes2CommentsExpose Refresh Warnings and Informational Messages via Notifications and API
When a Power BI semantic model refresh completes successfully, the status shows Completed, even when the refresh details contain warnings or informational messages that require attention. Please pro...Jashwanth_K11 hours agoMicrosoft EmployeeNew26Views7likes0CommentsInvoke Pipeline Task - Workspace Identity Authentication
Currently, the Fabric Data Factory Invoke Pipeline task uses the user's credentials who saved the pipeline to then authenticate to the Azure Data Factory to execute the ADF pipeline. When that user'...dzebrowitz16 hours agoAdvocate IPlanned1.8KViews61likes5Comments