Forum Discussion
Incremental refresh using Fabric pipeline
Hi Everyone, I am looking for a way/documentation I can uset to build a incremental refresh using pipelines within Microsoft Fabric. My data source is on-prem postgres. Pipeline recently started ...
NandanHegde
Super User
Super UserYou can use the concept of watermark
The below MSFT doc :
https://learn.microsoft.com/en-us/azure/data-factory/tutorial-incremental-copy-overview
provides in detail for incremental load
NandanHegde Anonymous - can this be used within fabric pipeline for on-prem postgres source the document refers to ADF and Synapse only ?
- NandanHegde
Yes,
The core concept remains the same irrespective of whatever the source is.
Also fabric data pipelines are saas replica of Azure data factory