Forum Discussion
Azure Synapse Link for Dataverse in a Fabric architecture
- 4 months ago
Hi Luigia-Costabil ,
Thanks for reaching out to Microsoft Fabric Community and Thanks to Vinodh247 for providing meaningful insights.Converting the Append Only CSV exports into Delta tables using Fabric notebooks does not inherently reduce the benefits of Synapse Link change tracking. The main consideration is data freshness, as the Delta Bronze layer will only reflect changes after the Fabric notebook or pipeline has processed the latest exported files.
Regarding Append Only mode, Microsoft documentation states that create, update, and delete changes are written as additional records in the destination files, and delete operations can be identified through the IsDelete column. This supports incremental processing scenarios.
However, the documentation does not explicitly state that the exported files should be treated as a complete audit trail containing every intermediate change event. Therefore, while Append Only preserves the changes exported by Synapse Link, any requirements for full historical auditing should be validated against your specific business needs.
A common Fabric approach is to retain the exported CSV files as the raw layer and load them into Delta Bronze tables using Fabric Spark notebooks or pipelines, allowing downstream workloads to benefit from Delta Lake capabilities while preserving the original exports.
For Reference:
Advanced configuration options in Azure Synapse Link Link your Dataverse environment to Microsoft Fabric and unlock deep insights
Export Dataverse data in Delta Lake formatBest Regards,
Abdul Rafi
Could you please confirm if the issue has been resolved? If not, feel free to reach out if you have any further questions.
Your update would be helpful for other members who may face a similar issue.
Best Regards,
Abdul Rafi