Forum Discussion
ronan_b6
Advocate II
1 year agoIssue with Data Not Appending to Warehouse Table in Pipeline
Hi everyone, I’m encountering an issue with a pipeline I’ve created in Microsoft Fabric. The pipeline runs successfully and includes the following steps: Extract data from the source and load it ...
- 1 year ago
Hello ronan_b6
The dataflow might execute before the upstream notebook completes writing cleaned data to the lakehouse, resulting in an empty or outdated source
In the dataflow’s warehouse destination settings, ensure Append is explicitly selected (not defaulting to Replace).
2. Avoid using “Auto create table,” which can reset configurations.Rebuild the warehouse connection or clear cached credentials.
• Add a 1–2 minute delay after the notebook to allow metadata synchronization.Please see if some of the suggestions are helpful
ronan_b6
Advocate II
1 year agoThank you nilendraFabric
I added a minute Wait activity after the notebook, and the the Dataflow appends to the warehouse when the pipeline runs.