pipelines
2 TopicsCopy data into lakehouse and warehouse - append or overwrite
When creating a data pipeline that copies data into a lakehouse, I can choose whether to Append or Overwrite data. If I choose to Overwrite, repeated runs of the pipeline do not create duplicate records. However, there is no option to Append or Overwrite when creating a data pipeline that copies data into a warehouse. As a result, repeated runs of the pipeline create duplicate records in the warehouse. Shouldn't the option to Append or Overwrite be present in the warehouse experience too? Or have I misunderstood the intent? Any wisdom appreciated. Thank you DuncanSolved23KViews3likes9CommentsAzure Database copy table job - Change source table
Hello, I have setup a simple job to copy and overwrite tables from one Azure SQL DB to another Azure SQL DB. Disclaimer - I am new to this. On the initial configuration in the wizard, I defined which Tables would be copied, however I need to make replace one of the tables that is being copied to the destination in the job. How do I change one of the tables that is being copied? ThanksSolved1.7KViews0likes1Comment