Forum Discussion
DataflowGen2 in a Data Pipeline is intermittently inserting data twice despite uniqueness measures
Hello, I am building a Data Pipeline to update my table in a data warehouse with a rolling 31 days of data. The data pipeline deletes the last 31 days of data Then it calls on a DataFlow Gen...
Update: I was never able to resolve why this was happening and so I rebuilt the pipeline model differently to do a replacement on a separate table in the warehouse and then append from there. Instead of trying to append directly from the Power Query with the API call. I have not received duplicate data with this method. I think it had something to do with the Append statement.