Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

Fabric Copy Data Pipeline Shifting Data In Columns

I recently stumbled upon an odd issue with the copy data pipeline activity.  The activity is loading the source data into the wrong destination columns.  My pipeline is very simple.  I execute a pysp...
  • lbendlin's avatar
    lbendlin
    2 years ago

    If your meta data changes halfway through then you cannot realistically expect this to be automated and robust. Either start over (flush and fill the parquets) or maybe implement some error handling for missing columns.