Forum Discussion
DataFlow Loading Sharepoint Folder TSV Files - File Structure added new column that's now required
Get rid of the Changed Type step, and make sure the transformations in the Sample Query and custom function are not doing an automatic changed type too. That will specifically reference a column and if it doesn't exist, you'll get errors.
You might consider redoing the new format, but turn this feature off in the desktop first:You will have to do a bit more work, but you will avoid these issues. Even this isn't without a problem. When you combine files, go to your sample query, and if it should have a Promoted Headers line, you'll need to do that in the sample query, as this "never detect..." turns off both header promotion and type detection.
Community ChampionGet rid of the Changed Type step, and make sure the transformations in the Sample Query and custom function are not doing an automatic changed type too. That will specifically reference a column and if it doesn't exist, you'll get errors.
You might consider redoing the new format, but turn this feature off in the desktop first:
You will have to do a bit more work, but you will avoid these issues. Even this isn't without a problem. When you combine files, go to your sample query, and if it should have a Promoted Headers line, you'll need to do that in the sample query, as this "never detect..." turns off both header promotion and type detection.