Forum Discussion
DataFlow Loading Sharepoint Folder TSV Files - File Structure added new column that's now required
Get rid of the Changed Type step, and make sure the transformations in the Sample Query and custom function are not doing an automatic changed type too. That will specifically reference a column and if it doesn't exist, you'll get errors.
You might consider redoing the new format, but turn this feature off in the desktop first:You will have to do a bit more work, but you will avoid these issues. Even this isn't without a problem. When you combine files, go to your sample query, and if it should have a Promoted Headers line, you'll need to do that in the sample query, as this "never detect..." turns off both header promotion and type detection.
Thank you for that. Such a simple solution and worked. Yes I have to do some work on the data types when bringing the data in but it doesn't argue or complain now when the new fields appear in newer file.
Really appreciate that. Has happened to be several times before and I've accomodated by creating a second import process and then combining them together. This is so much easier. 🙂