Forum Discussion
Helper IIIColumn values are shifting after csv files are loaded
lc1 OK, but I need the text. Like, open the file in Notepad. Copy, paste.
Thank you Greg_Deckler , I was able to see the errors when I open the file in Notepad.
Community Championlc1 Hard to be certain given the information provided but likely this is an issue with having some different formatting in your CSV files. When you import a folder of files one file is chosen as a sample file and you make the transformations based on that file. If files in the folder have different formats then the transformations will be applied incorrectly to those files because they are different.
Helper IIIHi, all files have the same format. So far, there are 3 files loaded with over 34,000 rows, and only 19 rows have errors.
- Greg_Deckler
lc1 OK, what are the errors? Have you clicked on "View errors" and investigated? Typically these are due to bad data. For example, let's say you have a Year column with numbers like 2023, 2024, etc. but for some of the rows you have text like "N/A". If the column is set to be numeric versus any, then you will get an error for that cell for that row.
- lc1
Greg_Deckler I did, two of the errors I can resolve, but the other 17 have me a little confused because they are correct in the dataset (csv folder), only when loaded is that the values get moved to other columns.
- Greg_Deckler
lc1 Right, so sounds like the format is different or you aren't account for text qualifiers. For example, maybe there is a missing comma or separator in that particular row. Or, you have something like:
"Foo", "Bar", "Foo, Bar"
If you don't account for commas in your text qualified by double quotes this will result in 4 columns, not 3 for example.
Pretty much impossible to know with the information provided.
- lc1
For example, one of the errors in the Fiscal Year Column is DataFormat.Error: We couldn't convert to Number.
But the data in the csv folder is correct, only when loaded is that I see values entered in the incorrect columns.
- Greg_Deckler
lc1 See my reply below about accounting for separators correctly. What are you using for a separator? If it is space or tab for example, it's really easy to get two spaces or tabs together that might look correct in the file but will shift things in ways that you don't want it to.