Forum Discussion
Loading a .Txt Delimited source, the max Rows hit a 244,265 limit, when the file has around 330K.
Thanks for your help.
I tried to load it in Notepad++ but its too big to open, got an error. I also looked at the data in Excel, where I was able to import and see the rows past the 244K, didnt spot anything funky on them. Also checked the errors in PBI and nothing was brought up. I made sure I didnt have any change types or anything playing with the data.
What I did just now, that resolved the issue.
-Loaded as Text Source, not as a csv.
-This loaded a single column with 333K rows as expected.
-I then used split by position to break out the details.
Thanks for your help!
Interesting, and clever thinking on the workround. I've never seen that happen. I would think a delimiter is missing. If you did split by position, I wonder if a space (char 32) is really a non-breaking space (char 160). Visually you cannot tell. And if splitting by position it won't matter, but if it is parsing based on using a space as a delimiter, it won't work, and may cause the issue you see.
Also weird that NotePad++ woudn't open it. I opened that 1.5M record fake credit card data on my machine in less than 3 seconds, but that file has very few fields, only 139MB. Your file might be larger even though it has fewer records.
- Anonymous6 years agoNot applicable
Yea, really weird, the .txt file is 468mbs