Fix unexpected character deletion on load | Provide warning when data is altered on load
Thank you for your continued attention to this issue, Lydia. Saving as XLSX is not an option for us as the csv source files contain several million rows, exceding Excel row limits.
The CSV source provided is encoded as MIcrosoft Excel Comma Separated Values according to Properties and all characters are part of the ASCII character set. We tried every encoding scheme in the Power BI load scripting and none of them produced the desired result - they always deleted the character on load.
How exactly did you produce the _x0019 value represented in your image and get it into Power BI?
Specifically what was the source file encoded as and what encoding scheme did you use to import?
We can't reproduce that... is it binary or some other encoding? In our Excel/CSV etc the value shows as a clear rectangular box similar to this [] . Our encoding settings are out of the box Excel, nothing fancy.
Since excel is not a valid option due to size limitations, we still have a data integrity and useability issue here. Our expectation is that Power BI should be able to consume all ASCII characters with no problems just like every other MS tool, but it does not.
Looking forward to your next thoughts. I am grateful you are helping us with this.