Forum Discussion
Power BI not loading the data in certain tables
- 1 year ago
You would have to modify the CSVDecode step.
But - all of these steps could be part of the Power Query ETL process if you want. You can use things like
try ... otherwise ...
to ingest the raw CSV either with commas or with tabs and then you can delete/discard the columns with the PII.
Please do not sort the table in Power Query - that is a very expensive operation that likely has no benefit (Power BI is ignoring the Power Query sort order).
Can you you isolate the CSV file that causes the issue or do you only see nulls across all files?
Ohh no. I sorted it just to see if the latest tables were being included correctly because it takes ages to scroll down to see the bottom, but then I removed the step. I know the issue is happening with all the files after July 16th this year. Everything before that loads properly.
- lbendlin1 year ago
Super User
when you visually inspect these CSV files do you see a difference?
- Mon_Go271 year agoFrequent Visitor
Mmm yes, there is a difference. I download the file daily using Power Automate to create the csv table. Since the file is originally tab separated instead of comma separated, I have an action that replaces commas with tab to generate and it seems that for some reason, after that date, it started changing the format. The correct format looks like this:
And the incorrect one is putting everything into columns:
Perhaps I should take this query to the Power Automate forum instead, as based on this the problem is not the power BI.
- lbendlin1 year ago
Super User
You can use Power Query to sense if the file is tab or comma separated, and then ingest it accordingly.
Where do you download the file from?
Since the file is originally tab separated instead of comma separated, I have an action that replaces commas with tab to generateThat's not recommended. Better to to leave the raw files as is and handle the changes in a tool that is a bit more robust than Power Automate.