Forum Discussion
Combine files with structure change
Hi all,
In PowerBI I have setup a query to retrieve several CSV files from a datasource. The query also combines these files into a single table using the 'combine files' function.
When new files are added at the datasource (these are log files), the extra files are also combined automatically and added to the table in PowerBI. This works perfectly.
Now the following scenario: a new log file has a different structure, for example a column is added. I don't get to see this column added to the combined table. Probably because PowerBI is basing the structure of the table on the first file only?
Is it even possible to take into account structure/schema changes? Or will this always be based on the first file?
Thanks in advance!
So, you can change which file is used as your sample file. There is an spot in the Folder query structure that allows you to change this. Also, since it is CSV, this defaults to specifying the number of fields in the Source line. You could edit this and remove that specification, that is the usual fix then you get a CSV file that changes the number of columns after you initially create the query.
5 Replies
So, you can change which file is used as your sample file. There is an spot in the Folder query structure that allows you to change this. Also, since it is CSV, this defaults to specifying the number of fields in the Source line. You could edit this and remove that specification, that is the usual fix then you get a CSV file that changes the number of columns after you initially create the query.
Anonymous,
By the way, you may help accept solution. Your contribution is highly appreciated.
Hi Greg_Deckler,
I've just come across this post while trying to solve my own problem - instead of CSV I am trying to combine .xls files without knowing which one has the most columns. Is there a way for it to default to the most it finds or something similar?
Regards,
Xarius
