Combine files with structure change

[Anonymous]

Hi all,

In PowerBI I have setup a query to retrieve several CSV files from a datasource. The query also combines these files into a single table using the 'combine files' function. 

When new files are added at the datasource (these are log files), the extra files are also combined automatically and added to the table in PowerBI. This works perfectly.

Now the following scenario: a new log file has a different structure, for example a column is added. I don't get to see this column added to the combined table. Probably because PowerBI is basing the structure of the table on the first file only?

Is it even possible to take into account structure/schema changes? Or will this always be based on the first file?

Thanks in advance!

[Greg_Deckler · Accepted solution]

So, you can change which file is used as your sample file. There is an spot in the Folder query structure that allows you to change this. Also, since it is CSV, this defaults to specifying the number of fields in the Source line. You could edit this and remove that specification, that is the usual fix then you get a CSV file that changes the number of columns after you initially create the query.

[xarius]

Hi @Greg_Deckler,

I've just come across this post while trying to solve my own problem - instead of CSV I am trying to combine .xls files without knowing which one has the most columns. Is there a way for it to default to the most it finds or something similar?

Regards,

Xarius

[hgauhar]

did anybody find a solution for this?

[Anonymous]

Thanks, that worked for me. This is what I changed:

[v-chuncz-msft]

@Anonymous,

By the way, you may help accept solution. Your contribution is highly appreciated.