Forum Discussion
Load multiple csv files and combine them
From the description you've given, it sounds like the issue is that your source data isn't formatted the same way. Of course, the easiest way would be the fix the data at the source - whether that be by padding any missing columns or removing columns that aren't going to be used. Since you are on sharepoint, which acts like a folder, in my experience, the Combine Files function is the best way to load in the data.
For your second question - technically no, there's no limits to the number of tables. But here's an interesting discussion on the limits of powerBI: https://community.fabric.microsoft.com/t5/Desktop/Power-BI-limit-for-number-of-tables/m-p/386845#:~:text=Power%20BI%20uses%20an%20internal,table%20used%20in%20the%20dataset.
And lastly, i think the exceeding the column limit is because you have 250 (column) * 10 tables, which is 25k columns in total (much higher than the 16k allowed for ALL tables you've loaded in)
Hi Vicky,
The files came from another source and I don't want to padding the files to make it consistent. I think the Append function will work well as long as I can keep on adding the file to the Append query. I will pick the one with most columns as the first file, then append the rest of them to this file.
250*10 = 2.5K, not 25K. And since I am using the Append function, I am not adding more columns. Just "Stacking" the dataset one after another. This will add more rows, not columns. Unless the database structure in Power BI is not using the "Stacking", but adding more columns one table aftger another.
Thank you.