Forum Discussion

caninetiger's avatar
caninetiger
Frequent Visitor
2 years ago
Solved

Import all CSV files from folder with different schemas

Hi,   I have a folder with 300+ csv files. It's a mass download that I receive on a regular basis mirroring our EMR's database so each file is it's own table with a different schema. I'd like to im...
Need Help
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi caninetiger 

     

    Currently Power Query doesn't support to create more queries(tables) automatically or dynamically from a table. So this is not possible at present. I read your discussion in another thread about this and you may decide to use a Python script to write them into an Excel Workbook or a database. This seems the best alternative currently. 

     

    But I'd like to remind that if these files have too many rows, it may hit the data size limit as you will have 300+ tables in a semantic model. You may refer to Power BI limit for number of tables - Microsoft Fabric Community There is no document to point out that the limit for number of tables in Power BI but there is limit to data size.

     

    Best Regards,
    Jing

     

Greg_Deckler's avatar
Greg_Deckler
Community Champion
2 years ago

caninetiger If they all have the same schema, then you can use a Folder query. If they all have different schemas may God have mercy on your soul...