Forum Discussion

b2wise's avatar
b2wise
Helper III
4 years ago
Solved

Do I need a database?? Excel datasource...

Hi all,   I get emailed daily web scrapes of our items with competitor pricing as an excel file. Each file is about 200K rows and I save them to a folder on a shared drive. I combine them using the...
  • Bpaige's avatar
    Bpaige
    4 years ago

    If it ain't broke don't fix it.

    There are many good Databases that have a free tier like Google BigQuery or SQL Server. The question is creating the pipeline to get your files into a table in the DB. If you are the only one that needs access to the folder, you may not need a database. The Power Bi model could be set to refresh at night. So even if it grows too large it won't comprimise proformance and you could always delete old files more easily from a folder than a database. See attached article.

    https://stackoverflow.com/questions/2147902/is-it-faster-to-access-data-from-files-or-a-database-server