Forum Discussion
Storage Soloution
Morning,
I am currently storing csv files in a SharePoint document library and consuming them in dataflows. This all works well but just wonderd what would be a better storage soloution for historical data than csv's.
Many thanks
Chris
What's wrong with CSVs? They are a great storage option and ingest quickly.
You could convert them to Parquet / Delta Lake format if you want to future proof them.
Note: consuming CSVs in dataflows is basically duplication of effort. You are moving data from one CSV into another CSV.
2 Replies
Lots of options, but they all cost money:
Import into a SQL Server database (or PostgreSQL) and read into Power BI as tablesImport into parquet files in Azure Data Lake Storage(Gen2) and read into Power BI
Use Fabric, and create Delta Tables in a Warehouse for the files and use DirectLake for the model in Power BI reports
What's wrong with CSVs? They are a great storage option and ingest quickly.
You could convert them to Parquet / Delta Lake format if you want to future proof them.
Note: consuming CSVs in dataflows is basically duplication of effort. You are moving data from one CSV into another CSV.
