Storage Soloution

[CEllis]

Morning,

I am currently storing csv files in a SharePoint document library and consuming them in dataflows. This all works well but just wonderd what would be a better storage soloution for historical data than csv's.

Many thanks

Chris

[lbendlin · Accepted solution]

What's wrong with CSVs? They are a great storage option and ingest quickly.  

You could convert them to Parquet / Delta Lake format if you want to future proof them.

Note: consuming CSVs in dataflows is basically duplication of effort.  You are moving data from one CSV into another CSV.

[Anonymous]

Lots of options, but they all cost money:
Import into a SQL Server database (or PostgreSQL) and read into Power BI as tables

Import into parquet files in Azure Data Lake Storage(Gen2) and read into Power BI 

Use Fabric, and create Delta Tables in a Warehouse for the files and use DirectLake for the model in Power BI reports