Select individual CSV data source files based on the date

[Anonymous]

Let me give you a bit of background, as it is now driving me around the bend.

I am trying to report on Paper Cut printer logs, and it outputs three logs. A daily log, a monthly log and a from the begining of time super log.  I have tried using the super log, but it is simply too big and errors. There are millions of lines of data for each log and we have two servers. So it just got very silly very quickly. The thing is, I cannot fathom how I can automate the required data from several monthly logs.  The solution does not have to be Power Query, and if I have to create a SQL table, then so be it, but it would be nice to keep it as simple as possible.

Does anyone have any ideas?

Thanks

[dax · Accepted solution]

Hi @Anonymous , 

I don't know how you store the data, each day per csv file or all data in a csv file? If it is previous one and you want to see current day of log, you could try to use date as csv file name , and use parameter in M code to change file name dynamically. If it is later one and csv file have date column, you could use date parameter to filter date range and load data in model. You could refer to power-bi-introduction-working-with-parameters-in-power-bi-desktop-part-4  for details.

Best Regards,
Zoe Zhi

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.