Large database: customize import?

[Simon_Striegel]

Dear community!

I am dealing with a relatively large MySQL database (15-25 GB) and would like to avoid that PowerBI imports the entire database. Is there any way to customize/define the data that PowerBI imports via "Get Data", e.g. by defining only the most recent database entries (by timestamp)?

I would be very grateful for an answer! Thanks in advance!

Best wishes

Simon

[v-lili6-msft]

hi, @Simon_Striegel 

Yes, you could get it in Edit Queries, please refer to this similar post:

https://community.powerbi.com/t5/Desktop/Filter-query-by-date-column/td-p/333186

https://blog.crossjoin.co.uk/2018/01/08/in-the-previous-date-filters-in-power-bi-gettransform-power-...

Best Regards,

Lin

[Simon_Striegel]

Thank you for your suggestion. Unfortunately, correctly filtering data based on current time is not really the problem with which I'm grappling.
Perhaps a more lucid description of my problem is needed.

The data I wish to analyse using PowerBI is in a SQL database and includes some *very large* tables -- several 100 million rows and tens of GB -- with timestamp as the primary key. These data are generated by the application and there already are processes in place to discard "aged" data from these tables.

The PowerBI analysis will *always* have a time bracket on the data, ranging from the past hours to the past days/weeks -- i.e., over a much smaller subset of the table that the SQL database can easily/quickly provide via primary key.

When I "Get Data" in PowerBI, I would like to limit the amount of data loaded to, say, the past 12 hours (and not all the several 100 million rows). I would appreciate any suggestions on how best to do achieve this.

Kind regards,