Loop for getting Data from database

PWRBI · ‎07-14-2022

Hi,

I need to load a very large amount of data from a database, when I load a whole month the server times out. Therefore I would like to load every single day via a loop.

But what would such a loop look like? Do you have an example?

v-jingzhang · ‎07-20-2022

Hi @PWRBI

What is the database you are connecting to? For some databases, you can expand Advanced options and enter another value for command timeout to keep the connection open longer when querying data.

Best Regards,
Community Support Team _ Jing
If this post helps, please Accept it as Solution to help other members find it.

BA_Pete · ‎07-15-2022

Hi @PWRBI ,

I'm not sure this will work as you expect it will. Even if you apply a functional loop, or staged load, the server connection is going to remain open for the duration of the query refresh and, therefore, will likely be shut down by the server as before.

For this quantity of data, you should really be looking at using Direct Query and Aggregation tables:

https://dax.tips/2021/09/06/intro-to-power-bi-aggregations/

Pete

Now accepting Kudos! If my post helped you, why not give it a thumbs-up?

Proud to be a Datanaut!