Trying to import 5 million row -- very slow

[ktue]

I'm relatively new to Power BI. I'm trying to import 5 million rows via an Oracle database. Its taking hours. Any tips?

[parry2k]

@GerardoRTobar your question is not clear, could you please provide more details.

✨ Follow us on LinkedIn and  to our YouTube channel

I would ❤ Kudos if my solution helped. 👉 If you can spend time posting the question, you can also make effort to give Kudos to whoever helped to solve your problem. It is a token of appreciation!

⚡ Visit us at https://perytus.com, your one-stop shop for Power BI-related projects/training/consultancy.

[v-deddai1-msft]

Hi @ktue ,

I would suggest you use direct query mode to avoid having to load all 5 million rows at all. For more details, please refer to https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-use-directquery

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Best Regards,

Dedmon Dai

[parry2k · Accepted solution]

@ktue ouch, I know that connector is very slow, maybe you want to think of incremental refresh or in power bi desktop control number of rows thru parameter and then in power bi service, change the parameter to bring all the rows.

Check my latest blog post Year-2020, Pandemic, Power BI and Beyond to get a summary of my favourite Power BI feature releases in 2020

I would ❤ Kudos if my solution helped. 👉 If you can spend time posting the question, you can also make efforts to give Kudos to whoever helped to solve your problem. It is a token of appreciation!

⚡Visit us at https://perytus.com, your one-stop-shop for Power BI-related projects/training/consultancy.⚡

[ktue]

Thanks parry! I used a combination of your row filter suggestion and filter out data prior to import using a native query. For anyone who needs more info see links.

https://blog.crossjoin.co.uk/2020/05/24/limit-the-amount-of-data-you-work-with-in-power-bi-desktop-u...

https://docs.microsoft.com/en-us/power-query/native-database-query

[GerardoRTobar]

Hello! Can you post a general form to do this? PowerBI doesn't let me use an external parameter in Oracle