how to upload 3M records from Cosmos DB to PowerBI?

[alpinzar]

Hi guys,

I am working on a report and noticed that while I have no problem to upload CsomosDB containers with up to 500K records, the one with 3M is giving me a very hard time. I waited for 4 hours and still - no progress. 

Any suggestion, please?

[Greg_Deckler]

Hmm, that's odd. I have imported upwards of 10 million rows into Power BI Desktop without a hitch although those are usually coming from SQL Server or something, not CosmosDB. I'm assuming this is import mode and not a Dataflow or something? Just straight up Desktop import mode?

[alpinzar]

yep, Get Data-> Azure Cosmos DB

[v-lid-msft]

Hi @alpinzar ,

Are there complex sql statements used to connect to the Cosmos DB? Is there any limitation set in the source such as 1M rows retrieved each time? Are you mean the same Cosmos DB when mention the 500K rows tests? Does the 3M records big, maybe it is because the performance of network from Desktop to Source?

Best regards,

[alpinzar]

Are there complex sql statements used to connect to the Cosmos DB?   -- no

Is there any limitation set in the source such as 1M rows retrieved each time?   --- no

Are you mean the same Cosmos DB when mention the 500K rows tests?   --- yes

Does the 3M records big, maybe it is because the performance of network from Desktop to Source?  -- sometimes this is the case

Thanks everyone for support, I figured out that I can not apply any 'Merge queries' calculations on 1M rows table, it slows down upload that much that it fails, but I can still work around without merging and have my report updated.

[Greg_Deckler]

Check out some of the DAX functions like NATURALINNERJOIN for example, you still might be able to merge it but outside of Power Query and in DAX instead. I have seen certain things that are faster for some reason in DAX than in Power Query against certain sources.

[Greg_Deckler · Accepted solution]

You could check the Issues forum here:

https://community.powerbi.com/t5/Issues/idb-p/Issues

And if it is not there, then you could post it.

If you have Pro account you could try to open a support ticket. If you have a Pro account it is free. Go to https://support.powerbi.com. Scroll down and click "CREATE SUPPORT TICKET".