How to use Power BI with big data?

[bourne2000]

Hi 

I am having a dataset is close to more than 3 million records. This is retail dataset. At present, the data is in AWS redshift. However, when we connect in Power BI, it is **bleep** slow. Unable to slice or dice. I used direct query, that makes more complicated. I need your guidance, how to handle more than million records in Power BI

1) I am current using Pro license, ready to go with premium per user. Does premium capacity improve the speed?

2) What is the alternative, we are open to move the data into Azure. Not sure what components to be used?

3) I referred some blog, please sugges to to use tabular model? Would tabular model improves the speed?

Could anyone advise me the optimal solution? or point out me a correct documentation please?

[v-luwang-msft · Accepted solution]

Hi @bourne2000 ，

 Power BI uses the same engine as SSAS, it can handle a LOT.Power BI runs on memory. So the bigger the data set, the more memory it is going to require. Make sure you have plenty of memory, and that you are on a 64 bit system.

Please try switching off Data load property from below settings;

Un-check both these settings.

Might be also worth to check out task manager on your machine (CPU usage, Memory usage) see if you don't have any performance issues there.

To  learn more details ,refer:

https://www.pbiusergroup.com/communities/community-home/digestviewer/viewthread?MessageKey=5f4519c4-... 

Did I answer your question? Mark my post as a solution!

Best Regards

Lucien

[amitchandak]

@bourne2000 . 3 M should not be a problem. Just use the column which are needed in power bi in import mode and check. First, check on a desktop with at least 8/16 GB (RAM). Service you can check on PPU trial

With premium you can get capacity, you can choose depending on need

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-faq

you can explore ppu too