Approach to load huge data

[kammaru]

Hi All,

Please suggest me to create a dashboard with huge data source of SQL on prime.

Records are in Billions

Thanks

Kamal

[v-ljerr-msft · Accepted solution]

Hi @kammaru,

Instead of import all data to Power BI, try using DirectQuery mode or a live connection. 

Reference:

https://community.powerbi.com/t5/Community-Blog/Power-BI-Live-connection-vs-Import-comparison-and-li...

https://powerbi.microsoft.com/en-us/documentation/powerbi-desktop-use-directquery/

Regards

[kammaru]

Thanks a lot friend, But DirectQuery has some limitations and it's taking time to refresh when you apply and filter form slicer because it's directly firing the query on that server.

One more do we need to schedule refresh for DirectQuery or not? I also applied some transformation and DAS queries there so that are not supporing DirectQuery Mode, Please advise.

Thanks 

Kamal Maru

India

[v-ljerr-msft]

Hi @kammaru,

As per this article, in Power BI Service, if your dataset is configured for a DirectQuery connection, there is a direct connection between Power BI and the database, there is no need to schedule refreshed, and datasets are refreshed approximately each hour or when interaction with the data occurs.

If DirectQuery mode is not supported for your data source, and your dataset doest hit the 1 GB dataset limitation, you can follow this article to import your data in Power BI. 

Regards

[Greg_Deckler]

You probably need to look at the enterprise gateway and a live connection.