Forum Discussion

jatneerjat's avatar
jatneerjat
Icon for Helper V rankHelper V
8 years ago

Pulling large amount of data from sql server

Hi,   I have to pull data from SQL server and load it into power bi but the sql have multiple joins which take long time to execute so how can i pull this data in lesser time. Should i load this d...
Need Help
jatneerjat's avatar
jatneerjat
Icon for Helper V rankHelper V
8 years ago

Hi Greg_Deckler,

 

But is it good approach to load millions of records in power BI and then create a relationship?

for eg: if we want to apply inner join between two tables from which one table have million records and another one has thousand records then its better to filter the data before loading to power bi.

 

Thanks,

Neeraj

Anonymous's avatar
Anonymous
Not applicable
8 years ago

The answer will ultimately depend on a number of factors.  Are you pulling from a production system or a data warehouse?  What frequency do you need the data refreshed?  Do you have access to Power BI Premium and with it access to incremental refresh?  What pre-join constraints could you use when pulling down the initial tables? Could you create any FACT tables that you can call instead?