Forum Discussion

jatneerjat's avatar
jatneerjat
Icon for Helper V rankHelper V
8 years ago

Pulling large amount of data from sql server

Hi,   I have to pull data from SQL server and load it into power bi but the sql have multiple joins which take long time to execute so how can i pull this data in lesser time. Should i load this d...
Need Help
Greg_Deckler's avatar
Greg_Deckler
Icon for Community Champion rankCommunity Champion
8 years ago

I would pull in the individual tables and create the relationships between them. So, instead of doing the SQL joins, form those joins using Power BI relationships. Really depends on your data and what you are trying to do but that would be the fastest I would think and would leverage Power BI's strengths.

jatneerjat's avatar
jatneerjat
Icon for Helper V rankHelper V
8 years ago

Hi Greg_Deckler,

 

But is it good approach to load millions of records in power BI and then create a relationship?

for eg: if we want to apply inner join between two tables from which one table have million records and another one has thousand records then its better to filter the data before loading to power bi.

 

Thanks,

Neeraj

  • Anonymous's avatar
    Anonymous
    Not applicable
    8 years ago

    The answer will ultimately depend on a number of factors.  Are you pulling from a production system or a data warehouse?  What frequency do you need the data refreshed?  Do you have access to Power BI Premium and with it access to incremental refresh?  What pre-join constraints could you use when pulling down the initial tables? Could you create any FACT tables that you can call instead?