Forum Discussion

jatneerjat's avatar
jatneerjat
Icon for Helper V rankHelper V
8 years ago

Pulling large amount of data from sql server

Hi,

 

I have to pull data from SQL server and load it into power bi but the sql have multiple joins which take long time to execute so how can i pull this data in lesser time.

Should i load this data into some temporary table and then fetch data from temporary table into power BI or any other way?

 

Thanks,.

Neeraj

Need Help

3 Replies

  • Greg_Deckler's avatar
    Greg_Deckler
    Icon for Community Champion rankCommunity Champion
    8 years ago

    I would pull in the individual tables and create the relationships between them. So, instead of doing the SQL joins, form those joins using Power BI relationships. Really depends on your data and what you are trying to do but that would be the fastest I would think and would leverage Power BI's strengths.

    • jatneerjat's avatar
      jatneerjat
      Icon for Helper V rankHelper V
      8 years ago

      Hi Greg_Deckler,

       

      But is it good approach to load millions of records in power BI and then create a relationship?

      for eg: if we want to apply inner join between two tables from which one table have million records and another one has thousand records then its better to filter the data before loading to power bi.

       

      Thanks,

      Neeraj

      • Anonymous's avatar
        Anonymous
        Not applicable
        8 years ago

        The answer will ultimately depend on a number of factors.  Are you pulling from a production system or a data warehouse?  What frequency do you need the data refreshed?  Do you have access to Power BI Premium and with it access to incremental refresh?  What pre-join constraints could you use when pulling down the initial tables? Could you create any FACT tables that you can call instead?