Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago

Referencing a table and column in SQL statement for inner join

Hi there

 

I have a HUGE dataset over 10 million rows and a small dataset of 2501 rows.

I need to do an inner join from the small to the large - so I only get matching rows from the large dataset based on Invoice ID, that way I don't bring in the entire large dataset.

 

The large dataset is called stg.vw_ActrlMthlyClaimSnapshot and Invoice ID is "Invoice ID"

The small dataset is called "OverPayments" - which I've already imported into Power BI so it's an existing table and Invoice ID is called "InvoiceId"

 

Below is my attempt at SQL but I'm not referencing the OverPayments table or Invoice ID column correctly. Help!

 

select*from stg.vw_ActrlMthlyClaimSnapshot
inner join Table.OverPayment 
on "Invoice ID" = STG.vw_ActrlMthlyClaimSnapshot.InvoiceId

 

 

 

 

 

Need Help

6 Replies

  • Mariusz's avatar
    Mariusz
    Community Champion
    7 years ago

    Hi Anonymous 

     

    You can use Merge Queries, if you getting your data from SQL server it will perform Query folding.

    You can check your SQL syntax by clicking on "View Native Query" 

    Regards,
    Mariusz

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • Anonymous's avatar
      Anonymous
      Not applicable
      7 years ago

      Mariusz  sadly view native query is greyed out for the merge step. 

       

      Basically, if I knew how to reference the OverPayment table and the InvoiceId column in a SQL statement, it should work. I've tried Table.OverPayment and that doesn't work either. 

       

      I absolutely don't want to import the entire huge dataset and perform a merge within PBI. 

      • Mariusz's avatar
        Mariusz
        Community Champion
        7 years ago

        Hi Anonymous 

         

        Please check how you importing your tables, do you just select them from the list or do you write a sql do it?

        Some of the transormations are not suported by Query Folding so its importent to make the merge before you insert any function that can not be translated to a native langage.

        Please check this article and video
        https://exceleratorbi.com.au/how-query-folding-works/

        Regards,
        Mariusz

        If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.