Forum Discussion

alozovoy's avatar
alozovoy
Icon for Advocate II rankAdvocate II
2 years ago

Duplicated Rows In Tables Built By Notebook

I was seeing incorrect numbers after joining two tables together. I have isolated the issue as shown in the following example:   I take the existing delta table named Rainbow_Accounting_Adjustments...
data engineering
alozovoy's avatar
alozovoy
Icon for Advocate II rankAdvocate II
2 years ago

It is set to replace.

 

Regardless, that should only impact the creation of the first table (Rainbow_Accounting_Adjustments). As the first query shows, this table appears to import correctly (at least when using the SQL endpoint).

 

However when I use this table in a notebook it has duplicate rows.

 

Just to clarify:

Excel   ----(Dataflow Gen2)--->  Rainbow_Accounting_Adjustments  ---(Notebook)--->  Business_Unit_Adjustment_Totals

frithjof_v's avatar
frithjof_v
Icon for Community Champion rankCommunity Champion
2 years ago

I see

 

So if you query the Rainbow_Accounting_Adjustments from SQL analytics endpoint, you get the right number of rows?

 

And if you query Rainbow_Accounting_Adjustments from Notebook, you get the double number of rows?

 

I think I experienced the same thing myself, if I remember correctly. But I deleted my Lakehouse and dataflow gen2 afterwards. If you still have your Lakehouse and dataflow gen2, I encourage you to raise a support ticket so that support can have a look at it

  • alozovoy's avatar
    alozovoy
    Icon for Advocate II rankAdvocate II
    2 years ago

    I have opened a Support Ticket.

     

    Thank You!

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi alozovoy ,

       

      Any chance you got a resolution on your ticket?  I am having the same issue:  SQL Endpoint is giving me the correct number of rows; but Notebooks return multiple versions of records (started for me yesterday).

       

      Thank you