Forum Discussion
Duplicated Rows In Tables Built By Notebook
You mention that you use dataflow gen2 to update the data in the table.
Do you use replace or append in the Dataflow gen2 destination settings?
If you are using append, then it would be expected to see extra rows.
If you are using replace, then I agree it should not be duplicates in the destination table. Then I would create a support ticket.
It is set to replace.
Regardless, that should only impact the creation of the first table (Rainbow_Accounting_Adjustments). As the first query shows, this table appears to import correctly (at least when using the SQL endpoint).
However when I use this table in a notebook it has duplicate rows.
Just to clarify:
Excel ----(Dataflow Gen2)---> Rainbow_Accounting_Adjustments ---(Notebook)---> Business_Unit_Adjustment_Totals
- frithjof_v2 years ago
Community Champion
I see
So if you query the Rainbow_Accounting_Adjustments from SQL analytics endpoint, you get the right number of rows?
And if you query Rainbow_Accounting_Adjustments from Notebook, you get the double number of rows?
I think I experienced the same thing myself, if I remember correctly. But I deleted my Lakehouse and dataflow gen2 afterwards. If you still have your Lakehouse and dataflow gen2, I encourage you to raise a support ticket so that support can have a look at it
- alozovoy2 years ago
Advocate II
I have opened a Support Ticket.
Thank You!
- Anonymous2 years agoNot applicable
Hi alozovoy ,
Any chance you got a resolution on your ticket? I am having the same issue: SQL Endpoint is giving me the correct number of rows; but Notebooks return multiple versions of records (started for me yesterday).
Thank you