Duplicate Invoice No and Use Data from 2nd record

No, the issue was that you included the "Source" column in your grouping when you should be grouping either by "Invoice number" alone, or possibly "Invoice Number and Amount", depending on what you really want to do.

Hi Ronrsnfld,

I appreciate you hanging in there with me. 

I think I am making some progress.

My only question now is that after I group and expand the "count" column, the grouping seems to be undone meaning that I am relegated to seeing duplicates once again (grouping is removed).  I do note that prior to expanding the "count" column the duplicates seemed to have been removed, which is what I wanted however no other columns were showing other than the 2 I grouped by (Invoice No Stripped and Invoice amount).

Do you know how to recover the columns and keep the grouping after expanding the column?  

I searched online and seems a few others have had this issue but I couldnt quite figure out the answers.  

thank you very much. 

below please find the Grouping parameters I am using: 

here is what it looks like on the Group step (you can see all of the other columns are missing but if I expand the COUNT column then the Grouping is undone):

please find below the group line if needed:

= Table.Group(#"Sorted Rows", {"Invoice No Stripped", "Invoice amount"}, {{"Count", each _, type table [Processing Began=nullable date, Vendor=text, WDDate=nullable date, #"Invoice #"=text, Invoice No Stripped=text, Source=nullable text, Invoice amount=nullable number, Currency=text, Invoice date=nullable date, Invoice due date=nullable date, Company Code=nullable text, Budget Category=nullable text, Invoice Status=nullable text, Goods Receipt=nullable number, #"Project "=nullable text, Funding Date=nullable date, AppendCurr.Date=nullable date, AppendCurr.Curr=nullable text, AppendCurr.Rate=nullable number, DDNo=nullable text, USD Amount=number, Account=nullable text, TypeDraw=nullable text]}})

Your sample data does not have any entries where there are duplicate rows.

Yes, there are entries where the Amount and Stripped Invoice number match, but none where all the other entries are the same.

If you have that situation in your actual data, try:

Table.Distinct(Table.FillDown(Table.FillUp(_,{"Goods Receipt"}),{"Goods Receipt"})), type table[...

Again, please note that supplying a truly representative data sample early in this Q&A session might have resulted in a much more focused and quicker solution.

HI Ronrsnfld,

The rows are not true duplicate rows...only on Invoice No Stripped and Invoice amount and this is detailed in the sample data.  I am needing to recover those columns that were removed by the Grouping.  

Does this change anything?  

here is a screen shot of the sample data.  Note the duplicates on Invoice No Stripped and Invoice amt. only (you can ignore the vendor column as its not impt)

just adding that I woudl need to fill up or down prior to the Grouping. 

Yes, it adds to my confusion as to what you really want. Please provide a screenshot of your expected output from the data you presented in your sample workbook.

Hi Ronrsnfld,

sorry for any confusion. 

What I need to do:

1. Move the Goods Receipt to the row above

but only on a duplicate of Invoice No Stripped and Invoice amt.

I think a sort order needs to be done so that for each duplicate the Source column will show 1-PC on the top and 2-Stampli on the bottom.  I need to take the Goods REceipt from this 2-Stampli record and move it to the record above (in other words the record that is tagged with "1-PC"

then Group the data based on Invoice No Stripped and Invoice amt (this will remove the duplicates. 

let me know if I have missed something.

thank you sir. 

You have missed my request: "Please provide a screenshot of your expected output from the data you presented in your sample workbook."

All I see in your last message is an annotated screenshot of a single pair of lines of data from an original data set which is not in the data set you supplied in your sample workbook.

Hello ronrsnfld,

Please see a screen shot of the sample data. 

I hope if makes sense.  Let me know if I need to provide more instruction. 

Grateful for the help sir. 

I don't know how to ask for what I need any more clearly. Perhaps there is a language problem here.

I asked for a screenshot of expected results from the data you provided in your sample workbook.

Instead, you provided a screenshot of your sample data marked up with arrows and comments that you had already shown in your sample data workbook. (I doubt that is how you want your results to look).

I would have expected you to post something like:

Or, since you wrote you wanted to "Move" the goods receipt number, perhaps:

or perhaps something else completely.

I seem unable to explain the term "screenshot of your expected results".

So no, what you posted still does not make sense to me, and I apparently am unable to explain properly exactly what I need from you nor understand your issues with regard to you not getting what you need. 

I was hopeful that if you posted a screenshot of what you expect, it might make things more clear, but I am unable to properly communicate to you that concept, so I do not think I will be able to help you further.

Hello sir.  Sorry we are not making the progresss as expected.  You are correct that I want to move the Goods Receipt in the record above based on the conditions (Invoice No Stripped and Invoice amt).  Your screen shot above looks like what I am looking for.  Sorry I am not able to produce those screen shots in PQ as you have (instead posted a screen shot of the sample data with arrows) since my question to do that is exactly what you did in PQ but I dont know how to do that in PQ and is the underlying reason why I posted the question. 

If you can provide a solution I am ready.  

thank you again and sorry for the confusion. 

I cannot because I do not know what you want.

You mention "my screenshot above", but you don't even say which of the two screenshots!

I know you cannot produce what you want in PQ as that is what you are asking help for.

But there are other tools available to manually produce tables that should show your desired output from the input. Would be a lot easier (and faster) than our back and forth of 25+ questions, and take less time.

For example, you could take your sample data in Excel, copy it to a new sheet, then manually edit it to show what you want for a result.

I am a little confused.  You were the one who posed a great idea to use fill up.  I gave you sample data as you wanted.  Its clear what I need and you clearly posted a pic of what I need as well as I.  We are going around in circles here.  I will post another question. 

Unfortunately, although it may be clear to you what you need, it is not clear to me.

You indicated that one of the two outputs I showed in a preceding post were what you wanted; but didn't indicate which one.

But here is the code for both:

My first screenshot: Copying "Goods Receipt" from last row to "1-PC" row:

let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{
                        {"Processing Began", type date}, {"Vendor", type text}, {"WDDate", type date}, 
                        {"Invoice #", type text}, {"Invoice No Stripped", type text}, {"Invoice amount", type number}, 
                        {"Currency", type text}, {"Invoice date", type date}, {"Invoice due date", type date}, 
                        {"Company Code", type text}, {"Budget Category", type text}, {"Invoice Status", type text}, 
                        {"Goods Receipt", Int64.Type}, {"Project ", type text}, {"Source", type text}, 
                        {"Funding Date", type any}, {"DDNo", type any}, {"USD Amount", type any}, 
                        {"Account", type any}, {"TypeDraw", type any}}),
    
    #"Grouped Rows" = Table.Group(#"Changed Type", {"Invoice No Stripped", "Invoice amount"}, {
        {"Count", each Table.FillUp(_,{"Goods Receipt"}), 
            type table [Processing Began=nullable date, Vendor=nullable text, WDDate=nullable date, #"Invoice #"=nullable text, 
                Invoice No Stripped=nullable text, Invoice amount=nullable number, Currency=nullable text, 
                Invoice date=nullable date, Invoice due date=nullable date, Company Code=nullable text, 
                Budget Category=nullable text, Invoice Status=nullable text, Goods Receipt=nullable number, 
                #"Project "=nullable text, Source=nullable text, Funding Date=nullable text, DDNo=nullable text, 
                USD Amount=nullable text, Account=nullable text, TypeDraw=nullable text]}}),
    
    #"Removed Columns" = Table.RemoveColumns(#"Grouped Rows",{"Invoice No Stripped", "Invoice amount"}),
    #"Expanded Count" = Table.ExpandTableColumn(#"Removed Columns", "Count", 
        {"Processing Began", "Vendor", "WDDate", "Invoice #", "Invoice No Stripped", "Invoice amount", "Currency", 
        "Invoice date", "Invoice due date", "Company Code", "Budget Category", "Invoice Status", "Goods Receipt", 
        "Project ", "Source", "Funding Date", "DDNo", "USD Amount", "Account", "TypeDraw"})
in
    #"Expanded Count"

My second screenshot: Moving the "Goods Receipt" to the "1-PC" row

let
    Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{
                        {"Processing Began", type date}, {"Vendor", type text}, {"WDDate", type date}, 
                        {"Invoice #", type text}, {"Invoice No Stripped", type text}, {"Invoice amount", type number}, 
                        {"Currency", type text}, {"Invoice date", type date}, {"Invoice due date", type date}, 
                        {"Company Code", type text}, {"Budget Category", type text}, {"Invoice Status", type text}, 
                        {"Goods Receipt", Int64.Type}, {"Project ", type text}, {"Source", type text}, 
                        {"Funding Date", type any}, {"DDNo", type any}, {"USD Amount", type any}, 
                        {"Account", type any}, {"TypeDraw", type any}}),
    
    #"Grouped Rows" = Table.Group(#"Changed Type", {"Invoice No Stripped", "Invoice amount"}, {
        {"Count", each [a=Table.FillUp(_,{"Goods Receipt"}),
                        b=Table.ReplaceValue(
                            a,
                            each [Source],
                            null,
                            (x,y,z)=>if y<> "1-PC" then z else x,
                            {"Goods Receipt"}
                        )][b],  
            type table [Processing Began=nullable date, Vendor=nullable text, WDDate=nullable date, #"Invoice #"=nullable text, 
                Invoice No Stripped=nullable text, Invoice amount=nullable number, Currency=nullable text, 
                Invoice date=nullable date, Invoice due date=nullable date, Company Code=nullable text, 
                Budget Category=nullable text, Invoice Status=nullable text, Goods Receipt=nullable number, 
                #"Project "=nullable text, Source=nullable text, Funding Date=nullable text, DDNo=nullable text, 
                USD Amount=nullable text, Account=nullable text, TypeDraw=nullable text]}}),
    
    #"Removed Columns" = Table.RemoveColumns(#"Grouped Rows",{"Invoice No Stripped", "Invoice amount"}),
    #"Expanded Count" = Table.ExpandTableColumn(#"Removed Columns", "Count", 
        {"Processing Began", "Vendor", "WDDate", "Invoice #", "Invoice No Stripped", "Invoice amount", "Currency", 
        "Invoice date", "Invoice due date", "Company Code", "Budget Category", "Invoice Status", "Goods Receipt", 
        "Project ", "Source", "Funding Date", "DDNo", "USD Amount", "Account", "TypeDraw"})
in
    #"Expanded Count"

It works on your sample data. However, it may not if your sample data is not truly representative of your actual data. 

Hi, ok thank you.  

Appreciate the response.  That is amazing. 

The first code block (the "copy") is the closest but it doesnt seem to move the "Goods Receipt" from the 2-Stampli (Source column) to the 1-PC row (its NULL).

The 2nd code block (the "move) seems to show all Goods Receipt as NULL.  

Below is the output (filtered for only 1 invoice) for the first code block (the "copy" Goods Receipt).

Possibly you see an easy tweak to the codes?  I am fine with the Goods Receipt being in both rows.  

thank you sir.  Appreciate the expert assistance. 

1. "I am fine with the Goods Receipt being in both rows." Does that mean that is your preferred outcome or not? You need to pick one or the other.

2. It works on your sample data as shown by my screenshots. So I would guess that your sample data is not truly representative of your real data.

3. In both your original question and also in your sample data, you state and show that "2-Simpli" is in the second row of each matching "invoice no/invoice amount", yet in your screen shot it is showing as the first row.

You also show only two (2) rows for any given matching in your sample data.

So if both those statements are true, I don't know why the order is reversed in your screenshot. Please explain.

Hello ronrsnfld, excellent!  That worked perfectly.  Both of them did.  I am going to use the one that "MOVES" the goods receipt.   thank you again for your expert assistance and  hanging in with me.  You are obviously very talented.   have a good day.