topic Re: dataflow gen2 filter in Data Engineering

dataflow gen2 filter

arkiboys2 — Thu, 07 Nov 2024 15:37:52 GMT

in dataflow gen2 filter how to have this applied?

column2 not equal to lower(trim('buy'))

so if the value is 'Buy' or 'buy' then I want to make sure the column2 is not equal to either one of these.

thank you

Re: dataflow gen2 filter

frithjof_v — Fri, 08 Nov 2024 05:09:43 GMT

This is what ChatGPT gave me:

= Table.SelectRows(#"yourTableName", each Text.Lower(Text.Trim([column2])) <> "buy")

Does it work for your case?

* the yourTableName shall be replaced by the name of the preceding step in your M query.

Re: dataflow gen2 filter

Anonymous — Fri, 08 Nov 2024 03:00:56 GMT

Hi @arkiboys2 ,

Thanks for the reply from frithjof_v . The syntax he provided is basically correct, with a small modification on my part.

You mean you want to filter out the data in Column2 with value 'Buy' or 'buy' right, am I understanding it correctly?

This is the data I created to use for testing:

ID Column2

1 buy

2 sales

3 Twins

4 Buy

5 Boy

6 Girl

7 girl

8 Buy

9 buy

10 buy

Modify the code as follows:

Table.SelectRows(#“Changed column type”, each Text.Lower(Text.Trim([Column2])) <> “buy”)

The final display is as follows:

If you have any other questions please feel free to contact me.

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

Re: dataflow gen2 filter

frithjof_v — Fri, 08 Nov 2024 05:22:13 GMT

The easiest way to do this, is:

In the user interface, make a random filter selection. In Column2 filter dropdown, choose some random value. It doesn't matter which value you choose.
The previous step will automatically generate some M code, where the Table.SelectRows function is used.
Then, manually replace the contents of the Table.SelectRows function with the actual code:

Table.SelectRows(#"name Of Previous Step", each Text.Lower(Text.Trim([column2])) <> "buy")