Keyword search over large dataset

[hrafnkel11]

Hi - we are encountering issues creating a keyword search over a large dataset and wanted to see how others may have overcome.

We migrated data from a deprecated ticketing system into Snowflake. The business needs to be able to search keywords within some fairly large text columns (trimmed in Snowflake to 32,763 characters to meet Power BI visual requirements).

Given the Text Filter's 1,000 record count limitation, are there any other options available to us before we explore non-Power BI options?

My thought was that we could set this up as Direct Query back to Snowflake, create a user-defined parameter and have that pass to Power Query as a WHERE statement, but there seem to be some limitations around this approach.

Another possible option may be to tokenize the top 1000 keywords and only allow searching on those, but that obviously would limit the search options.

Any other ideas? I can't imagine this hasn't been encountered by others working with datasets larger than ours.

[lbendlin · Accepted solution]

How many search terms are you using in parallel?  The Filter Pane allows you to use up to two search terms in AND or OR combination.

[hrafnkel11]

I forgot to say thanks for this! This worked like a charm. We tried so many complicated methods and the simplest one was right there the entire time. Thanks again!