topic Re: Power BI Custom Visual Text Filter -- data limitation in Custom Visuals Development Discussion

Power BI Custom Visual Text Filter -- data limitation

Anonymous — Wed, 28 Feb 2024 07:48:12 GMT

HI,

I have a very large dataset, imported to my local workspace. When I use the Text Filter to search for data, it doesn't always find it. Is there any limitation of data size that the filter can support?

Thanks

Re: Power BI Custom Visual Text Filter -- data limitation

dm-p — Wed, 06 Mar 2024 01:49:44 GMT

Hi @Anonymous,

For looking at the source code, it looks like they are using the maximum limit of 30,000 rows. This means that if you have more than 30,000 unique values of the column you're attempting to filter, then some of them will be omitted based on the order they are sent to the visual by Power BI.

Regards,

Daniel

Re: Power BI Custom Visual Text Filter -- data limitation

Anonymous — Wed, 06 Mar 2024 05:56:03 GMT

Hi Daniel,

Thanks for the answer! That's way not enough for me. I have millions of rows.

Is there any way to optimize/make Power BI handle this, or is Power BI simply unable to handle large datasets?

Re: Power BI Custom Visual Text Filter -- data limitation

lbendlin — Wed, 06 Mar 2024 11:55:23 GMT

It means that this custom visual is not suitable. The Filter pane will be able to handle the volume.

Re: Power BI Custom Visual Text Filter -- data limitation

Anonymous — Wed, 06 Mar 2024 12:07:30 GMT

Thanks! If that's how it is, is there a way to prompt the end user enter the value for filtering?

Re: Power BI Custom Visual Text Filter -- data limitation

lbendlin — Wed, 06 Mar 2024 12:22:03 GMT

Have a training session with them where you teach them how to use the filter pane.

Re: Power BI Custom Visual Text Filter -- data limitation

dm-p — Wed, 06 Mar 2024 20:40:20 GMT

Power BI Can handle large datasets, but it is designed for aggregation (i.e., minimal data points) when it comes to using visuals on the canvas. Slicers (which are a visual) need to look at all available data, which means that Power BI needs to send all available values to it before its logic can work. This limit is 30K rows (if the visual author has permitted this amount; in this case, they have).

As @lbendlin has advised, you would need to use the filter pane for such a scenario, as this isn't a visual on the canvas and is not subject to the same limitations.