Azure Table Storage filter by partition key range

[eugene1]

Is it possible to filter data on Azure Table Storage side via Table Storage connector?

Table Storage has preformant operations to fetch data by given Paertition Key range like the following:

(PartitionKey ge 'AAAAA' and PartitionKey le 'BBBBB')

Is it possible to force PowerBI somehow to make such perofromant queries instead of filtering on the user side?

[eugene1 · Accepted solution]

Here is M-language snippet (from Advanced Editor). This is translated and works on server side like a charm.

...
#"Filtered Rows" = Table.SelectRows(tablename, each ([PartitionKey] >= "XXXX" and [PartitionKey] <= "YYYYY" )),
...

[KoenDeVroede]

Dear all,

The solution also works for me but I would like to make the filtering 'dynamic' based on the result of another query.

When I define another query LastProcessedPartitionKey which returns a single value of type Text and I change the filtering condition to

...
#"Filtered Rows" = Table.SelectRows(tablename, each ([PartitionKey] > LastProcessedPartitionKey,
...

evaluation keeps going on...

When I replave the queryname by the actual underlying value between "", the results are available after a couple of seconds.

Could it be that the use of a 'variable' breaks the query folding and triggers processing on client side?

Thanks and best regards

Koen

[eugene1]

I think you are right, it looks like only the constant expressions are supported in such cases to be translated to the server-side fitering expressions...