Forum Discussion
Azure Table Storage filter by partition key range
Is it possible to filter data on Azure Table Storage side via Table Storage connector?
Table Storage has preformant operations to fetch data by given Paertition Key range like the following:
(PartitionKey ge 'AAAAA' and PartitionKey le 'BBBBB')
Is it possible to force PowerBI somehow to make such perofromant queries instead of filtering on the user side?
Here is M-language snippet (from Advanced Editor). This is translated and works on server side like a charm.
... #"Filtered Rows" = Table.SelectRows(tablename, each ([PartitionKey] >= "XXXX" and [PartitionKey] <= "YYYYY" )), ...
3 Replies
- eugene1Regular Visitor
Here is M-language snippet (from Advanced Editor). This is translated and works on server side like a charm.
... #"Filtered Rows" = Table.SelectRows(tablename, each ([PartitionKey] >= "XXXX" and [PartitionKey] <= "YYYYY" )), ...
- KoenDeVroedeNew Member
Dear all,
The solution also works for me but I would like to make the filtering 'dynamic' based on the result of another query.
When I define another query LastProcessedPartitionKey which returns a single value of type Text and I change the filtering condition to
...
#"Filtered Rows" = Table.SelectRows(tablename, each ([PartitionKey] > LastProcessedPartitionKey,
...evaluation keeps going on...
When I replave the queryname by the actual underlying value between "", the results are available after a couple of seconds.
Could it be that the use of a 'variable' breaks the query folding and triggers processing on client side?
Thanks and best regards
Koen
- eugene1Regular Visitor
I think you are right, it looks like only the constant expressions are supported in such cases to be translated to the server-side fitering expressions...