Prefilter Azure Table Storage Data

[jhuamani]

Hi, I have data in Azure Table Storage that I'm attempting to use Incremental Refresh on when using the Azure Table Storage Connector. However, I've noticed that when using the connector all the data in my tables gets imported, which sometimes is causing me timeout issues, despite having subsequent filters on the Partition and Row Keys. I'd like to know if it's possible to pre-filter Azure Table Storage data on the Partition and Row Keys during the initial import. I've found this information on querying Table Storage but there is no option to apply a simple query via the Table Storage Connector. Thank you!

[v-xinruzhu-msft]

Hi @jhuamani 

After testing, you can consider to use api to filter, then select web connector,  you can refer to the following link.

Querying tables and entities (REST API) - Azure Storage | Microsoft Learn

And you can also refer to the following similar thread.

Pre-filtering/selecting data before Importing to P... - Microsoft Fabric Community

powerbi - How to pre filter the data Set before loading all the data in Power BI - Stack Overflow

powerquery - How to efficiently filter Azure Table Storage data in Power Query - Stack Overflow

Best Regards!

Yolo Zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.