Why does my whole dataset refresh when I've removed most of the data by filtering out lines?

[siddrow]

Hi

In my power query for the dataset, I've removed out heaps of lines by using the filter function, so I'm left with about 200 lines. When I refresh my dataset, it still loads all rows (the original data is about 80k lines) and takes forever. How do I avoid this? This dataset is pulled from active directory and I need the live data, no just a data dump, so I can't bring it in any other way. 

[lbendlin]

The ActiveDirectory connector most likely doesn't support query folding.  Use an ODATA query against the Graph API instead, including your filters. Or - find an AD extract in CSV form that surely must exist in your company.

[siddrow]

Hi

Thanks for the reply. I have never done that before - can you please explain " Use an ODATA query against the Graph API instead, including your filters"

thank you

[lbendlin · Accepted solution]

Use the Microsoft Graph API - Microsoft Graph | Microsoft Learn

Manage Microsoft Entra identity and network access capabilities by using Microsoft Graph - Microsoft...

Graph Explorer | Try Microsoft Graph APIs - Microsoft Graph