Creating a Custom Connector to Access API Response Headers in Power BI

Hi all,

We have successfully set up an API connection in Power BI and loaded data from the current endpoints. However, the API has a limit of 5,000 records. As a response header, the call returns an "x-next-key" which can be used to retrieve the next 5,000 records. The problem is that we response headers are not visible in Power BI.

We have tried several options, such as WebMethod.head() and Odata.Feed(), but none of these methods seem to show the response header needed to load the next 5,000 rows.

We would like to automate this and have been told that this should be possible using a custom connector. Unfortunately, however, we have not yet been able to get the headers into Power BI. Can anyone provide assistance in creating a custom connector in order to get the response header "x-next-key" in?