Web.BrowserContents() slow

[Yggdrasill]

Using the Web.BrowserContents() function to get some scraped data from a web page is turning into an overall disappointing journey. I like the first steps on how they've made it easy to scrape web pages with this method and I have no complains there.

However.

I'm using an URL with RelativePath and parsing 100 id's into the URL and calling the URL 1 time per row. I invoke the custom function for a list of 100 ids. Basically it's baseURL/id

First I spend almost half an hour getting data for 100 rows in Power Query, then when I want to load the already "pre-loaded" data into my model everything starts all over again. I thought the Power Query result would be cached.

Is there a way to cache each record called upon using the Web.BrowserContents() ?

I've tried the Table.Buffer() function but honestly I have no clear idea how that works.

[v-lid-msft]

Hi @Yggdrasill ,

We can create another custom column to store the result of Web.BowserContens() functon, then we can use the content in this column to invoke other custom function.

The content in Custom column is cached as simple text with html format, this column can be used multi times in power query without recall origin page,  but it will be called again if refresh the model to keep the model up-to-date.If you do not want to refresh this table, for example  it does not update frequently,  we can disable "include in report refresh" .

Best regards,