Web.BrowserContents refresh issue on Power BI Service (dynamic data source)

[Anonymous]

Hi,

I have created a Power BI file that does web scrapping using the Web.BrowserContents function.

The scrapping is done dynamically, so I created a function for web scrapping and the parameters of this function are used to build my URL.

It works fine on Power BI Desktop, but I can't refresh the dataset on Power BI Service because I get the following error:

This dataset includes a dynamic data source. Since dynamic data sources aren't refreshed in the Power BI service, this dataset won't be refreshed. Learn more: https://aka.ms/dynamic-data-sources.

The code looks like this:

(var_value as text) =>
let
Source = Web.BrowserContents("<base URL>?<parameter1>="& var_value ),

I saw that web.Contents allowed to avoid this error by using the Query parameter, but it doesn't seem possible with Web.BrowserContents.

Does anyone have a solution?

Thanks!

[lbendlin]

@Anonymous Try this one 

WebAction.Request - PowerQuery M | Microsoft Docs

[Anonymous]

Hi @lbendlin , 
Thank you for your help. 

However, I am not sure it is working. Am I not supposed to use this method to make an API call ? If yes, I'll get a binary output and not a HTML one.... no ? 

Thank you for your answers. 

[lbendlin]

Since you know that the returned data is actually the HTML you can parse it as such in your next step.

[Anonymous]

I am not sure it is working. 
It seems that it really is for an API call and I am not making an API call, just some web scrapping. 

I get the following error: 

Expression.Error: We haven't been given permission to perform actions against this resource.

I don't need any permission to access this website. I also tried to get another table just to make sure it's not a permission issue, but I receive the same error if I try to access one of the table in the following Wikipedia page. https://en.wikipedia.org/wiki/List_of_Unicode_characters

I am not sure the solution is not working or if it is me that is not correctly using the function. Could you quickly try with the wikipedia page above ? If that is working, I am curious to see the M code that you use 🙂

Thanks !