Another Web Scraping Query

I get the same as that for your URL example, but my URL example still has the same issue as at the start. Is there no way you would be able to test my URL specifically/directly please? It clearly has something quirkier going on. Is the issue with you accessing this specific URL down to you not being in the UK? Would it be possible to try via VPN somehow? I am so grateful for all your help

Hi , jmillsjmills 

We're sorry, but I don't have access to your internal URLs and can't help you test.

If you are a Power BI Pro licensee, you can create a support ticket for free and a dedicated Microsoft engineer will come to solve the problem for you.

It would be great if you continue to share in this issue to help others with similar problems after you know the root cause or solution.

The link of Power BI Support: https://powerbi.microsoft.com/en-us/support/

For how to create a support ticket, please refer to https://community.powerbi.com/t5/Community-Blog/How-to-create-a-support-ticket-in-Power-BI/ba-p/6830...

Best Regards,

Aniya Zhang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Is there anyone please that can directly take a look at this and assess this URL specifically? I can't seem to access Power BI Support - and am wondering if this could be to do with being only free trial on Power BI Pro

Hi, jmillsjmills 

Yes, only Pro license users can apply for a support ticket.

For your question, can you share the url and the “Headers” of this https request to us?Like this :

Thank you for your time and sharing, and thank you for your support and understanding of PowerBI! 

Best Regards,

Aniya Zhang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Sure! Thanks

I am now working with this one: 

https://www.betfred.com/services/SportsBook/event?language=uk&type=event&eventid=22385578.2&dataflags=14&datasize=8&cachebust=1669080116102

and the headers are:

Hi , jmillsjmills 

Can you try to use this to test?

let
    url = "https://www.betfred.com/services/SportsBook/event?language=uk&type=event&eventid=22385490.2&dataflag...[your url should replace here]",
    headers = [#"accept"="application/json",#"content-type"="application/json",#"referer"="https://www.betfred.com/sports/event/22385490.2",#"user-agent"="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.52",#"cookies"="your cookies"],
    response = Web.Contents(
        url,
        [
            Headers = headers
        ]
    ),
    jsonResponse = Json.Document(response)
in
    jsonResponse

 You need to midify the "url" , "cookies" in this code.

Thank you for your time and sharing, and thank you for your support and understanding of PowerBI! 

Best Regards,

Aniya Zhang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

I really appreciate your patience but i'm afraid it's still not working on my end, with the same error. Was that working from your side? 

Hi, jmillsjmills 

This is really strange, for you "F12" screenshot does return data in JSON format. But in PQ it returns HTML, first of all, you can click the "response" to see If there is data returned, and see what the returned data is, whether it is HTML-type data？And can you share the "response" step return in the PQ screenshot?

If the html , can you try to use the "Web.Page(response)" to get the data ?

Thank you for your time and sharing, and thank you for your support and understanding of PowerBI! 

Best Regards,

Aniya Zhang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly