Forum Discussion

RokuCap's avatar
RokuCap
Icon for Helper I rankHelper I
2 years ago
Solved

Creating a Web Query to scrape data from multiple webpages

I was following along to an exercise to 'Web scrape with Power Query' (Link). It involves using a formula in Power Query to import 'Major League Base Detailed Standings' table data from the 'baseball...
Need Help
  • PhilipTreacy's avatar
    PhilipTreacy
    2 years ago

    Hi RokuCap 

     

    Let me check, give me 10 minutes.  A quick look at the web page structure shows me that the actual table of data you want is in HTML comments, meaning the web browser wouldn't display it.

     

    So the fact we are seeing it means there's something else going on like maybe JavaScript is reading the table and rendering it to screen.  Unusual.

     

    In the meantime I've created this example PBIX file  that loads the data you want via a function.

     

    Phil

     

PhilipTreacy's avatar
PhilipTreacy
Icon for Super User rankSuper User
2 years ago

Hi RokuCap 

 

Let me check, give me 10 minutes.  A quick look at the web page structure shows me that the actual table of data you want is in HTML comments, meaning the web browser wouldn't display it.

 

So the fact we are seeing it means there's something else going on like maybe JavaScript is reading the table and rendering it to screen.  Unusual.

 

In the meantime I've created this example PBIX file  that loads the data you want via a function.

 

Phil

 

RokuCap's avatar
RokuCap
Icon for Helper I rankHelper I
2 years ago

Hi Phil,

 

Your PBIX file works perfectly in edit mode but I get the following error when I try to load the data. Do you get the same errors? It loads really slowly to the point of timing out. I assumed it had something to do with the source website or even my internet connection.

Thanks again