Pullinfg data from website to report

[sdhn]

Hi All,

I am developing a dashboard based on a public website.

Here’s what I’ve done:

1. Get Data > Click on Web > Entered URL > Load.

   This loaded 4 tables for me:

   • All Main
   • Displayed Text
   • HTML Code
   • Table 1 (Table 1 has fields from Column 1 to Column 9)

I checked the All Main table, and it contains the following fields:

• Benefits
• Job Title
• Name
• Pay
• OT Pay
• Reg Pay
• Total Pay
• Total Pay & Benefits

I added a search visual for the Name field.

If I search for a name, this page brings up the values for that name and displays them on the first page of the website. However, if I search on the website, I can see records beyond the first page.

To illustrate, imagine www.go.com displays 20 names. My report can search and display names found on that site. But if I search for "John Mike" on www.go.com and it’s not listed on the first page, it won't appear in the report, even though it might be found if searching directly on the website.

Thanks 

SDHN

[Anonymous · Accepted solution]

Hi  @sdhn ,

As far as I know, Power Query fetches data from websites that are static, and can only fetch existing data and fixed elements in the site, the content of the site is loaded asynchronously by the site scripts, and if you want to fetch dynamic data from the site, you may need to search for the relevant backend API for the source data.

This is the related document, you can view this content:

Extract data from a Web page by example - Power Query | Microsoft Learn

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.