Forum Discussion
Super UserIs it possible to scrape tables generated by javascript into the query editor?
As a concrete example, lets say I want to load in the Standings table at the bottom of https://tcec.chessdom.com/
I'd like to load in Engine, # Games, Points, etc., but I can't figure out how. If you view the source for the page, you can deduce that that table is generated by some sort of Javascript. Something about "crosstable, "socket", "bootstrap" and various things I'm not familiar with.
If I attempt to load it in via Power Query > Get Data > Web > Add table using examples, that table doesn't appear anywhere in the Web view and I'm guessing it's because it's dynamically generated rather than part of the base HTML.
Is there a reasonable solution or workaround for this natively? If not, are there any nice R/Python scripts that would do the job?
2 Replies
v-danhe-msftMicrosoft Employee
Hi AlexisOlson,
Based on my test, I am afraid you could not get the data table, I have tried with python, but this web is a dynamic web, it could not load the data and with this function in Power BI:
https://docs.microsoft.com/en-us/power-bi/desktop-connect-to-web-by-example
It also could not load the correct data. Or I suggest you ask the problem in python forum to get a further problem.
Hope it could help you.
Regards,
Daniel He
- AlexisOlsonThanks for trying. I guess I'll look into finding a python script I can embed in my M query.
