Forum Discussion
Extract Data from a table on a website
Just an update on this challenge. I have been seraching the forum for the past few hours and eventualy came across this post which was right on topic:
It seems that you can extract data from these kind of tables by using Python (which is way beyond my current scope).
As a temporary solution the orginal poster mentioned downloading the actual HTML page and connecting to the file instead of the website. Not ideal obviously, but at least I now have a snapshot of the data as it stands at the moment. Extracting the data this way was painless, and all the rows of the table were loaded automatically.
Power Bi can do this for you.
-Get Data
-Web
enter the URL and choose the table that's available
Anonymous
Thank you for taking the time to look into this. I did get as far as you have suggested. The problem is that the URL input only returns the first 50 rows out of a total of 280. Normally I would use a function and an input table for the pages for each of the following pages containing the subsequent rows. However, when you move to the next pages in the table on the website the URL remains static - in other words it’s the same URL for all pages, so I am lost as to how to obtain the complete table dataset.
I would appreciate any input as to how to get the query to run through all of the rows inte table, and not just the first 50.
many thanks for your help!
Just an update on this challenge. I have been seraching the forum for the past few hours and eventualy came across this post which was right on topic:
It seems that you can extract data from these kind of tables by using Python (which is way beyond my current scope).
As a temporary solution the orginal poster mentioned downloading the actual HTML page and connecting to the file instead of the website. Not ideal obviously, but at least I now have a snapshot of the data as it stands at the moment. Extracting the data this way was painless, and all the rows of the table were loaded automatically.