Forum Discussion
Importing multiple pages tabular data from web
I am trying to import multiple pages of data that are indexed in a table in this URL http://www.nepalstock.com/main/floorsheet/index/176/?contract-no=&stock-symbol=&buyer=&seller=&_limit=500 By default, the site only shows 20 rows of data but we have an option to display 500 rows at a time. With the help of one video on power query, I was able to import this into excel. But I could do so only for the first 500 rows only. There are around 176 such pages and my aim is to edit the code in power query editor that imports all the pages into excel.
In the example video where I learned to import these data via power query, in the advance editor, we could define a variable (StartPage as text)>= and change the start page of URL with this variable. But in my case the URL is little bit different. It doesn’t have “……&start=1&…” in the URL where I can change the variable name. Instead, it has index number that runs serially from 1 to hundreds. I would hugely appreciate if someone could guide me how I could import all of the pages.
2 Replies
- mahoneypatMicrosoft Employee
Please see if the approach in this video helps you solve this. If you web call has a skip or offset parameter, this may be simpler.
Power BI - Tales From The Front - REST APIs - YouTube
Pat
- AnonymousNot applicable
yugadi
Do you mean you want to show first 500 rows in one table, and then next 500 rows in a second table and so on? I doubt you can do that.Something might help:
Loop through Multiple Web Pages using Power Query - Adatis
Scrape Data from Multiple Web Pages with Power Query • My Online Training Hub
Paul Zheng _ Community Support Team
If this post helps, please Accept it as the solution to help the other members find it more quickly.