Forum Discussion
Get data from Web
Hey Chiwa200,
Thanks for providing additional info. The issue was caused by the Suggested Tables section in the Power BI Web connector. The webpage actually contains only:
- 1 actual HTML table
- multiple Power BI inferred Suggested Tables from web-page
These are not real tables. Power BI creates them while trying to infer tabular structures from the rendered page. This process is computationally heavy and often causes endless loading. The fix is to just select the HTML Table. It should load successfully.
Best,
Harshit
Hi Chiwa200 ,
there are many ways to get data from web. actually you can just have a request that get one specific table or you can do really web scrapping going deeper.
Many websites split data across multiple pages (and you need to iterate through each page; this requires analyzing the page URL structure to see how it handles pagination). In other scenarios all the tables can be accessed in the same page.
Maybe the query that you have is trying to go through many pages or tables. Maybe you need to have authorizations. Maybe the page is blocking multiple queries... there are many options that generate your issue. If you can please share more info about your script.
Hello pcoley ,
Thank you for your feedback. I am trying to extract data from world population review (https://worldpopulationreview.com/state-rankings/median-household-income-by-state) and am getting the error as in the screenshots. However, when I use the advanced option and increase the timeout to 10 or 15 mins, it will show the tables but when I select relevant tables and load, its not loading. Saying timed out.
