Get data from Web

[Chiwa200]

Hi, I am trying to get data from Web in Power BI Desktop but it's failing to load after I select the tables. Saying timed out. Anyone with an idea why this is the case?

[Chiwa200]

This popped up after using the advanced option and put the timeout to 10 mins and the other pic shows the error after i click "load"

[Chiwa200]

Hi @pcoley @stoic-harsh @danextian 

Thank you for your feedback. I am trying to get data from [https://worldpopulationreview.com/state-rankings/median-household-income-by-state], and am encountering the challenge as in the screenshots. However, if I use the advanced option and increase the time out to 10 or 15 mins, it would show the tables on the navigator but would fail to load after selecting the necessary tables.

[v-moharafi-msft]

Hi  @Chiwa200  ,

Thank you for reaching out to Microsoft Fabric Community and Thanks to @danextian , @stoic-harsh and @pcoley  for Sharing valuable insights.

Just wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. 

 Best Regards,

Abdul Rafi.

[danextian]

What URL are you trying to scrape? The website may have a security layer that blocks browser sessions not initiated by a human user, which is how Power Query typically behaves.

[stoic-harsh]

Hey @Chiwa200,

Agree with @pcoley. That said, could you provide more context and screenshots? The issue could stem from several different causes, so a bit more detail would help narrow it down.

Best,

Harshit

[pcoley]

Hi @Chiwa200 ,

there are many ways to get data from web. actually you can just have a request that get one specific table or you can do really web scrapping going deeper. 
Many websites split data across multiple pages (and you need to iterate through each page; this requires analyzing the page URL structure to see how it handles pagination). In other scenarios all the tables can be accessed in the same page.
Maybe the query that you have is trying to go through many pages or tables. Maybe you need to have authorizations. Maybe the page is blocking multiple queries... there are many options that generate your issue. If you can please share more info about your script. 

[Chiwa200]

Hello @pcoley , 

Thank you for your feedback. I am trying to extract data from world population review (https://worldpopulationreview.com/state-rankings/median-household-income-by-state) and am getting the error as in the screenshots. However, when I use the advanced option and increase the timeout to 10 or 15 mins, it will show the tables but when I select relevant tables and load, its not loading. Saying timed out.