Forum Discussion
Get Data not showing from Web source
Hello,
I'm very new to Power BI and trying to follow along the lesson plan on MS learning plan but I keep runing into an issue when I try to load data from a Web https://www.fool.com/research/best-states-to-retire/ (I have followed each step and have enabled "Enable web table inference option" in the settings. I keep getting the result in the dark and I don't know how I can fix it. Please help 🙂
My resultExpected result
Hi Becca94 ,
Agree with lbendlin,
It appears to be a change in the architecture of this site. The data tables in the page are rendered in JS and embedded in iframe, you can see the html code of the page embedded in the iframe on the page:
But Power Query's Web.BrowserContents (which is the same as web connector you are using in Power BI now) can't get to this data in this type.
So that tutorial you are learning from should be outdated, if you just need to learn how to get data from the web, replace it with a viable site. If you definitely need to get data from that site, maybe you can try to use a python crawler, or try to get its corresponding API that doesn't require a token (but that's difficult).
Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
5 Replies
- lbendlin
Super User
That lesson plan was probably generated a long time ago. Web sites change their design frequently. The table is now reachable via this DOM tag:
- vojtechsima
lbendlin How do you access it tho.
I tried using Html.Table with selector of "table" and there's no actual element when you get the page and inspect the code within power query.
- vojtechsima
Hello, Becca94 ,
I tried it myself. I think the issue is that the content you want is dynamically loaded and isn't available upon the first scan. I wonder how you even got the second screen (the expected result).
The 'Expected Result" was taken from the lesson plan. I couldn't get that result myself 😞
Hi Becca94 ,
Agree with lbendlin,
It appears to be a change in the architecture of this site. The data tables in the page are rendered in JS and embedded in iframe, you can see the html code of the page embedded in the iframe on the page:
But Power Query's Web.BrowserContents (which is the same as web connector you are using in Power BI now) can't get to this data in this type.
So that tutorial you are learning from should be outdated, if you just need to learn how to get data from the web, replace it with a viable site. If you definitely need to get data from that site, maybe you can try to use a python crawler, or try to get its corresponding API that doesn't require a token (but that's difficult).
Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
