Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
Saman5
New Member

All records from a table in a website not displaying

There is no page no in the URL.

Only arrows are displaying for each table.

Please tell me how to scrap all the data from the website in the powerBi.

IMG20201204124852.jpg

1 ACCEPTED SOLUTION
PhilipTreacy
Super User
Super User

HI @Saman5 

That website is using JavaScript to display the information and you won't be able to use PBI/PQ to get the data.

You could use VBA or Python to interact with the site and get what you want, but even then you may be limited in what you can get. It depends on exactly how the site is programmed.

Further reading

https://www.myonlinetraininghub.com/web-scraping-with-vba

https://www.myonlinetraininghub.com/web-scraping-filling-forms 

regards

Phil



Did I answer your question? Then please mark my post as the solution.
If I helped you, click on the Thumbs Up to give Kudos.


Blog :: YouTube Channel :: Connect on Linkedin


Proud to be a Super User!


View solution in original post

5 REPLIES 5
PhilipTreacy
Super User
Super User

HI @Saman5 

That website is using JavaScript to display the information and you won't be able to use PBI/PQ to get the data.

You could use VBA or Python to interact with the site and get what you want, but even then you may be limited in what you can get. It depends on exactly how the site is programmed.

Further reading

https://www.myonlinetraininghub.com/web-scraping-with-vba

https://www.myonlinetraininghub.com/web-scraping-filling-forms 

regards

Phil



Did I answer your question? Then please mark my post as the solution.
If I helped you, click on the Thumbs Up to give Kudos.


Blog :: YouTube Channel :: Connect on Linkedin


Proud to be a Super User!


v-robertq-msft
Community Support
Community Support

Hi, @Saman5 

According to your description, you want to get information from the web through Power BI, I suggest you to connect to the web using web connector in Power BI Desktop, like this:

v-robertq-msft_0-1607314708630.png

 

Then you can select the data you want to import to Power BI to make some transform or create visuals, like this:

v-robertq-msft_1-1607314708639.png

 

And you can get what you want.

More info about connecting to a web page in Power BI

 

Best Regards,

Community Support Team _Robert Qin

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

I had tried this but all the data from the tables is not extracting.

And the URL does not contain any page number .

Like the attached picture showing only 10 records but table contain total 116 records .so the powerBi is showing only 10 records.

Screenshot_2020-12-06-12-55-17-92.jpg

v-robertq-msft
Community Support
Community Support

Hi, @Saman5 

According to your picture, I guess that it is not a report created by Power BI, so what’s your true meaning? What’s more, if you want to scrap all the data from the Power BI report, you can upgrade your dataset(like download the report as pbix in Service then edit the dataset in Power BI desktop) or just delete your dataset in the Power BI service.

If you still can’t solve your problem, you can share some sample pictures or pbix file so that we can help you in advance.

Thanks very much!

How to Get Your Question Answered Quickly 

 

Best Regards,

Community Support Team _Robert Qin

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Hi,

This screenshot is from website https://contracts.disclosurelo.gs/displaySON.php?SONID=SON3520191&year=2019.

I want to scrap data from this website through powerBi .

 

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.