Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
Anonymous
Not applicable

Webscraping a Webpage with a Login and Password

I need some help working through an issue with trying to pull into both desktop and dataflows of a table of data behind a login and password.

 

The data is coming from https://fcafuel.org/historical-fuel-index/.

 

The public version includes historical data, yet not the current records.

 

The entire historical table is only available behind the pay wall.

 

I want to pull this data into a dataset for a report.

5 REPLIES 5
v-diye-msft
Community Support
Community Support

Hi @Anonymous 

 

Let me know if you'd like to get below data:

0009.PNG

You might refer to this article:

https://www.poweredsolutions.co/2018/05/14/new-web-scraping-experience-in-power-bi-power-query-using-css-selectors/ 

 

Community Support Team _ Dina Ye
If this post helps, then please consider Accept it as the solution to help the other members find it more
quickly.
Anonymous
Not applicable

@v-diye-msft  Thanks for the suggestion.

 

I've already tried similar methods and run into the issues of not being able to pass/use login and password to access current values.

 

Instead, I run into the "Table highlighting is disabled..." error like in the thread below.

Get error message as Table Highlighting is disable... 

@Anonymous 

I tried to extract data form a website which required credentials and failed dismally. I eventually succeeded with a long workaround using Excel.

If you're interested, you can see how in this thread:

 

Get data from web with credentials 





Did I answer your question? Mark my post as a solution!
In doing so, you are also helping me. Thank you!

Proud to be a Super User!
Paul on Linkedin.






Anonymous
Not applicable

@PaulDBrown 

 

Thanks! I'll look into the link you sent and try it out.

@Anonymous 

Good luck! (btw, you still need the credentials to get into the dataset- the solution in the thread only solves the problem of getting access to the dataset going through the login requirements; it does not provide a back-entry avoiding login...)

 

EDIT: I just did a search for a solution using Python and came across this:

 

Scraping data from web which requires login using Python 





Did I answer your question? Mark my post as a solution!
In doing so, you are also helping me. Thank you!

Proud to be a Super User!
Paul on Linkedin.






Helpful resources

Announcements
July 2024 Power BI Update

Power BI Monthly Update - July 2024

Check out the July 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

Top Solution Authors