cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Anonymous
Not applicable

Webscraping a Webpage with a Login and Password

I need some help working through an issue with trying to pull into both desktop and dataflows of a table of data behind a login and password.

 

The data is coming from https://fcafuel.org/historical-fuel-index/.

 

The public version includes historical data, yet not the current records.

 

The entire historical table is only available behind the pay wall.

 

I want to pull this data into a dataset for a report.

5 REPLIES 5
v-diye-msft
Community Support
Community Support

Hi @Anonymous 

 

Let me know if you'd like to get below data:

0009.PNG

You might refer to this article:

https://www.poweredsolutions.co/2018/05/14/new-web-scraping-experience-in-power-bi-power-query-using-css-selectors/ 

 

Community Support Team _ Dina Ye
If this post helps, then please consider Accept it as the solution to help the other members find it more
quickly.
Anonymous
Not applicable

@v-diye-msft  Thanks for the suggestion.

 

I've already tried similar methods and run into the issues of not being able to pass/use login and password to access current values.

 

Instead, I run into the "Table highlighting is disabled..." error like in the thread below.

Get error message as Table Highlighting is disable... 

@Anonymous 

I tried to extract data form a website which required credentials and failed dismally. I eventually succeeded with a long workaround using Excel.

If you're interested, you can see how in this thread:

 

Get data from web with credentials 





Did I answer your question? Mark my post as a solution!
In doing so, you are also helping me. Thank you!

Proud to be a Super User!
Paul on Linkedin.






Anonymous
Not applicable

@PaulDBrown 

 

Thanks! I'll look into the link you sent and try it out.

@Anonymous 

Good luck! (btw, you still need the credentials to get into the dataset- the solution in the thread only solves the problem of getting access to the dataset going through the login requirements; it does not provide a back-entry avoiding login...)

 

EDIT: I just did a search for a solution using Python and came across this:

 

Scraping data from web which requires login using Python 





Did I answer your question? Mark my post as a solution!
In doing so, you are also helping me. Thank you!

Proud to be a Super User!
Paul on Linkedin.






Helpful resources

Announcements
Join Arun Ulag at MPPC23

Join Arun Ulag at MPPC23

Get a sneak peek into this year's Power Platform Conference Keynote.

PBI Sept Update Carousel

Power BI September 2023 Update

Take a look at the September 2023 Power BI update to learn more.

Learn Live

Learn Live: Event Series

Join Microsoft Reactor and learn from developers.

Dashboard in a day with date

Exclusive opportunity for Women!

Join us for a free, hands-on Microsoft workshop led by women trainers for women where you will learn how to build a Dashboard in a Day!

Top Solution Authors