Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
vojtechsima
Resident Rockstar
Resident Rockstar

Web scrape info from this Community Notification Feed page to Power BI

Hello,

I am trying to do some statistics about my notification panel in this community:
https://community.fabric.microsoft.com/t5/notificationfeed/page

 

I was wondering if there's a way how to access it.

 

I thought about scraping the page on a regular basis through Power BI (naturally); however, I am not sure how to apply the authentication. Do you have any advice or a different approach?

 

Thank you

1 ACCEPTED SOLUTION
v-mengmli-msft
Community Support
Community Support

Hi @vojtechsima ,

 

You can try writing a crawler in Python that will crawl pages of website that require authentication by simulating login. If the website uses a more sophisticated authentication mechanism, such as multi-factor authentication, you may need to use a browser automation tool, such as Selenium, to handle the login process. After you save the captured data as a CSV file, you can import it into PowerBI for analysis.

 

The above requires knowledge of different fields, and I suggest you contact the relevant professionals.

 

 

Best regards,

Mengmeng Li

View solution in original post

3 REPLIES 3
v-mengmli-msft
Community Support
Community Support

Hi @vojtechsima ,

 

You can try writing a crawler in Python that will crawl pages of website that require authentication by simulating login. If the website uses a more sophisticated authentication mechanism, such as multi-factor authentication, you may need to use a browser automation tool, such as Selenium, to handle the login process. After you save the captured data as a CSV file, you can import it into PowerBI for analysis.

 

The above requires knowledge of different fields, and I suggest you contact the relevant professionals.

 

 

Best regards,

Mengmeng Li

VahidDM
Super User
Super User

Hi @vojtechsima 

 

Most of the data you seek is available on the Profile page. What exactly are you looking? 

 

If this post helps, please consider accepting it as the solution to help the other members find it more quickly.

Appreciate your Kudos!! 

LinkedIn|Twitter|Blog |YouTube 

@VahidDM 
I'd like to historize it for my own personal challenge, so I can see in what months or weeks I was most active etc. But naturally, the date is there, however, I don't wanna manually write it down.

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.