Scraping data from web to make PowerBI reports

[Anonymous]

I get data from a URL Link to my PBI reports
For me to get the data, I first need to make a selection on filters (Date range- Make it YTD and a specific set of customers)
I then copy and paste the URL link to PowerBI to get the data

I am sure this is not the best method to access data coming from a web source. I want to see if there is a way to get live/dynamic data from the web link ?? Can someone help??

[v-yanjiang-msft]

Hi @Anonymous ,

There are a few ways to get live/dynamic data from a web link in Power BI.

One way is to use the "Web" connector in Power BI to directly connect to the web page that contains the data you need. From there, you can use Power BI's query editor to filter and transform the data as needed.

Another way is to use an API if one is available for the data source. APIs provide a more structured way to access data and can often provide real-time or near real-time updates. You can use Power BI's "Web" connector to connect to an API endpoint and retrieve the data.

If neither of these options are available, you may need to consider using a third-party tool or service to extract the data from the web page and make it available in a format that Power BI can consume.

Best regards,

Community Support Team_yanjiang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Anonymous]

Hi, thank you for your response. 

Yes via the web connector, I can connect to the link. But with every month data needs to be updated, for example- The date will need to change on the data source filter to get the latest data. Do you think it is possible to get the latest data here without an API

[v-yanjiang-msft]

Hi @Anonymous ,

According to your description, you want to firstly filter the latest data in data source then load into Power BI. Why not load the whole data in Power BI then filter it in Power Query. If you need help in transforming data in Power Query, I can help you.

Best regards,

Community Support Team_yanjiang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.