Loading data from dynamic URLs

[Syndicate_Admin]

Good afternoon

I have 5 URLs (webservices) where in the URL, ONLY the ID (1, 3, 5, 7, 10) and the year changes. The tables of the 5 URLs that contain the data are exactly the same, only the id and the year change in the address.

Example:

http://11.12.13.14:5000/api/arbol/1/arbol_process/?year=2021

http://11.12.13.14:5000/api/arbol/2/arbol_process/?year=2022

In this case, you have changed the 1 for the 2 and the year 2021 for 2022

Is it possible to load the data of those 5 web addresses (webservices) in one go from "Get data" / "Web" and therefore, since the 5 URLs have the same structure, that in PowerBi a single tree appears with their respective columns in the hierarchy?

Thanks a lot

[Syndicate_Admin]

What happens if you have more than 100 dynamic URLs? and whether these can change over time.

[Anonymous]

Hi  @Syndicate_Admin ,

You can use PowerBI Desktop to batch collect data from multiple web pages from the following blog.

Note: If the list of original column names contains names that do not exist in the table, an error will be reported.

https://community.powerbi.com/t5/Community-Blog/Batch-crawling-web-page-data/ba-p/1715990

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[mh2587]

Get the Data from all the sources then combine the data in one query 

[Syndicate_Admin]

Thank you for your reply.

Does it refer to the Power Query Editor button \ "Merge Queries" or "Append Queries" ???

I understand that it refers to loading 5 times data from the 5 different URLs

http://11.12.13.14:5000/api/arbol/1/arbol_process/?year=2021

http://11.12.13.14:5000/api/arbol/2/arbol_process/?year=2021

http://11.12.13.14:5000/api/arbol/3/arbol_process/?year=2021

http://11.12.13.14:5000/api/arbol/4/arbol_process/?year=2021

http://11.12.13.14:5000/api/arbol/5/arbol_process/?year=2021

And then?

- Clean all data from the 5 tables?

- Consolidate the resulting table with a single query?

Thanks a lot