Forum Discussion
Loading data from dynamic URLs
Good afternoon
I have 5 URLs (webservices) where in the URL, ONLY the ID (1, 3, 5, 7, 10) and the year changes. The tables of the 5 URLs that contain the data are exactly the same, only the id and the year change in the address.
Example:
http://11.12.13.14:5000/api/arbol/1/arbol_process/?year=2021
http://11.12.13.14:5000/api/arbol/2/arbol_process/?year=2022
In this case, you have changed the 1 for the 2 and the year 2021 for 2022
Is it possible to load the data of those 5 web addresses (webservices) in one go from "Get data" / "Web" and therefore, since the 5 URLs have the same structure, that in PowerBi a single tree appears with their respective columns in the hierarchy?
Thanks a lot
4 Replies
Get the Data from all the sources then combine the data in one query
Thank you for your reply.
Does it refer to the Power Query Editor button \ "Merge Queries" or "Append Queries" ???
I understand that it refers to loading 5 times data from the 5 different URLs
http://11.12.13.14:5000/api/arbol/1/arbol_process/?year=2021
http://11.12.13.14:5000/api/arbol/2/arbol_process/?year=2021
http://11.12.13.14:5000/api/arbol/3/arbol_process/?year=2021
http://11.12.13.14:5000/api/arbol/4/arbol_process/?year=2021
http://11.12.13.14:5000/api/arbol/5/arbol_process/?year=2021
And then?
- Clean all data from the 5 tables?
- Consolidate the resulting table with a single query?
Thanks a lot
Hi Syndicate_Admin ,
You can use PowerBI Desktop to batch collect data from multiple web pages from the following blog.
Note: If the list of original column names contains names that do not exist in the table, an error will be reported.
https://community.powerbi.com/t5/Community-Blog/Batch-crawling-web-page-data/ba-p/1715990
Best Regards,
Liu Yang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
What happens if you have more than 100 dynamic URLs? and whether these can change over time.
