Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started
I found following code:
let Source = Web.Page(Web.Contents("https://www.baseball-reference.com/play-index/batter_vs_pitcher.cgi?batter=arenano01")), Data1 = Source{1}[Data], #"Changed Type" = Table.TransformColumnTypes(Data1,{{"Name", type text}, {"PA", Int64.Type}, {"AB", Int64.Type}, {"H", Int64.Type}, {"2B", Int64.Type}, {"3B", Int64.Type}, {"HR", Int64.Type}, {"RBI", Int64.Type}, {"BB", Int64.Type}, {"SO", Int64.Type}, {"BA", type number}, {"OBP", type number}, {"SLG", type number}, {"OPS", type number}, {"SH", Int64.Type}, {"SF", Int64.Type}, {"IBB", Int64.Type}, {"HBP", Int64.Type}, {"GDP", Int64.Type}, {"missG", type text}}) in #"Changed Type"
Suppose I have around 10 to 20 webpages that are exactly the same in structure, but they contain different data. Is there a way to retrieve this data using a single query and combine the results instead of running 20 separate queries for each webpage?
Can Power BI handle this task, or do I need to rely on my VBA skills to import all the data into Excel?
Solved! Go to Solution.
Hi, @Johns23 all you need is a list of URLs. Then List.Transform and Table.Combine. Smth like this:
let
url_list = {"url01", "url02", "url03"},
combined_results = Table.Combine(List.Transform(url_list, each Web.Page(Web.Contents(_))){1}[Data])
in combined_results
you may create a table with links in Excel => get data from table to have the table in PQ and refer to table column to get a list. Or you may simply make the same transformation to your table (instead of list) but using Table.TransformColumns function. I hope you get the idea.
Hi, @Johns23 all you need is a list of URLs. Then List.Transform and Table.Combine. Smth like this:
let
url_list = {"url01", "url02", "url03"},
combined_results = Table.Combine(List.Transform(url_list, each Web.Page(Web.Contents(_))){1}[Data])
in combined_results
you may create a table with links in Excel => get data from table to have the table in PQ and refer to table column to get a list. Or you may simply make the same transformation to your table (instead of list) but using Table.TransformColumns function. I hope you get the idea.
Check out the September 2024 Power BI update to learn about new features.
Learn from experts, get hands-on experience, and win awesome prizes.
User | Count |
---|---|
73 | |
64 | |
42 | |
28 | |
20 |