Microsoft is giving away 50,000 FREE Microsoft Certification exam vouchers!
Enter the sweepstakes now!See when key Fabric features will launch and what’s already live, all in one place and always up to date. Explore the new Fabric roadmap
I found following code:
let Source = Web.Page(Web.Contents("https://www.baseball-reference.com/play-index/batter_vs_pitcher.cgi?batter=arenano01")), Data1 = Source{1}[Data], #"Changed Type" = Table.TransformColumnTypes(Data1,{{"Name", type text}, {"PA", Int64.Type}, {"AB", Int64.Type}, {"H", Int64.Type}, {"2B", Int64.Type}, {"3B", Int64.Type}, {"HR", Int64.Type}, {"RBI", Int64.Type}, {"BB", Int64.Type}, {"SO", Int64.Type}, {"BA", type number}, {"OBP", type number}, {"SLG", type number}, {"OPS", type number}, {"SH", Int64.Type}, {"SF", Int64.Type}, {"IBB", Int64.Type}, {"HBP", Int64.Type}, {"GDP", Int64.Type}, {"missG", type text}}) in #"Changed Type"
Suppose I have around 10 to 20 webpages that are exactly the same in structure, but they contain different data. Is there a way to retrieve this data using a single query and combine the results instead of running 20 separate queries for each webpage?
Can Power BI handle this task, or do I need to rely on my VBA skills to import all the data into Excel?
Solved! Go to Solution.
Hi, @Johns23 all you need is a list of URLs. Then List.Transform and Table.Combine. Smth like this:
let
url_list = {"url01", "url02", "url03"},
combined_results = Table.Combine(List.Transform(url_list, each Web.Page(Web.Contents(_))){1}[Data])
in combined_results
you may create a table with links in Excel => get data from table to have the table in PQ and refer to table column to get a list. Or you may simply make the same transformation to your table (instead of list) but using Table.TransformColumns function. I hope you get the idea.
Hi, @Johns23 all you need is a list of URLs. Then List.Transform and Table.Combine. Smth like this:
let
url_list = {"url01", "url02", "url03"},
combined_results = Table.Combine(List.Transform(url_list, each Web.Page(Web.Contents(_))){1}[Data])
in combined_results
you may create a table with links in Excel => get data from table to have the table in PQ and refer to table column to get a list. Or you may simply make the same transformation to your table (instead of list) but using Table.TransformColumns function. I hope you get the idea.