Forum Discussion

Missippy's avatar
Missippy
Helper I
1 year ago
Solved

Source page keeps getting small changes

I run power queries every morning where I download a lot of data from a webpage. The source keeps making these small changes, like adding a column to the page I am trying to download. When they do, m...
Need Help
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Missippy,

     

    Thank you for reaching out to the Microsoft Fabric Forum Community.

     

    Can please try below M code to adopt to any changes

    let
    Source = Web.Page(Web.Contents("https://www.baseball-reference.com/teams/tgl.cgi?team=NYY&t=p&year=2025")),
    AllTables = Source[Data],

    // Convert all columns in all tables to text
    ProcessedTables = List.Transform(
    AllTables,
    each Table.TransformColumnTypes( _,List.Transform(Table.ColumnNames(_), each {_, type text}))),

    // Optional: Combine into one big table (if structures are the same)
    CombinedTable = Table.Combine(ProcessedTables)
    in
    CombinedTable

     


    Kind regards,
    Prasanna Kumar

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi Missippy,

 

Thank you for reaching out to the Microsoft Fabric Forum Community.

 

Thanks for sharing the details. Since you're not using M code directly and are building the query through the UI, it might help to take a closer look at the actual query steps. If possible, could you please share a sample PBIX file (with either non-sensitive data or sample data) so we can better understand and assist you with the issue? or Please share the screenshot of advanced editor M code.

 

Home tab → Transform Data → In Power Query, select your query → Home tab → Advanced Editor.

 

Kind regards,
Prasanna Kumar

  • Missippy's avatar
    Missippy
    Helper I
    1 year ago

    I will post a picture of the query editor when I can get home tyo my computer. none of this is sensative. Its just sports data that I download and then run some formulas with. I posted a link to one of the pages I am trying to download. I just download the entire table but I actually only need about 10 of the columns. Thanks for all the help