Forum Discussion

Missippy's avatar
Missippy
Helper I
1 year ago
Solved

Source page keeps getting small changes

I run power queries every morning where I download a lot of data from a webpage. The source keeps making these small changes, like adding a column to the page I am trying to download. When they do, m...
Need Help
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Missippy,

     

    Thank you for reaching out to the Microsoft Fabric Forum Community.

     

    Can please try below M code to adopt to any changes

    let
    Source = Web.Page(Web.Contents("https://www.baseball-reference.com/teams/tgl.cgi?team=NYY&t=p&year=2025")),
    AllTables = Source[Data],

    // Convert all columns in all tables to text
    ProcessedTables = List.Transform(
    AllTables,
    each Table.TransformColumnTypes( _,List.Transform(Table.ColumnNames(_), each {_, type text}))),

    // Optional: Combine into one big table (if structures are the same)
    CombinedTable = Table.Combine(ProcessedTables)
    in
    CombinedTable

     


    Kind regards,
    Prasanna Kumar

ralf_anton's avatar
ralf_anton
Resolver I
1 year ago

Hallo Missippy ,

Eine pauschale Aussage hierzu ist leider nicht möglich, da Websites die Daten auf unterschiedlichen Wegen zur Verfügung stellen können. Um Ihre Frage konkreter beantworten zu können, wäre es hilfreich, die Website zu kennen.

Über den M-Code:

M ist die Abfragesprache für PQ. Bei Queries, die ausschließlich über das Menü angelegt werden, wird sie automatisch generiert. Sie können es jedoch im Editor-Menü Start --> Erweiterter Editor anzeigen und bearbeiten.

Missippy's avatar
Missippy
Helper I
1 year ago

Thank you for your response. here is a link to one of the pages I am trying to download. Which I can do easily but the owners of the site keep making very small changes, like add a new column or whatever, which makes my query not recognize it so it doesnt run. https://www.baseball-reference.com/teams/tgl.cgi?team=NYY&t=p&year=2025. I didnt know if I could tell it to ignore changes and get the data I am looking for.