Source page keeps getting small changes

[Missippy]

I run power queries every morning where I download a lot of data from a webpage. The source keeps making these small changes, like adding a column to the page I am trying to download. When they do, my query won't run any longer. They did this about 4 weeks ago and I just got all the queries up and running again. Now they have added 1 more column. Is there anything I can do to avoid the total rebuild?

[v-pgoloju]

Hi @Missippy,

Thank you for reaching out to the Microsoft Fabric Forum Community.

Can please try below M code to adopt to any changes

let
Source = Web.Page(Web.Contents("https://www.baseball-reference.com/teams/tgl.cgi?team=NYY&t=p&year=2025")),
AllTables = Source[Data],

// Convert all columns in all tables to text
ProcessedTables = List.Transform(
AllTables,
each Table.TransformColumnTypes( _,List.Transform(Table.ColumnNames(_), each {_, type text}))),

// Optional: Combine into one big table (if structures are the same)
CombinedTable = Table.Combine(ProcessedTables)
in
CombinedTable

Kind regards,
Prasanna Kumar

[ralf_anton]

Hallo @Missippy ,

Eine pauschale Aussage hierzu ist leider nicht möglich, da Websites die Daten auf unterschiedlichen Wegen zur Verfügung stellen können. Um Ihre Frage konkreter beantworten zu können, wäre es hilfreich, die Website zu kennen.

Über den M-Code:

M ist die Abfragesprache für PQ. Bei Queries, die ausschließlich über das Menü angelegt werden, wird sie automatisch generiert. Sie können es jedoch im Editor-Menü Start --> Erweiterter Editor anzeigen und bearbeiten.

[Missippy]

Thank you for your response. here is a link to one of the pages I am trying to download. Which I can do easily but the owners of the site keep making very small changes, like add a new column or whatever, which makes my query not recognize it so it doesnt run. https://www.baseball-reference.com/teams/tgl.cgi?team=NYY&t=p&year=2025. I didnt know if I could tell it to ignore changes and get the data I am looking for.

[v-pgoloju]

Hi @Missippy,

Thank you for reaching out to the Microsoft Fabric Forum Community.

Thanks for sharing the details. Since you're not using M code directly and are building the query through the UI, it might help to take a closer look at the actual query steps. If possible, could you please share a sample PBIX file (with either non-sensitive data or sample data) so we can better understand and assist you with the issue? or Please share the screenshot of advanced editor M code.

Home tab → Transform Data → In Power Query, select your query → Home tab → Advanced Editor.

Kind regards,
Prasanna Kumar

[Missippy]

I will post a picture of the query editor when I can get home tyo my computer. none of this is sensative. Its just sports data that I download and then run some formulas with. I posted a link to one of the pages I am trying to download. I just download the entire table but I actually only need about 10 of the columns. Thanks for all the help

[v-pgoloju]

Hi @Missippy,

Thanks for reaching out to the Microsoft Fabric Forum Community.

If you want to ignore newly added columns and only keep specific ones, you can use the following M code.

Table.SelectColumns(Source, {"Col1", "Col2"}, MissingField.Ignore)

This helps avoid errors when the source adds new columns unexpectedly.

However, if you want to load the entire table dynamically, including all columns, you can get the list of all columns using.

AllColumns = Table.ColumnNames(Source)

If the issue still persists, please share the M code you’re using so we can take a closer look and help you resolve it.

Thanks & regards,
Prasanna Kumar

[Missippy]

Thank you for responding. Unfortunately I don't know what m-code is. When building a query, I just select data, from web, paste the link to the web page, choose columns and such, add to page. That's it.