[DataSource.Error] We timed out waiting for the we...

Anonymous · ‎01-10-2024

I make a WebScrapping in powerbi, and in de PowerQuery this work normally, but when i click in saved and closed and import to desktop for a create my visuals, i recived the mensage [DataSource.Error] We timed out waiting for the web page to load.. '.[DataSource.Error] We timed out,

the query is

let
    listaGerada = List.Generate(
    () => [x = 1, y = {}],
    each [x] <= 4455,
    each [x = [x] + 5, y = [y] & {[x]}], 
    each [x] 
),
    #"Converted to Table" = Table.FromList(listaGerada, Splitter.SplitByNothing(), null, "Eventos", ExtraValues.Error),
    #"Renamed Columns" = Table.RenameColumns(#"Converted to Table",{{"Column1", "Eventos"}}),
    #"Added Index" = Table.AddIndexColumn(#"Renamed Columns", "Index", 1, 1, Int64.Type),
    #"Merged Queries" = Table.NestedJoin(#"Added Index", {"Index"}, #"Pages (2)", {"Index"}, "Pages (2)", JoinKind.LeftOuter),
    #"Expanded Pages (2)" = Table.ExpandTableColumn(#"Merged Queries", "Pages (2)", {"Column1"}, {"Column1"}),
    #"Renamed Columns1" = Table.RenameColumns(#"Expanded Pages (2)",{{"Index", "Page_Fact"}, {"Column1", "Pages_Attribute"}}),
    #"Changed Type" = Table.TransformColumnTypes(#"Renamed Columns1",{{"Eventos", type text}, {"Page_Fact", type text}, {"Pages_Attribute", type text}}),
    #"Added Custom" = Table.AddColumn(#"Changed Type", "Custom", each "http://ba.portaldatransparencia.com.br/prefeitura/madrededeus/?pagina=dop&frompage="&[Pages_Attribute]&"&StartRow="&[Eventos]),
    #"Invoked Custom Function" = Table.AddColumn(#"Added Custom", "Custom.1", each Fuction([Custom])),
    #"Expanded Custom.1" = Table.ExpandTableColumn(#"Invoked Custom Function", "Custom.1", {"Column1", "Column2", "Column3", "Column4", "Column5", "Column6", "Column7", "Column8", "Column9"}, {"Column1", "Column2", "Column3", "Column4", "Column5", "Column6", "Column7", "Column8", "Column9"}),
    #"Removed Columns" = Table.RemoveColumns(#"Expanded Custom.1",{"Custom", "Pages_Attribute", "Page_Fact", "Eventos"}),
    #"Renamed Columns2" = Table.RenameColumns(#"Removed Columns",{{"Column1", "Caderno"}, {"Column2", "Data"}, {"Column4", "Codigo"}, {"Column5", "Descrição"}, {"Column6", "Tamanho Documentaçção"}}),
    #"Removed Columns1" = Table.RemoveColumns(#"Renamed Columns2",{"Column9", "Column3", "Column7", "Column8"}),
    #"Changed Type1" = Table.TransformColumnTypes(#"Removed Columns1",{{"Caderno", type text}, {"Data", type date}, {"Codigo", type text}, {"Descrição", type text}, {"Tamanho Documentaçção", type text}})
in
    #"Changed Type1"

how can I solve my problem?

v-weiyan1-msft · ‎01-11-2024

Hi @Anonymous ,

Based on your description, if possible, try connecting to another network to see if the problem persists. Sometimes, network-related issues can cause a timeout.
You can also check if the webpage you are connecting to allows Web scraping.
The post linked below is related to this cause, you can refer to it.

Web Scrape: Worked before but now timing out... - Microsoft Fabric Community

I also found a similar post, please refer to it and see if it helps you.

Solved: "We timed out waiting for the web page to load" fr... - Microsoft Fabric Community

Best Regards,
Yulia Yan

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.