Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago
Solved

Real time data from web page with .zip files

I am trying to create a real time report from the following website. 

The website updates data every hour by generating a new .zip file at the bottom of the list.

The difficulty is twofold:

  1. the .csv data is zipped;
  2. the name of the desired file changes every hour, which means that, while the base url remains uchanged, the full url changes periodocally;

 

zip files

 

I think the solution is to, within Transform Data, parse the text to match the web view and then select the last row.

But I don't know how to do that or if that's the right way.

Can someone please help?

Dataflow
Need Help
Tips and Tricks

3 Replies

  • v-luwang-msft's avatar
    v-luwang-msft
    Icon for Community Support rankCommunity Support
    4 years ago

    Hi Anonymous ，

    Test  M code as below:

    let
Source = Web.Contents("http://res1104.se.gob.ar/adjuntos/precios_eess_2013_en_adelante.zip",[Headers=[#"Accept-Encoding"="gzip"]]),
Decompress = Binary.Decompress(Source, Compression.GZip)
in
Decompress

     

    To learn more details ,refer:

     

    Did I answer your question? Mark my post as a solution!


    Best Regards

    Lucien

    • Anonymous's avatar
      Anonymous
      Not applicable
      4 years ago

      Hello, Lucien

      Thanks for the reply.

      The problem with the solution provided is that the file path changes periodically whilst the code from your solution treats the file path as fixed. 

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    I solved this problem with python.

    Please check this reply. 

    Cheers