Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago
Solved

Custom function to decompress .gz file not loading all rows

Hi all,

 

I created a custom function to decompress a .gz file. The custom function is based on this query, which loads 10.902.214 rows:

let
    Source = Binary.Decompress(Web.Contents("https://ec.europa.eu/eurostat/estat-navtree-portlet-prod/BulkDownloadListing?file=data/nama_10_a64.tsv.gz"),Compression.GZip),
    #"Imported CSV" = Csv.Document(Source,[Delimiter="#(tab)",Encoding=65001])
in
    #"Imported CSV"

However, if I create the custom function (see code below) with GZIPFILE = the url from the first code sample, it only loads 231.963 rows. What is happening here, does anyone know? Is there a limitation to the number of rows a custom function can handle? Or am I doing something wrong?

(GZIPFILE) => 
let
    Source = Binary.Decompress(Web.Contents(GZIPFILE),Compression.GZip),
    #"Imported CSV" = Csv.Document(Source,[Delimiter="#(tab)",Encoding=65001]) 
in
    #"Imported CSV"

 

  • Anonymous's avatar
    Anonymous
    4 years ago

    Hi Anonymous - I am not sure how you got 10,902,214 rows in the first place.  The file only has 231.962 row and 1 heading row = 231.963.  

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Anonymous - I am not sure how you got 10,902,214 rows in the first place.  The file only has 231.962 row and 1 heading row = 231.963.  

  • Anonymous's avatar
    Anonymous
    Not applicable

    Thanks Anonymous my bad, I was comparing to another query which was unpivoted (not shown in the example above)... so yes then you can get many more rows ğŸ˜‚