Forum Discussion
Custom function to decompress .gz file not loading all rows
Hi all,
I created a custom function to decompress a .gz file. The custom function is based on this query, which loads 10.902.214 rows:
let
Source = Binary.Decompress(Web.Contents("https://ec.europa.eu/eurostat/estat-navtree-portlet-prod/BulkDownloadListing?file=data/nama_10_a64.tsv.gz"),Compression.GZip),
#"Imported CSV" = Csv.Document(Source,[Delimiter="#(tab)",Encoding=65001])
in
#"Imported CSV"However, if I create the custom function (see code below) with GZIPFILE = the url from the first code sample, it only loads 231.963 rows. What is happening here, does anyone know? Is there a limitation to the number of rows a custom function can handle? Or am I doing something wrong?
(GZIPFILE) =>
let
Source = Binary.Decompress(Web.Contents(GZIPFILE),Compression.GZip),
#"Imported CSV" = Csv.Document(Source,[Delimiter="#(tab)",Encoding=65001])
in
#"Imported CSV"
- Anonymous4 years ago
Hi Anonymous - I am not sure how you got 10,902,214 rows in the first place. The file only has 231.962 row and 1 heading row = 231.963.
2 Replies
- AnonymousNot applicable
Hi Anonymous - I am not sure how you got 10,902,214 rows in the first place. The file only has 231.962 row and 1 heading row = 231.963.
- AnonymousNot applicable
Thanks Anonymous my bad, I was comparing to another query which was unpivoted (not shown in the example above)... so yes then you can get many more rows 😂