Forum Discussion
Unzipping very large files
Hi all, I've using the Unzip functions from artemis and @lbendlin and this has been ok for files smaller than 4 GB. https://community.fabric.microsoft.com/t5/Community-Blog/Working-With-Zip-Fi...
Thanks lbendlin, I've not used streaming before and is a new challenge.
Any pointers from anyone who has had this challenge welcomed. I only need to crunch the metadata from the massive CSV's in the ZIP files, so streaming it in and being able to run a Table.Profile at the minimum is my goal.
If you only need the meta data then you can check where in your ZIP files the directory is (beginning or end) and then read only that part. My article explains where to look and how to do it.