7 Comments

  • yoshihiro's avatar
    yoshihiro
    New Member
    6 years ago
    A lot of zip files are published by Government's web site in Japan. These zip files include Excel files, CSV files. Some zip files have folders in it. I want to use Excel/CSV files as Power BI' "Web" data source, to no-download/no-expand/updatable these files.
  • stefan_quinn2's avatar
    stefan_quinn2
    New Member
    6 years ago
    Create a function using the code here http://sql10.blogspot.com.au/2016/06/reading-zip-files-in-powerquery-m.html Then to iterate over the files on the web page, do something like let GetCSVContents = (data) as table => let files= unzipFile(data[Content]), csv=Csv.Document(files[Content],[Delimiter=",", Columns=10, Encoding=1252, QuoteStyle=QuoteStyle.None]) in csv, f=unzipFile(Web.Contents("http://blah.com")), combine=Table.AddColumn(f,"Contents",each GetCSVContents(_)) in combine
  • fbcideas_migusr's avatar
    fbcideas_migusr
    New Member
    6 years ago
    Not just locally, but an online one as well to allow for automatic refreshing (like the web connector does with a table in a website).
  • fbcideas_migusr's avatar
    fbcideas_migusr
    New Member
    2 years ago

    Agreed.


    It would be nice to have native tools for unzipping files that contain multiple data files into a DataLake for further ETL processing with pipelines. This would allow users to download, unzip, process (ETL) and consume data using an automated end-to-end process.


    Thanks

Recent ideas