Forum Discussion

ABR002's avatar
ABR002
Helper I
2 years ago
Solved

Binary error when trying to link zip file on web

Trying to import the CVE zip file into power query (https://github.com/CVEProject/cvelistV5/archive/refs/heads/main.zip)

 

I’ve tried various solutions found on this board, such as:

Unzip and load csv from web - error "we didn't rec... - Microsoft Fabric Community
Solved: Re: How to connect Azure DevOps REST API in to pow... - Microsoft Fabric Community

I keep getting a binary error. Either it can’t convert to binary or:

DataFormat.Error: There was a problem reading the binary format at position 405777492.  The end of the input was reached before the value could be read.

 

What am I doing wrong?

  • That ZIP file is (way, way) too big for the solutions you have tried.  Anything over 2 GiB will not read reliably. Your content is over 4GiB and has gazillions of files and folders. The solutions mostly expect single file payloads.

     

    Download and extract the ZIP manually and then use the Folder connector to ingest the CVEs.

     

     

    let
        Source = Folder.Files("C:\Users\xxx\Downloads\cves"),
        #"Removed Other Columns" = Table.SelectColumns(Source,{"Content", "Name"}),
        #"Added Custom" = Table.AddColumn(#"Removed Other Columns", "Title", each Json.Document([Content],1252)[containers][cna][descriptions]{0}[value])
    in
        #"Added Custom"

1 Reply

  • That ZIP file is (way, way) too big for the solutions you have tried.  Anything over 2 GiB will not read reliably. Your content is over 4GiB and has gazillions of files and folders. The solutions mostly expect single file payloads.

     

    Download and extract the ZIP manually and then use the Folder connector to ingest the CVEs.

     

     

    let
        Source = Folder.Files("C:\Users\xxx\Downloads\cves"),
        #"Removed Other Columns" = Table.SelectColumns(Source,{"Content", "Name"}),
        #"Added Custom" = Table.AddColumn(#"Removed Other Columns", "Title", each Json.Document([Content],1252)[containers][cna][descriptions]{0}[value])
    in
        #"Added Custom"