Forum Discussion
Help with JSON import from NIST
Hi anf1sher,
Here are some similar examples for your reference:
Call web API, receive ZIP, decompress multiple JSON files, Load Them
import gzip csv from web to power bi.md
Regards,
Yuliana Gu
Either I didn't understand what they were trying say or it didn't help my problem.
- squiddly8 years agoAdvocate I
Hi anf1sher,
I've gone down this road -- it's a LOT of data for Power BI to chew through. The following code will download the JSON in its .GZ format, unzip it, and parse it. If you're going to be doing this for all of the CVE data (2002-2018) then you might want to make a PowerShell script to download those files and extract them to a local folder, then point Power BI to the folder contents. If that's something you want to do, let me know and I'll share the script I wrote.
let NvdUrl = "https://static.nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2018.json.gz", Source = Json.Document(Binary.Decompress(Web.Contents(NvdUrl),Compression.GZip)), #"Converted to Table" = Record.ToTable(Source), Value = #"Converted to Table"{5}[Value], #"Converted to Table1" = Table.FromList(Value, Splitter.SplitByNothing(), null, null, ExtraValues.Error), #"Expanded Column1" = Table.ExpandRecordColumn(#"Converted to Table1", "Column1", {"cve", "configurations", "impact", "publishedDate", "lastModifiedDate"}, {"Column1.cve", "Column1.configurations", "Column1.impact", "Column1.publishedDate", "Column1.lastModifiedDate"}) in #"Expanded Column1"You could also create a function to loop through and get 2002 thru 2018 but I don't know enough about that to be of help.
- Bennos827 years agoNew Member
Hi Squiddly,
Im trying to download and extract all the CVE data from NIST (2002-2019) but am not having much luck.
You mentioned you may be able to share your script - If you could it would solve a massive headache for me.
Many thanks in advance
Ben
- diederd5 years agoHelper II
Afternoon squiddly
Would your PS script still be available for review? I'm looking to implement a similar solution; however as you have already eluded to there is a lot of data for PBI to import and as such am looking for an alternate solution.
Thank you in advance.
Denver
- Amy3331 year agoFrequent Visitor
squiddly,
Does your script still work? Or have you modernized it for use with the API. I just need a simple script to download a few CVEs NVDs for a subset of products and keep an eye on them.
Never did this before not sure how to start, so I just need an example.
Thanks in advance.