Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
olimilo
Responsive Resident
Responsive Resident

Streaming Dataset from a JSON API

Hi everyone,

So we are pulling data from a websource using a JSON API. However, the data that we get from the JSON API is not laid out in a flat file-like structure but has columns that look like the one below:

 

data
{List}
1/1/2020

Passed

 

So basically, I have to transform the data first to get it to something more usable. My question is, the PBI streaming dataset looks like it requires to have your file in a flat file-like structure. Since my data isn't flat file-like in the first place, how can I achieve a streaming dataset with my data?

3 REPLIES 3
amitchandak
Super User
Super User
Greg_Deckler
Super User
Super User

@olimilo - Use Azure Streaming Analytics to transform your data prior to getting to Power BI.


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Hi @Greg_Deckler @amitchandak 

I tried refreshing the data using the dataset tab in the PBI service and got this error: Query contains unsupported function. Function name: Web.Contents.

 

Which is funny because when I refreshed the data in PBI desktop, the refresh went without a hitch. Will this have any bearing on us trying to achieve a realtime connection to our data? This is the connector that I used:

 

 

 

= Json.Document(Web.Contents(JSONSourceURL, [Timeout=#duration(0, 0, 30, 0), Headers=[#"User-Agent"="Power BI", Accept="application/jsonapi", #"Content-Type"="application/json", Authorization="..."]]))

 

 

Edit: I saw on the reference page below that JSON data sources does not support DirectQuery/Live connection - does that mean that we're out of options in this case? Or is it not possible for us to schedule data refreshes?

 

https://docs.microsoft.com/en-us/power-bi/connect-data/power-bi-data-sources

 

Helpful resources

Announcements
LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors