Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join us at FabCon Vienna from September 15-18, 2025, for the ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM. Get registered

Reply
Velegandla
New Member

Flattening nested JSON values in a dataflow with varying keys.

We are using Azrue DevOps REST API calls to return JSON files and storing them in blob. Then we perform a dataflow to transform the data. The issue is a portion of the JSON being stored in blob has varying keys.

 

When we specify the columns to map in a Select action, we are selecting specifically one of the varying keys from a list of options. But need to map ALL of these – we cannot manually specify these because the data source is so large.

 

We cannot implement a standard name for this section of the JSON. A wildcard for { } would work ideally but is not supported. We do not care what the keys are, just the contents (id, name).
 
Select Action:
Source Column:
resources.pipelines.{src-release}.pipeline.id
resources.pipelines.{src-release}.pipeline.name

resources.pipelines.{build }.pipeline.id

resources.pipelines.{build }.pipeline.name

 

Mapping Name as:
‘pipelineID’

‘pipelineName’


Below is a JSON snippet which highlights the key from the source JSON

Velegandla_0-1717641241214.png

 

Example of Select action mapping – each key shows as its own dropdown:

 

Velegandla_1-1717641241217.png

 

 

Picture1.png

 

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @Velegandla 

Apologies for the inconvenience, this community is specifically for discussions and questions related to Microsoft Fabric. For queries related to Azure Data Factory, we recommend using the dedicated Microsoft Q&A forum where they are ready to assist you better. Here's the link to post your query in Microsoft Q&A : Ask a question - Microsoft Q&A.

 

Thanks.

View solution in original post

3 REPLIES 3
Anonymous
Not applicable

Hi @Velegandla 
Thanks for using Fabric Community.
Can you please confirm if you are trying the above scenario with ADF dataflow or Fabric Dataflows?
thanks

@Anonymous 

 

ADF dataflow

Anonymous
Not applicable

Hi @Velegandla 

Apologies for the inconvenience, this community is specifically for discussions and questions related to Microsoft Fabric. For queries related to Azure Data Factory, we recommend using the dedicated Microsoft Q&A forum where they are ready to assist you better. Here's the link to post your query in Microsoft Q&A : Ask a question - Microsoft Q&A.

 

Thanks.

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

May FBC25 Carousel

Fabric Monthly Update - May 2025

Check out the May 2025 Fabric update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.