Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
Velegandla
New Member

Flattening nested JSON values in a dataflow with varying keys.

We are using Azrue DevOps REST API calls to return JSON files and storing them in blob. Then we perform a dataflow to transform the data. The issue is a portion of the JSON being stored in blob has varying keys.

 

When we specify the columns to map in a Select action, we are selecting specifically one of the varying keys from a list of options. But need to map ALL of these – we cannot manually specify these because the data source is so large.

 

We cannot implement a standard name for this section of the JSON. A wildcard for { } would work ideally but is not supported. We do not care what the keys are, just the contents (id, name).
 
Select Action:
Source Column:
resources.pipelines.{src-release}.pipeline.id
resources.pipelines.{src-release}.pipeline.name

resources.pipelines.{build }.pipeline.id

resources.pipelines.{build }.pipeline.name

 

Mapping Name as:
‘pipelineID’

‘pipelineName’


Below is a JSON snippet which highlights the key from the source JSON

Velegandla_0-1717641241214.png

 

Example of Select action mapping – each key shows as its own dropdown:

 

Velegandla_1-1717641241217.png

 

 

Picture1.png

 

1 ACCEPTED SOLUTION

Hi @Velegandla 

Apologies for the inconvenience, this community is specifically for discussions and questions related to Microsoft Fabric. For queries related to Azure Data Factory, we recommend using the dedicated Microsoft Q&A forum where they are ready to assist you better. Here's the link to post your query in Microsoft Q&A : Ask a question - Microsoft Q&A.

 

Thanks.

View solution in original post

3 REPLIES 3
v-nikhilan-msft
Community Support
Community Support

Hi @Velegandla 
Thanks for using Fabric Community.
Can you please confirm if you are trying the above scenario with ADF dataflow or Fabric Dataflows?
thanks

@v-nikhilan-msft 

 

ADF dataflow

Hi @Velegandla 

Apologies for the inconvenience, this community is specifically for discussions and questions related to Microsoft Fabric. For queries related to Azure Data Factory, we recommend using the dedicated Microsoft Q&A forum where they are ready to assist you better. Here's the link to post your query in Microsoft Q&A : Ask a question - Microsoft Q&A.

 

Thanks.

Helpful resources

Announcements
FabricCarousel_June2024

Fabric Monthly Update - June 2024

Check out the June 2024 Fabric update to learn about new features.

July Newsletter

Fabric Community Update - July 2024

Find out what's new and trending in the Fabric Community.