Forum Discussion

arkiboys2's avatar
arkiboys2
Helper IV
2 years ago
Solved

reading json file

hello, using the ADF dataflow, I use the flatten activity to read the json file... How can I do this in fabric? thank you
pipelines
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi arkiboys2 ,

    Thanks for using Fabric Community.
    I tried to upload JSON file into DataFlow Gen 2 and here is my result,

    Sample Json:

    [
    {
        "id": 1,
        "items": [
            {
                "name": "Headphones",
                "price": 79.99,
                "quantity": 1
            },
            {
                "name": "Notebook",
                "price": 9.99,
                "quantity": 2
            }
        ],
        "customer": {
            "name": "Alice Smith",
            "address": {
                "street": "10 Main St",
                "city": "Anytown",
                "state": "CA",
                "zip": "98765"
            },
            "phone": "555-123-4567"
        }
    },
    {
        "id": 2,
        "items": [
            {
                "name": "T-Shirt",
                "price": 14.99,
                "quantity": 1
            },
            {
                "name": "Mug",
                "price": 5.99,
                "quantity": 1
            },
            {
                "name": "Pen Set",
                "price": 3.49,
                "quantity": 2
            }
        ],
        "customer": {
            "name": "Bob Jones",
            "address": {
                "street": "25 Elm St",
                "city": "Springfield",
                "state": "NY",
                "zip": "10001"
            },
            "phone": "555-567-8901"
        }
    }
]

     
    Uploading Json File into Dataflow Gen 2:



    Output in Dataflow Gen 2:


    You can find each and every operation/steps it performed at right corner.

    Can you please upload your json file into dataflow gen2? 

    Hope this is helpful. Please let me know incase of further queries.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi arkiboys2 ,

Thanks for using Fabric Community.

I’d recommend connecting to the JSON directly in Dataflow Gen2 to perform the flatten operation if it just a single file.

 

If there are multiple or it’s a large file, I’d suggest looking at the Copy activity in Data pipeline to land it into the lakehouse and then Dataflow Gen2 to connect and flatten.

Hope this is helpful. Please do let me know incase of further queries.

  • arkiboys2's avatar
    arkiboys2
    Helper IV
    2 years ago

    yes the files are in the storage account.

    how can I flatten the data in dataflowgen2? there is no flatten activity.

    thank you

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi arkiboys2 ,

      Thanks for using Fabric Community.
      I tried to upload JSON file into DataFlow Gen 2 and here is my result,

      Sample Json:

      [
    {
        "id": 1,
        "items": [
            {
                "name": "Headphones",
                "price": 79.99,
                "quantity": 1
            },
            {
                "name": "Notebook",
                "price": 9.99,
                "quantity": 2
            }
        ],
        "customer": {
            "name": "Alice Smith",
            "address": {
                "street": "10 Main St",
                "city": "Anytown",
                "state": "CA",
                "zip": "98765"
            },
            "phone": "555-123-4567"
        }
    },
    {
        "id": 2,
        "items": [
            {
                "name": "T-Shirt",
                "price": 14.99,
                "quantity": 1
            },
            {
                "name": "Mug",
                "price": 5.99,
                "quantity": 1
            },
            {
                "name": "Pen Set",
                "price": 3.49,
                "quantity": 2
            }
        ],
        "customer": {
            "name": "Bob Jones",
            "address": {
                "street": "25 Elm St",
                "city": "Springfield",
                "state": "NY",
                "zip": "10001"
            },
            "phone": "555-567-8901"
        }
    }
]

       
      Uploading Json File into Dataflow Gen 2:



      Output in Dataflow Gen 2:


      You can find each and every operation/steps it performed at right corner.

      Can you please upload your json file into dataflow gen2? 

      Hope this is helpful. Please let me know incase of further queries.

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi arkiboys2 ,

        We haven’t heard from you on the last response and was just checking back to see if your query was answered.
        Otherwise, will respond back with the more details and we will try to help .

        Thanks