topic Re: reading json file in Pipelines

reading json file

arkiboys2 — Tue, 18 Jun 2024 12:01:36 GMT

hello,

using the ADF dataflow, I use the flatten activity to read the json file...
How can I do this in fabric?

thank you

Re: reading json file

Anonymous — Wed, 19 Jun 2024 06:35:51 GMT

Hi arkiboys2 ,

Thanks for using Fabric Community.

I’d recommend connecting to the JSON directly in Dataflow Gen2 to perform the flatten operation if it just a single file.

If there are multiple or it’s a large file, I’d suggest looking at the Copy activity in Data pipeline to land it into the lakehouse and then Dataflow Gen2 to connect and flatten.

Hope this is helpful. Please do let me know incase of further queries.

Re: reading json file

arkiboys2 — Wed, 19 Jun 2024 07:54:25 GMT

yes the files are in the storage account.

how can I flatten the data in dataflowgen2? there is no flatten activity.

thank you

Re: reading json file

Anonymous — Thu, 20 Jun 2024 09:53:39 GMT

Hi arkiboys2 ,

Thanks for using Fabric Community.
I tried to upload JSON file into DataFlow Gen 2 and here is my result,

Sample Json:

[ { "id": 1, "items": [ { "name": "Headphones", "price": 79.99, "quantity": 1 }, { "name": "Notebook", "price": 9.99, "quantity": 2 } ], "customer": { "name": "Alice Smith", "address": { "street": "10 Main St", "city": "Anytown", "state": "CA", "zip": "98765" }, "phone": "555-123-4567" } }, { "id": 2, "items": [ { "name": "T-Shirt", "price": 14.99, "quantity": 1 }, { "name": "Mug", "price": 5.99, "quantity": 1 }, { "name": "Pen Set", "price": 3.49, "quantity": 2 } ], "customer": { "name": "Bob Jones", "address": { "street": "25 Elm St", "city": "Springfield", "state": "NY", "zip": "10001" }, "phone": "555-567-8901" } } ]

Uploading Json File into Dataflow Gen 2:

Output in Dataflow Gen 2:

You can find each and every operation/steps it performed at right corner.

Can you please upload your json file into dataflow gen2?

Hope this is helpful. Please let me know incase of further queries.

Re: reading json file

Anonymous — Fri, 21 Jun 2024 10:02:03 GMT

Hi arkiboys2 ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help .

Thanks