Forum Discussion

mark_carlisle's avatar
mark_carlisle
Advocate IV
2 years ago
Solved

Copy Data Activity for JSON from paged API response

I have setup a data pipeline that successful retrives data from an API and loads the JSON response into a lakehouse.   My issue is how the copy data activity saves a paged response to a single JSON...
Need Help
Pipelines
  • Nero's avatar
    Nero
    2 years ago

    Try setting File Pattern to "Array of Objects"

     

Nero's avatar
Nero
Advocate II
2 years ago

Try setting File Pattern to "Array of Objects"

 

  • mark_carlisle's avatar
    mark_carlisle
    Advocate IV
    2 years ago

    Hi,

     

    Thanks for your reponse. Managed to figure this out over the weekend. Looks like I'm impacted by a bug of some sort because we'd been switching that setting about and still getting the same output. It would seem that this bug is preventing the setting taking effect:

     

    I was able to overcome this by editing the JSON (Edit Fabric Pipeline's JSON (linkedin.com)) manually.

    • v-cboorla-msft's avatar
      v-cboorla-msft
      Microsoft Employee
      2 years ago

      Hi mark_carlisle 

       

      Thanks for using Microsoft Fabric Community.

      Glad that you were able to find some insights and thank you for sharing the same with the community as it can be helpful to others.
      Please continue using Fabric Community for further queries.

       

      Thank you.