topic Re: Lakehouse files from copy data activity gets unknown typ in Pipelines

Lakehouse files from copy data activity gets unknown typ

joakimfenno — Thu, 11 Jul 2024 08:14:23 GMT

I am using data pipeline - copy data activity to copy data from a rest API to files in fabric lakehouse

everything works as expected but the files end up with an unknown type in the lakehouse file area

the response from the API is in json format and I want to store the files as json (but I have also tried other formats)

Any idea of how I shall troubleshot this

Example response from API

{ "Items": [ { "Id": 1, "Name": "test" }, { "Id": 2, "Name": "test2" } ], "Take": 2, "Skip": 0, "Count": 2 }

Re: Lakehouse files from copy data activity gets unknown typ

Anonymous — Fri, 12 Jul 2024 02:25:42 GMT

Hi joakimfenno ,

First you need to make sure that the replication activity in the data pipeline explicitly specifies that the output format is JSON, and that the REST API response contains the correct content type header (application/json).

Next make sure you save the file with a .json extension. Sometimes the file type may not be recognized if the extension is missing or incorrect.

It is also possible to change the file type of lakehouse, you can check this documentation: Navigate the Fabric Lakehouse explorer - Microsoft Fabric | Microsoft Learn

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Lakehouse files from copy data activity gets unknown typ

joakimfenno — Fri, 12 Jul 2024 05:07:04 GMT

it worked when I ended the filename with ".json"

just setting type json did not work