topic Re: Is it possible to save the results of a Query as a JSON file? in Dataflow

Is it possible to save the results of a Query as a JSON file?

iBusinessBI — Tue, 25 Jul 2023 07:38:38 GMT

I am pulling data from REST API source.
One of the Columns in the Query invokes a function with an API call.

I would like to save this step as a JSON file AS-IS, without having to "expand" this column (that contains Records) to columns.
Is it possible with Dataflows Gen2? Maybe save to Lakehouse as a file but not as a table?

Currently, when I choose Lakehouse as a source, it only prompts me for a Table name and says:

"A new table will be created in Lakehouse"

I need to save a JSON file, not a table. And I want to use the Dataflow, not Data Factory.

Please help

Re: Is it possible to save the results of a Query as a JSON file?

miguel — Tue, 25 Jul 2023 15:52:31 GMT

Dataflows Gen2 doesn't have a way to save the binary as is today. I encourage you to to post your idea to make this feature available in Dataflow Gen2 from the link below:

https://aka.ms/FabricIdeas

However, it is possible to query a REST API with pipelines and save the results as a binary using Pipelines. You can use the copy activity for it:

How to copy data using copy activity - Microsoft Fabric | Microsoft Learn

Re: Is it possible to save the results of a Query as a JSON file?

iBusinessBI — Tue, 25 Jul 2023 16:19:28 GMT

Thanks, miguel

I am not talking about saving a binary, but a simple JSON/text file.

I did open an idea, please vote:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=b9b321af-be2a-ee11-a81c-000d3a0ec312

Re: Is it possible to save the results of a Query as a JSON file?

miguel — Tue, 25 Jul 2023 16:22:37 GMT

Thank you for posting the idea!

Basically at its core the file is considered a binary and then you can define what extension such file / binary might have or how it might be interpreted or how it should be encoded.