Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
I am pulling data from REST API source.
One of the Columns in the Query invokes a function with an API call.
I would like to save this step as a JSON file AS-IS, without having to "expand" this column (that contains Records) to columns.
Is it possible with Dataflows Gen2? Maybe save to Lakehouse as a file but not as a table?
Currently, when I choose Lakehouse as a source, it only prompts me for a Table name and says:
"A new table will be created in Lakehouse"
I need to save a JSON file, not a table. And I want to use the Dataflow, not Data Factory.
Please help
Solved! Go to Solution.
Dataflows Gen2 doesn't have a way to save the binary as is today. I encourage you to to post your idea to make this feature available in Dataflow Gen2 from the link below:
However, it is possible to query a REST API with pipelines and save the results as a binary using Pipelines. You can use the copy activity for it:
How to copy data using copy activity - Microsoft Fabric | Microsoft Learn
Dataflows Gen2 doesn't have a way to save the binary as is today. I encourage you to to post your idea to make this feature available in Dataflow Gen2 from the link below:
However, it is possible to query a REST API with pipelines and save the results as a binary using Pipelines. You can use the copy activity for it:
How to copy data using copy activity - Microsoft Fabric | Microsoft Learn
Thanks, @miguel
I am not talking about saving a binary, but a simple JSON/text file.
I did open an idea, please vote:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=b9b321af-be2a-ee11-a81c-000d3a0ec312
Thank you for posting the idea!
Basically at its core the file is considered a binary and then you can define what extension such file / binary might have or how it might be interpreted or how it should be encoded.
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.