Don't miss your chance to take the Fabric Data Engineer (DP-700) exam on us!
Learn moreThe FabCon + SQLCon recap series starts April 14th at 8am Pacific. If you’re tracking where AI is going inside Fabric, this first session is a can't miss. Register now
I am pulling data from REST API source.
One of the Columns in the Query invokes a function with an API call.
I would like to save this step as a JSON file AS-IS, without having to "expand" this column (that contains Records) to columns.
Is it possible with Dataflows Gen2? Maybe save to Lakehouse as a file but not as a table?
Currently, when I choose Lakehouse as a source, it only prompts me for a Table name and says:
"A new table will be created in Lakehouse"
I need to save a JSON file, not a table. And I want to use the Dataflow, not Data Factory.
Please help
Solved! Go to Solution.
Dataflows Gen2 doesn't have a way to save the binary as is today. I encourage you to to post your idea to make this feature available in Dataflow Gen2 from the link below:
However, it is possible to query a REST API with pipelines and save the results as a binary using Pipelines. You can use the copy activity for it:
How to copy data using copy activity - Microsoft Fabric | Microsoft Learn
Dataflows Gen2 doesn't have a way to save the binary as is today. I encourage you to to post your idea to make this feature available in Dataflow Gen2 from the link below:
However, it is possible to query a REST API with pipelines and save the results as a binary using Pipelines. You can use the copy activity for it:
How to copy data using copy activity - Microsoft Fabric | Microsoft Learn
Thanks, @miguel
I am not talking about saving a binary, but a simple JSON/text file.
I did open an idea, please vote:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=b9b321af-be2a-ee11-a81c-000d3a0ec312
Thank you for posting the idea!
Basically at its core the file is considered a binary and then you can define what extension such file / binary might have or how it might be interpreted or how it should be encoded.
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.