Forum Discussion
Fabric Data Flow Gen2 Destination as Lakehouse Files
- 2 years ago
You could use Notebooks as well in Fabric. Currently Dataflow Gen2 doesn't support the load operation as files to a destination, but you can request that as new feature idea from aka.ms/FabricIdeas
You could alternatively load the data first as a table and then use something like Data Pipeline to copy the data and then save it as a file using the "Copy" activity. You could also take advantage of the "Copy" activity in pipelines and the REST API for it, or raise a new idea to have new explicit connectors to a source of your choice that might not be available today in Data Pipeline.
The most explicit way would be to use a Notebook.
Hope this helps!
Thanks for the confirmation, as it is Data Flow Gen2 limitation.
This case how we can extract the data from Salesforce and ingest as files into Lakehouse using Fabric.
Regards,
Sathish Kumar
You could use Notebooks as well in Fabric. Currently Dataflow Gen2 doesn't support the load operation as files to a destination, but you can request that as new feature idea from aka.ms/FabricIdeas
You could alternatively load the data first as a table and then use something like Data Pipeline to copy the data and then save it as a file using the "Copy" activity. You could also take advantage of the "Copy" activity in pipelines and the REST API for it, or raise a new idea to have new explicit connectors to a source of your choice that might not be available today in Data Pipeline.
The most explicit way would be to use a Notebook.
Hope this helps!