Forum Discussion
Writing to a specific warehouse schema using a dataflow gen2
Hi,
I've a warehouse having some schemas for the tables to ingest. I need to write some data into a specific table of a specific schema using a dataflow gen2 (I need to use a dataflow gen2), but it isn't possible to select a specific schema for the warehouse destination.
I've noticed that there is this idea, in completed status: Write to custom schema in Dataflow Gen2
Is this issue solved or not?
Any suggests to me, please? Thanks
tayloramy pmscorca we implemented the capability of writing to a given schema in Azure Sql, Lakehouse, Warehouse and Fabric Sql quite some time ago already.
As mentioned by miguel you need to ensure that you expand Advanced option when selecting the connector and set "Navigate using full hierarchy" to True.
Once done, on the next stage you'll be able to see the list of schema you can write to
Best regards,
Antoine
20 Replies
- anrosMicrosoft Employee
tayloramy pmscorca we implemented the capability of writing to a given schema in Azure Sql, Lakehouse, Warehouse and Fabric Sql quite some time ago already.
As mentioned by miguel you need to ensure that you expand Advanced option when selecting the connector and set "Navigate using full hierarchy" to True.
Once done, on the next stage you'll be able to see the list of schema you can write to
Best regards,
Antoine
- tayloramySuper User
Hi pmscorca,
Maybe CharlesWebbMSFT can comment, but I've never seen the functionality to select a schema in dataflow gen 2.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
- pmscorcaKudo Kingpin
The idea status is completed: this is a wrong communication for the Fabric community!
- miguelCommunity Admin
Could you share a screenshot of what you're able to see?
Also, please confirm that when you've selected the warehouse connector that you've selected the advanced option to enable schema navigation
- pmscorcaKudo Kingpin
Hi, I haven't selected the advanced option to enable the schema navigation (is it documented?).
But also selecting it the result doesn't change:
I cannot specify any schema for the new table.- miguelCommunity Admin
Here's the link to the documentation about this capability:
Dataflow Gen2 data destinations and managed settings - Microsoft Fabric | Microsoft Learn
As mentioned by Antoine, once you select this option you'll be able to navigate to the schema of your choice and create or select a table within that specific schema.The view from your screenshot fundamentally showcases all available warehouses in your workspace, so you need to expand the nodes to be able to see the schemas within them. Fundamentally navigating on the left pane to the schema of your choice.
- miguelCommunity Admin
Today, and what the original idea shared was tracking, you are able to use existing items (like databases) and schemas to navigate through them and create new tables within them. You can define the names of the new tables after picking the schema like in the example below where I first created a new schema (named schema1) inside the Warehouse experience and then through the data destination experience I get a message that a new table will be created in this schema:
In other words, there is no input box for schema. Instead, you need to select the specific schema from the navigation tree on the left as shown in the screenshot above.
If perhaps this is about having Dataflow create a new warehouse or a new schema, those are valid suggestions and we welcome such suggestions in the Fabric Ideas portal.