Forum Discussion
DataFlow Choose destination settings "Use automatic settings" disabled
- 2 years ago
Please check the documentation available for this:
answering some of the questions that I've seen on this thread:
- Automatic settings are only supported for Lakehouse and Azure SQL database
- Automatic settings can only be applied to new tables
- Dynamic table schema options on publish can only be selected when using the "Replace" update method
As mentioned in some previous replies, there are some experiences that perhaps don't exist today in Dataflow Gen2. For any of those please feel free to post an idea in the Fabric ideas portal (aka.ms/FabricIdeas)
if you can't use the "automatic settings" when trying to create a new table to a Lakehouse or an Azure SQL DB, please feel free to open a support ticket and reply to this message with the case number. I'll elevate it and have the engineering team take a closer look as to what might be causing such bug.
Please do refer to the documentation available that covers the current supported scenarios and limitations.
Great to have feedback!
A database have a collection of schemas (and in addition I created my own), the default schema is "dbo". When preparing a workflow, while defining/choosing the "Destination settings", to get-data there are 2 "Schema options on publish":
1- Dynamic Schema (default: disabled).
2- Fixed Schema (default: enabled).
Those schema options are shown on the "Choose destination settings" but by default its "Fixed Schema" implying that the data will be copied into a table in the "dbo" schema. Still, the data should be copied into a different schema different from "dbo". According with the documentation to do this you need to switch the "Use automatic settings" "Off" and the "Dynamic Schema" option will then be enabled and allow you to select a destination schema. As far as I can see schemas are only relevant to "Data Warehouses" and therefore I don't see how can those be relevant to Lake Houses. Anyways, I created the schema in a Data Warehouse, I should be able to copy data to any created/available schema as long as I have rights to do so in the schema (I am the admin, so I do have those rights).
Your thoughts...
I see... It's different kind of schemas.
The "Dynamic schema" functionality is referring to the table's internal schema (columns, column names, column types).
It's not related to the database schema. Currently I don't think you can change database schema with dataflows gen2. I think you can only write to "dbo" schema. I may be wrong here, but I think I recall reading that somewhere.