Forum Discussion
dhorrall
Advocate I
Advocate IHow to handle schema drift?
In legacy datafactory there were options to explicitly allow schema drift. I do not see that in Fabric. Am I missing it? For example, I was just doing some random testing of loading historical b...
So Consider this scenario: Copying multiple csv files from OneLake to a Data warehouse within Fabric capacity. CSVs have different schemas, and the tables in the Data Warehouse have to be autocreated (will require schema drift to be on). Now since the schemas are different, in the "Mapping" section of the "Copy" activity, one cannot provide the schemas, but still the current pipelines in Fabric do ask for that.
For more context - GetMetadata gets all the childitems in the onelake folder, and ForEach runs the CopyData activity on all the ChildItems.