Status:
Need Clarification
Enable Dataflow Gen2 to Dynamically Adjust Schema Mapping & Resource Paths Using Pipeline Parameters
Please consider enabling Dataflow Gen2 to: Dynamically adjust schema mapping at runtime based on the resolved parameter value. Allow resource paths (such as Lakehouse table names) to be fully dri...
miguel I have the following use-case for #1/#3 - Metadata driven dataflow which ingest X number of excel files from a Sharepoint, the parameters (sourcepath, filename, column mapping, column datatypes, destination schema, destination tablename, filters on columns and etc.) are read from a JSON files with a ForEach loop and fed to the dataflow. Currently I cannot manage to parametrize the data destination table schema, it does not follow the set schema in the dataflow for the current ingested file (at runtime), the one set at the time of dataflow creation through the UI persists.
