Dataflow Challenges Adding Columns and Values to a Lakehouse

In Dataflow Gen 2 you can use 'Add custom column' to add columns with the needed info. For the timestamp you can use some DateTime function (e.g. DateTimeZone.UtcNow()). For the CreatedBy I think you can hardcode that? Or do you need it to be dynamic? (If so - why? ☺️)

In pipeline perhaps you can use 'Additional columns' under the Advanced setting. There are some functions you can use, or you can hardcode the values.

Or you could generate the extra columns as part of the SQL query if you are using a written SQL query.

Anyway I think you need to create the columns in the Delta table before you can start writing values to these columns. If you plan to use this table in SQL Analytics Endpoint or semantic model, you will need to create a new table in order to change the number of columns in your table.