Forum Discussion
TSQL vs Gen2 Dataflow
Hi,
The explanation about what exactly you are doing is a bit confused. But let me try to add something.
I don't think this support will be added soon, it doesn't seems to be the purpose. But I'm not in position to answer this part.
You can use Spark SQL in a notebook to create tables in a lakehouse, I'm not sure if this helps.
About views, there is an old trick about views and order by: If you add a TOP 100 PERCENT in your query, you are able to add an order by to your view. I haven't tested in a lakehouse yet, but it should work.
Kind Regards,
Dennes
I'm not Spark SQL via a notebook since I don't like how you can't retain upper case naming on the Table names.
With T-SQL you have this control. That's the only reason I'm using them - T-SQL Views
Otherwise, would happily use Spark SQL. There I wouldn't even use Views, (not sure if Spark SQL even supports views), but would instead do a write back to the Lakehouse, with Ordering added too.
Hopefully support for T-SQL to write back to the Lakehouse might be added soon...? Or the ability to write from a Spark SQL notebook, where I can make sure that the Table name retains it's Upper Casing.