Right now Notebooks and Spark Job Definitions can't use the on-premises data gateway at all , only Dataflow Gen2 and Pipelines can. That means anyone trying to pull on-prem data into a notebook is stuck, even if they already have a gateway set up and working fine for dataflows. I would like for Notebooks and Spark to be able to connect through the on-premises data gateway, the same way Dataflow Gen2 and Pipelines already do. This would also solve the static outbound IP problem a lot of us are hitting, since the gateway already has a fixed IP that vendors can whitelist , or let me set up a static outbound IP on a notebook.
2 Comments
- AGREED! This would solve a lot of my problems
