topic Re: Dataflow Gen2 - Unable to create destination in Lakehouse from on-prem source in Dataflow

Dataflow Gen2 - Unable to create destination in Lakehouse from on-prem source

Anonymous — Fri, 09 Jun 2023 03:11:54 GMT

I'm bringing data from one of our on-prem databases through data gateway. I can see data being pulled.

However, when I try to create the destination in the lakehouse, I keep getting the following error: An exception occurred: The given data source kind is not supported. Data source kind: Lakehouse.

Re: Dataflow Gen2 - Unable to create destination in Lakehouse from on-prem source

anuarmn — Tue, 30 May 2023 04:15:57 GMT

I had the same issue. You need to update your gateway to the latest version. After that it should works.

Re: Dataflow Gen2 - Unable to create destination in Lakehouse from on-prem source

SidJay — Tue, 30 May 2023 19:34:49 GMT

A further update to the Gateway was posted today (May 29th). It will help address additional issues related to the use of the Lakehouse connector in on-premises scenarios. Please let us know if you are still encountering issues after the most recent Gateway update.

Re: Dataflow Gen2 - Unable to create destination in Lakehouse from on-prem source

maswadkar — Sun, 04 Jun 2023 08:46:56 GMT

cannot choose the existing lakehouse as "data destination" in the ingestion data pipeline

Re: Dataflow Gen2 - Unable to create destination in Lakehouse from on-prem source

miguel — Sun, 04 Jun 2023 10:46:12 GMT

Hi!

it appears, based on your screenshot, that your scenario is not directly related to the topic of this thread. Your screenshot showcases a "pipeline" whilst the thread is about dataflows gen2. I'd highly recommend starting a new thread with more details about your scenario so we can try and help you.