Forum Discussion
pacman
7 months agoNew Member
Dataflow to Lakehouse WriteToDestination Failure
Hey guys, a bit puzzled as to why this might be happening and was wondering if any of y'all could help. I have a table, ~80 col x ~ 2 mil rows with historical data. I am trying to run it via Data...
- 7 months ago
Hi v-ssriganesh
After much trial and error myself and a Microsoft employee were able to fix the issue. It is a bug dealing with the 2.0 connector - ADBC driver. Switching it to 1.0 and using the ODBC driver worked. Apparently this will be fixed in an update soon, but for now, I have swapped all Databricks connections to 1.0 and they work fine.
deborshi_nag
7 months agoSuper User
are you saying this table is produced by Databricks - if so, is this an external table or a managed Databricks table?
pacman
7 months agoNew Member
Hi, this table is in our Databricks environment, and is being pulled through the Dataflow via the Databricks connector