Forum Discussion
Solved
Databricks VNet DM_GWPipeline_Gateway_MashupDataAccessError
We are getting the following error when trying to refresh data from databricks via a VNet gateway. We have checked everything we can think of in terms of what might be causing the error though so far...
Walkaround is possible by native queries
Value.NativeQuery(Databricks.Catalogs(
"adb-xxxxxxxxx.azuredatabricks.net",
"/sql/xx/xx/xx",
[Catalog = "xxx", Database = null, EnableAutomaticProxyDiscovery = null]
){[Name = "xxx", Kind = "Database"]}[Data],
"select * from Sample",
null,
[EnableFolding = true])
MS Support says that Databricks has planned to fix this issue "around April", and they suggest disabling cloud fetch as a temporary workaround (as mentioned by Deku).
However, I tested with the workaround proposed by Ni_BI_Żak, using Value.NativeQuery(Databricks.Catalogs()) as a replacement for Databricks.Query(), and that resolved the issue for me. So the culprit seems to be Databricks.Query().
This doesn't work:
let
Source = Databricks.Query(
"adb-xxxxxxxxxx.x.azuredatabricks.net",
"/sql/1.0/warehouses/xxxxxxxxx"
),
Query = Source("SELECT * FROM my_catalog.my_database.my_table")
in
Query
Use this instead:
let
Source = Databricks.Catalogs(
"adb-xxxxxxxxxx.x.azuredatabricks.net",
"/sql/1.0/warehouses/xxxxxxxxx"
){[Name="my_catalog", Kind="Database"]}[Data],
Query = Value.NativeQuery(Source, "SELECT * FROM my_database.my_table")
in
Query