Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

Unable to read SQL Endpoint view into a Notebook dataframe

Hi All, We are seeking to use a view within a SQL analytics Endpoint as a source of data for a dataframe in a notebook. When we seek to query it, we see an error like  [TABLE_OR_VIEW_NOT_FOUND]...
data engineering
  • AndyDDC's avatar
    AndyDDC
    2 years ago

    Hi Anonymous no I don't believe this will work as the View has been created using the SQL Analytics endpoint, there is no metadata sync from the SQL Endpoint to the Lakehouse (it's the other way round). 

     

    You could use JDBC connector in the Notebook to query the View in the SQL Endpoint, or create the View in the Lakehouse using Spark.

     

    edit: I believe pyodbc would work here 

AndyDDC's avatar
AndyDDC
Most Valuable Professional
2 years ago

Hi Anonymous no I don't believe this will work as the View has been created using the SQL Analytics endpoint, there is no metadata sync from the SQL Endpoint to the Lakehouse (it's the other way round). 

 

You could use JDBC connector in the Notebook to query the View in the SQL Endpoint, or create the View in the Lakehouse using Spark.

 

edit: I believe pyodbc would work here 

PunChili's avatar
PunChili
Advocate II
2 years ago

Hi, 

I can read data by using pyodbc package from endpoint. Now I would like to store these results in a delta table in lakehouse... is this possible?

 

Thank you 😄