Cannot Use DataLake SQL Endpoint in Notebook for Data Science Analysis

[BeyzaKzlky]

Hi all,

I'm very new at Fabric. I'm trying to build a structure on it. In the scope of this structure I want to get all data, transform and then use in a notebook for a data science project.

I got data from on-prem and created a lake house.  Then I created a view from these tables with SQL Endpoint. But when I open a notebook, I can load only lakehouse not the view. 

This means I have to make this transformation on the python side again. 

When I check the community and learning paths it says use lake house if you will build a data science project. 

Is there any way? Am I missing something?

I saw a similar question to this issue in the forum and it was saying that you need to use PYODBC in notebook for conenction. If I'll use pyodbc why I'm creating view in the lakehouse and why I'm using notebook on Fabric? I can easily use my notebook on my locale?

Please guide me if I'm missing something.

Thanks

[Anonymous]

Hi @BeyzaKzlky 
Thanks for using Fabric Community.
After getting the external data into lakehouse , why are you creating a view?
You can do all the transformations inside a Notebook itself. Notebooks can only read tables. Currently views are not supported. After doing the transformations in a Notebook you can use the data for Data Science project.
https://learn.microsoft.com/en-us/fabric/data-science/tutorial-data-science-ingest-data

Hope this helps. Please let me know if you have any further queries.

[BeyzaKzlky · Accepted solution]

Thanks for your message.

I'm a senior data scientist and I'm trying to use all system with my team. 

If I will use notebook in a Fabric and I will make transformations on my notebook, I think I don't need to Fabric. 

My goal is to prepare data before using it in a notebook. 

I understand that it doesn'T meet my goal for now. 

Thanks again.