Forum Discussion
High Currency for Notebooks
- Anonymous1 year ago
Hi tan_thiamhuat ,
Yes, writing to a persistent table with saveAsTable makes the data accessible to any notebook connected to the same lakehouse and Spark environment, including both high concurrency and standard sessions. This is useful for sharing data broadly across sessions.
However, temporary views are limited to the same Spark session, so to share them between notebooks, those notebooks must join the same high concurrency session. If you need quick, session-scoped sharing, use temporary views with shared sessions; for wider access across different sessions, persistent tables are the best option.
If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.
Thank you.
If you want to run mulitple Notebooks from the same workspace, you have to tag both notebooks High concurrency session, but there are specific condiitions that must be met. The notebooks need to
- Both notebooks from the same lakheouse
- Notebooks run by same user
- Same Librarry configurations
So, with enabling high concuurrency mode, you will attaach multiple noteebooks to an existing Spark session, allowing for greater session utilization and faster execution
Read more abour high concuurrency mode here - Configure high concurrency mode for notebooks - Microsoft Fabric | Microsoft Learn
Thank you!
Did I answer your question? Mark my post as a solution!
Proud to be a Super User!
does not work for me, both notebooks are in the same Lakehouse and workspace.