Forum Discussion
Many users work with Notebook?
- 1 year ago
Hi Cookistador ,
Thanks for posting your query in Micrososft Fabric Community,
You're right that setting up a notebook with 2 nodes (each with 4 cores) requires 8 CUs. With an F4 capacity, providing 4 CUs, would limit you to running one notebook at a time. If multiple users try to work simultaneously, you might run into performance issues.Alternatives you might consider:
-
High Concurrency Mode: This mode is designed to handle multiple sessions, but there are some limitations. Sessions need to be within a single user boundary and share the same configuration.
-
Optimizing Notebooks: For small-scale demonstrations, try optimizing the notebooks to be less resource-intensive. This could mean simplifying tasks, reducing data sizes, or breaking down complex operations into smaller chunks.
-
Incremental Upgrades: If budget allows, and more resources are needed down the line, consider upgrading to a higher capacity incrementally.
- Data Flows: You can also try DataFlows for transformations which is Low/No code ETL tool and reduce dependency on Spark-based notebooks.
- Using NotebookUtils (MSSparkUtils): Utilize NotebookUtils for efficient data management and workflow optimization. It allows you to handle files, chain notebooks, manage environment variables, and retrieve secrets securely. This can streamline the teaching process, reduce complexity, and improve overall performance, even with limited capacity like F4.
Please refer this link for further details.
https://learn.microsoft.com/en-us/fabric/data-engineering/microsoft-spark-utilities#reference-run-multiple-notebooks-in-parallel
For companies with 10-15 people:
-
Larger organizations often go for higher capacities or scalable solutions to manage multiple users and notebooks efficiently.
-
Some may prefer solutions like Databricks if it better fits their workload. However, with careful planning and optimization, Microsoft Fabric can be a cost-effective and versatile choice.
I hope this helps! If you have any more questions or need further assistance, feel free to ask.
If this post helps please consider accepting as solution to help others benefit from this and a kudos would be appreciated.Best regards
Vinay. -
Hi Cookistador ,
We wanted to follow up on your query to see if you were able to resolve the issue. If so, marking the response as the solution and leaving a kudos would be greatly appreciated, as it helps others in the community facing similar challenges.
If you're still experiencing difficulties or need further clarification, please let us know.
Best Regards,
Vinay.