Forum Discussion
Solved
Pandas or Spark
Hi all, I am beginning the research and setup of Fabric in a Trial Environment and had some questions about Spark vs. Pandas. I understand that Spark is more tuned for "Big Data", due to it's...
A Python Notebook (which doesn't use Spark, instead it just runs on a single node) is in the release plans:
https://learn.microsoft.com/en-us/fabric/release-plan/data-engineering#python-notebook
It will be suitable for Pandas, Polars, etc. because those Python dialects only run on a single node.
People say Polars (which is quite similar to Pandas) is more performant:
https://www.reddit.com/r/MicrosoftFabric/s/awK3fcctsx
(See the response from PawarBI)