Forum Discussion
Installing Packages
Has anyone been able to successfully install the spark-xml library on the spark pool in Fabric? I added this in the workspace settings: After a few minutes, it was 'successful', but the noteb...
I opened a support ticket for this, but they never got it working and said it was not supported now. They didn't give any timeline or any good reason as to why it doesn't work.
As a workaround, I am reading the XML with scala, which does work with this package. Then just doing the rest of what I need to do in Pysypark.
Thanks Joshrodgers123, that's a great suggestion.
With a little help from ChatGPT I was able to rewrite parts of my notebook to use Scala, and then drop back into Pyspark to do the rest of the work.
It's a shame that Microsoft haven't got this working properly, especially as it works in Synapse Analytics, but this workaround will do for now.
I'm having the same issue with spark-xml. Have there been any updates on this?
