Forum Discussion
jisaenz
Helper I
Helper IPerformance issues running pipelines and notebooks
I am working with the trial capacity and I am experiencing performance issues excuting pipelines and notebooks that use spark. They are running too slow or never finish. I would like to know what is...
I have the same problem, when I test from my spark notebook that transforms and stores a considerable amount of records in the lakehouse, the execution time is 5 min, with this time I am fine!
When I do the same execution calling the notebook from a pipeline the execution time increases to 30 min, the execution time increases by 600% 😓 , why does this happen? does the execution of the notebook from a fabric pipeline has less resources?