Native execution Disabled during run time

Hi skb16 ,

on top of enabling it in the Acceleration tab, you'll want to add it to the Spark properties tab as well. 

In the Spark properties tab, add a new property with the key value pair "spark.native.enabled" and "true". 

Let me know if this resolved your problem. 🙂 

Kind regards,

Niels

Hi skb16 

Thank you for reaching out to the Microsoft Fabric Community Forum.

To properly activate the Native Execution Engine during Spark runtime in Microsoft Fabric, simply enabling it under the Acceleration tab in Custom Spark Pool is not enough. You must also add the property spark.native.enabled with the value true under the Spark properties tab of the same pool as mentioned by ObungiNiels .  After configuring both the Acceleration and Spark properties, click Publish to apply the changes. This step is crucial because the Native Execution Engine is a preview feature, and certain preview configurations require explicit runtime-level properties to be recognized by the Spark session. Once published, restart any running notebooks or pipelines using this pool. Confirm the setting by running spark.conf.get("spark.native.enabled") in your notebook; it should return 'true'. This ensures the Spark job uses the Native Execution Engine for optimized performance.

For reference: Native execution engine for Fabric Spark - Microsoft Fabric | Microsoft Learn

If this response resolves your query, kindly mark it as the Accepted Solution to help other community members. A Kudos is also appreciated if you found the response helpful.

Thank you!