Forum Discussion
input_file_name() function not working when using custom Environment
- Anonymous1 year ago
HI RickPeters,
Perhaps you can take al ooak the following document about the spark native execution engine and its limitations if helps:
Native execution engine for Fabric Spark - Microsoft Fabric | Microsoft Learn
Regards,Xiaoxin Sheng
HI RickPeters,
So you mean these script can executed on the default environment but not work property on the custom environment? If that is the case, I'd like to suggest you tried to check the library and resource difference between these two environments.
For the not existed libraries and resources, you may need to install them at first before import in the notebook.
Manage Apache Spark libraries - Microsoft Fabric | Microsoft Learn
Regards,
Xiaoxin Sheng
- RickPeters1 year agoNew Member
The only difference is that Native execution engine was enabled on the custom environment. This seemed to be the cause of input_file_name() was not working. I am wondering why though...
- Anonymous1 year agoNot applicable
HI RickPeters,
Perhaps you can take al ooak the following document about the spark native execution engine and its limitations if helps:
Native execution engine for Fabric Spark - Microsoft Fabric | Microsoft Learn
Regards,Xiaoxin Sheng