Forum Discussion

y0m0's avatar
y0m0
Frequent Visitor
2 years ago
Solved

Spark Job Definition: unable to access uploaded Reference File

Hi, I am having issues trying to use reference files in a spark job definition. As shown in the picture I have a simple main definition file called spark_entry_job.py and under Reference File I upl...
data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi y0m0 ,

    Thanks for sharing your support ticket number. In meanwhile I also reached out to internal for help and team confirmed it has a known issue and going to be resolved in upcoming release.

    Sorry for the inconvenience..

  • y0m0's avatar
    y0m0
    2 years ago

    After some back and forth with support, they figured out that the issue was happening in my specific Fabric region.
    The engeneering team deployed a fix which I tested and everything now works as it should.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi y0m0 ,

Apologies for the issue you are facing. When I tried to reproduce your scenario I am able to run the job successfully without any issues. Attaching the screenshot for reference,

 




FYI: I have used the same code that you shared previously.

Incase if you are still facing the issue this might require a deeper investigation from our engineering team and they can guide you better.

Please go ahead and raise a support ticket to reach our support team:

https://support.fabric.microsoft.com/support
Please provide the ticket number here as we can keep an eye on it.

Hope this is helpful. Please let me know incase of further queries.



y0m0's avatar
y0m0
Frequent Visitor
2 years ago

Anonymous 
thanks for the quick reply.
I am not sure what the issue is, with the code provided I get the no module xxx error.

I noticed in your SJD repro that you have a notification about updating to Runtime 1.2, does that mean that the workspace you used to repro is using Runtime 1.1?
I am currently testing on Runtime 1.2 on the Microsoft Fabric trial, could this be the issue?