Forum Discussion

gmangiante's avatar
gmangiante
Frequent Visitor
2 years ago
Solved

Adding custom .zip or .egg reference files to PySpark jobs

Hello- I'm currently working on a fairly complex Spark ETL job definition that requires a number of additional custom Python files alongside the main file in order to run. I'm currently using the "r...
data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi gmangiante ,

    Currently this is not supported. Team has taken has feedback on it.

    Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

    Hope this helps. Please let me know if you have any further queries.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi gmangiante ,

Currently this is not supported. Team has taken has feedback on it.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps. Please let me know if you have any further queries.

  • gmangiante's avatar
    gmangiante
    Frequent Visitor
    2 years ago

    Appreciate you all taking a look, and will do! Thanks.