Forum Discussion

DennesTorres's avatar
DennesTorres
Icon for Power Participant rankPower Participant
3 years ago
Solved

Spark Job Definition vs Notebooks

Hi, Is there a reason for a spark job definition not accept a notebook from the portal and requires us to download the notebook as a .py file and upload again to the job definition, requiring a ma...
data engineering
DennesTorres's avatar
DennesTorres
Icon for Power Participant rankPower Participant
3 years ago

Hi,

The array becomes fixed in this example, I'm trying to achieve something more dynamic. But this may be an option.

Kind Regards,

 

Dennes

Anonymous's avatar
Anonymous
Not applicable
3 years ago

Hi DennesTorres ,

Can you please check this code

 

 

lakehouses = catalog.listDatabases()

lakehouse_list = []

for lakehouse in lakehouses:
    lakehouse_list.append(lakehouse.name)

print(lakehouse_list)

 

 



 

  • Anonymous's avatar
    Anonymous
    Not applicable
    3 years ago

    Hello DennesTorres ,
    We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet . Otherwise, will respond back with the more details and we will try to help .

  • Anonymous's avatar
    Anonymous
    Not applicable
    3 years ago

    Hi DennesTorres,
    We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .
    In case if you have any resolution please do share that same with the community as it can be helpful to others .
    If you have any question relating to the current thread, please do let us know and we will try out best to help you.
    In case if you have any other question on a different issue, we request you to open a new thread .