Forum Discussion

johnpjustus's avatar
johnpjustus
Helper IV
2 years ago
Solved

Refresh Dataflow after Databricks job

Hi All, I have an requirement like this. I have a job in databricks, basically this job refreshes the datamodel in databricks (refreshes data in Gold layer) Now as soon as this job completes, I wo...
Need Help
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi johnpjustus ,

     

    The official document mentioned:

     

    In some cases, you may need to pass some values from the notebook back to the service. These values can be used for control flow (conditional inspection) in the service or use by downstream activities (limited to 2 MB).

     

    I think you are in line with this situation.

     

    You can return a value after your homework is completed. This value can be used in services such as Azure data factory, and then the Power Automate stream can be triggered.

     

    For details, please refer to the screenshots and documents below:

    Azure Databricks activity - Microsoft Fabric | Microsoft Learn

     

    If you have other questions, please contact me at any time.

     

    Best Regards,
    Yang
    Community Support Team

     

    If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
    If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

johnpjustus's avatar
johnpjustus
Helper IV
2 years ago

Thank you Yang for the suggestions.

The thing is, I wouldnt be knowing when the databricks job completes, so I can't stick to an expected completion time and then trigger the power automate to run.

Any ideas?

Thanks,

John

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi johnpjustus ,

 

The official document mentioned:

 

In some cases, you may need to pass some values from the notebook back to the service. These values can be used for control flow (conditional inspection) in the service or use by downstream activities (limited to 2 MB).

 

I think you are in line with this situation.

 

You can return a value after your homework is completed. This value can be used in services such as Azure data factory, and then the Power Automate stream can be triggered.

 

For details, please refer to the screenshots and documents below:

Azure Databricks activity - Microsoft Fabric | Microsoft Learn

 

If you have other questions, please contact me at any time.

 

Best Regards,
Yang
Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

  • johnpjustus's avatar
    johnpjustus
    Helper IV
    2 years ago

    Thank you so much. I am sure this is going to be helpful.