topic Re: Reference json data from notebook output in Pipelines

Reference json data from notebook output

chriklev — Wed, 25 Oct 2023 08:08:51 GMT

Hello!

I'm trying to return json data from a notebook like this:

json_data = {"key1": "value1","key2": "value2"} dbutils.notebook.exit(json_data)

How do I reference json values from the notebook output in a pipeline?
It seems, this is possible with databricks notebooks:
https://stackoverflow.com/questions/77126213/sending-databricks-notebook-output-as-json-via-post-in-adf
,but in Fabric the json output is formatted as a string.

Thanks in advance for any help 😁

Re: Reference json data from notebook output

v-cboorla-msft — Thu, 26 Oct 2023 07:47:46 GMT

Hi chriklev

Welcome to Fabric Community and thanks for posting your question here.

I am not clear with your ask, So could you please provide me more details regarding the ask.

Which activity you are using? Can you please provide me some screenshots so that I can help you better.

Thank you.

Re: Reference json data from notebook output

jwinchell40 — Mon, 30 Oct 2023 22:44:10 GMT

You can convert a string to JSON using the JSON function but I don't know that you can do a lot with it at that point.

https://learn.microsoft.com/en-us/azure/data-factory/control-flow-expression-language-functions#json

Depending on your use case it may be better to write the output to a file and return the path instead so you can read the data into data factory so you can do stuff.

If its just for purposes of logging, then the rest string should be fine.

Re: Reference json data from notebook output

chriklev — Fri, 03 Nov 2023 08:57:05 GMT

Thank you! parsing the output with the JSON function did the trick.

Re: Reference json data from notebook output

jwinchell40 — Fri, 03 Nov 2023 18:11:36 GMT

No problem. Glad it worked!