Forum Discussion
Can I secure notebook outputs?
Greetings, all. I have a notebook for which I am returning an output value to a Fabric data pipeline. I want to ensure that the data in the notebook is secured and the output is secured in such a way that it doesn't get persisted. The data that will be passed will likely be sensitive data. Is this possible?
For reference, I am using the following to output the return value:
notebookutils.notebook.exit({"adf_output_value":r})
1 Reply
Hi arpost
Which type of data do you want to secure? Maybe you can consider using Azure Key Vault. Azure Key Vault is a cloud service for securely storing and accessing secrets. A secret is anything that you want to tightly control access to, such as API keys, passwords, certificates, or cryptographic keys.
You can write secrets in Azure Key Vault using notebooks. In the data pipeline, create a Web activity to get the secret from Azure Key Vault and use it in other activities. Set the Secure Output option to true to prevent the secret value from being logged in plain text. Any further activities that consume this value should have their Secure Input option set to true.
Use Azure Key Vault secrets in pipeline activities - Azure Data Factory | Microsoft Learn
Query and use Azure Key Vault secrets in your Pipeline - Azure Pipelines | Microsoft Learn
Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!
