topic Re: Dynamically Change Notebook ID for each Workspace in Pipelines

Dynamically Change Notebook ID for each Workspace

MisterSmith — Tue, 03 Sep 2024 15:09:31 GMT

Hi All

I want to set up a pipeline that dynamically selects the correct workspace and notebook, depending what environment/workspace the pipeline is in. I am using the system variable to select the correct workspace. However it doesn't provide a dropdown of available notebooks. Therefore I am having to use the notebook id. But I suspect the notebook id will change once it is deployed to a new environment/workspace. Therefore I would like the pipeline to dynamically select the correct notebook id. Can this be done.

Thanks

Neil

Re: Dynamically Change Notebook ID for each Workspace

Anonymous — Wed, 04 Sep 2024 08:57:48 GMT

Hi MisterSmith ,

Based on your description, to set up a pipeline that dynamically selects the correct workspace and laptop based on the environment, you can use a combination of system variables and mapped configurations.

Refer to related document:

Set Variable activity - Microsoft Fabric | Microsoft Learn

Best Regards,
Adamk Kong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Dynamically Change Notebook ID for each Workspace

MisterSmith — Thu, 05 Sep 2024 09:39:16 GMT

Hi Anonymous

I am aware that I can I can use the variable activity to construct a variable. However it is the makeup of the variable that I am quering. How can I dynamically call the correct notebook id depending on the workspace. I am unsure on how I could do this.

thanks

Neil

Re: Dynamically Change Notebook ID for each Workspace

MisterSmith — Thu, 05 Sep 2024 10:18:17 GMT

This looks to have been resolved by Microsoft. When dynamically setting the workspace id, the list of available notebooks is now available in the drop down box. Therefore there is no need for me to create a variable to dynamically set the notebook id for each workspace.

Re: Dynamically Change Notebook ID for each Workspace

kharithaas — Fri, 13 Sep 2024 08:28:23 GMT

i have tried to make the workspaceid dynamically, but cant se any notebooks - its empty

Re: Dynamically Change Notebook ID for each Workspace

MisterSmith — Wed, 18 Sep 2024 12:52:05 GMT

Put a value into the notebook field, save and exit the pipeline. Reopen the pipeline and delete the notebook value. The list should now be available. In short the pipeline needs to be refreshed.

Re: Dynamically Change Notebook ID for each Workspace

KhagendraWagle — Mon, 25 Nov 2024 15:01:41 GMT

Please visit the post and try if it helps to solve your problem.

https://community.fabric.microsoft.com/t5/Data-Pipeline/Set-NotebookId-dynamically-in-notebook-activity-of-data-pipeline/m-p/4299424#M6470

Re: Dynamically Change Notebook ID for each Workspace

Anonymous — Mon, 10 Feb 2025 11:35:35 GMT

Hi, this solution worked for dev enviroment but when i am commiting the changes to test azure devops
it didnt capture the workspace id, only the notebook id.
is my only option is create table and assign notebook id through it?
Any insights or best practices would be greatly appreciated!

Sample JSON of pipeline
{
"properties": {
"activities": [
{
"type": "TridentNotebook",
"typeProperties": {
"notebookId": "c83f4cb0-d163-48cb-9a11-b4f029e0820f"
},
"policy": {
"timeout": "0.12:00:00",
"retry": 0,
"retryIntervalInSeconds": 30,
"secureInput": false,
"secureOutput": false
},
"name": "Check new folders and files",
"description": "Check if new folders and Ingest folder entry in config table and files present in the folder in file config table.",
"dependsOn": [
{
"activity": "fetch env info from ctrl tbl",
"dependencyConditions": [
"Succeeded"
]
}
]
},