Assistance Required: Git Not Installed on Runtime 1.2 for Code Cloning from GitHub

[Nghia]

Good morning,

I am encountering an issue while attempting to clone my repository from GitHub using a newer runtime environment. I want to provide some context and request assistance to resolve this matter.

Previously, I have been working with runtime version 1.1, which has Git installed by default, allowing me to clone my code repositories without any issues. However, I recently switched to runtime version 1.2 to take advantage of several improvements that are critical for my project. It appears that Git is not pre-installed in this environment, which has brought my work to a standstill since I am unable to clone my code repository.

Could you please guide me on how to install Git on runtime 1.2, or is there an alternative solution that I can pursue to clone my GitHub repository using this newer runtime? Any assistance or insights into this issue would be greatly appreciated.

Thank you for your time and support.

Best regards,

Nghia

[venkims · Accepted solution]

Can you check your "Workspace settings" and "Premium or License" mode?

[Nghia · Accepted solution]

My Workspace settings/Premium/License Mode= "Trail".

[venkims]

Updated: The following link has related info

Create, configure, and use an environment in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

Thanks for using Fabric Community.

Fabric 1.2 is using new runtime. Until the runtime includes git, please use the following workaround.

1) Create new YAML file with following content. Name this file as "update_env.yml"

name: Fabric1.2_GitWorkaround
channels:
  - conda-forge
  - defaults
dependencies:
  - git

2) Create new environment from Data Science or Data Engineering

Name the environment something like "Fabric1.2WithGit".

3) In the new "Fabric1.2WithGit", under "public libraries", select "add from .yml"

4) Import "update_env.yml" file created in step 1.

5) Select the public library "git", click "Save" and then "Publish". Please be patient, it will take few min to create the environment. Ensure the environment is published successfully (notification will be delivered).

6) Under the notebook, select "Fabric1.2WithGit", you will have git working

Hope it helps.

[Nghia]

I am writing to seek assistance regarding the use of the Environment artifact on the Fabric platform, which, according to my understanding, is essential for integrating Git into my workflow as per the instructions provided in your recent communication.

Unfortunately, it appears that the Environment artifact is not yet available or accessible in my current user account (Fabric Workspace).

This limitation is impacting my ability to follow the provided workaround for using Git with Fabric 1.2.

I kindly request your guidance or assistance in resolving this matter. Specifically, I would like to inquire:

1. Access to the Environment artifact: Is it possible to enable the Environment artifact for my account? If this artifact is restricted, could I request access based on my current project requirements?

2. Alternative Solutions: In the event that immediate access to the Environment artifact is not feasible, could you suggest any alternative solutions or workarounds that would allow me to use Git within the Fabric platform?

3. Timeline for artifact Availability: If the artifact is planned to be rolled out to all users soon, could you provide an estimated timeline for when it might become available to me?

Your assistance in this matter is greatly appreciated, as it will significantly impact the efficiency and effectiveness of my ongoing projects. I understand that platform updates and artifact rollouts can be complex, and I am willing to explore any interim solutions you might suggest.

Thank you for your attention to this request. I look forward to your prompt response and am available for any further information or clarification that might be needed.

PS: Data Factory Amount, Apache Airflow and Change Data Capture seem amazing

[venkims · Accepted solution]

Can you check your "Workspace settings" and "Premium or License" mode?

[Nghia · Accepted solution]

1. I found that I can go to Libary management >  Feed libraries > Add from .yml > select update_env.yml > wait 2 minutes > Done.

2. In the notebook, I have git working

Thank you very much.

[Nghia · Accepted solution]

My Workspace settings/Premium/License Mode= "Trail".

[Nghia]

Hi @Anonymous.

I was using dbt to build our DWH. I have already written an article about that: Link

[Anonymous]

Hi @Nghia ,
I have received an update from the internal team. 

Please refer this link for the official Git integration. LINK1

Git cmd is not a official supported scenario. Runtime 1.2 does not have git cmd, as it's based on Mariner - is a very streamlined/lightweight Linux OS and it does not contain the plethora of packages that were in Ubuntu (and runtime 1.1).

You can install git cmd thru conda as well. Here you can find the details about our versioning LINK2

We can bring git cmd back to Runtime 1.2 . We can certainly keep an eye on it for upvote.
Appreciate if you could share the feedback on our feedback link , which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.
Feedback Link : Home (microsoft.com)

Hope this helps. Please let us know if you have any further questions.

[Nghia]

Installing Git: Following your recommendation, I tried to install Git in my current Conda environment. I used the command :

%conda install git

After Installation Git command not found:

[Nghia]

Morning @Anonymous 

I hope this message finds you well. I am writing to seek further assistance regarding the installation of Git on Runtime 1.2, as per your previous guidance.

I attempted to install Git using Conda in the existing environment, but unfortunately, I encountered a significant challenge. Here is a summary of the steps I took and the issue that arose:

1. Installing Git: Following your recommendation, I tried to install Git in my current Conda environment. I used the command %conda install git.

Collecting package metadata (current_repodata.json): done
Solving environment: done


==> WARNING: A newer version of conda exists. <==
  current version: 22.9.0
  latest version: 23.10.0

Please update conda by running

    $ conda update -n base -c conda-forge conda



## Package Plan ##

  environment location: /nfs4/pyenv-0f889611-10bc-42f4-8904-f54b23dd4cf4

  added / updated specs:
    - git


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    c-ares-1.21.0              |       hd590300_0         119 KB  conda-forge
    curl-8.4.0                 |       hca28451_0          94 KB  conda-forge
    gettext-0.21.1             |       h27087fc_0         4.1 MB  conda-forge
    git-2.42.0                 | pl5321h86e50cf_0         9.3 MB  conda-forge
    keyutils-1.6.1             |       h166bdaf_0         115 KB  conda-forge
    krb5-1.21.2                |       h659d440_0         1.3 MB  conda-forge
    libcurl-8.4.0              |       hca28451_0         377 KB  conda-forge
    libedit-3.1.20191231       |       he28a2e2_2         121 KB  conda-forge
    libev-4.33                 |       h516909a_1         104 KB  conda-forge
    libexpat-2.5.0             |       hcb278e6_1          76 KB  conda-forge
    libiconv-1.17              |       h166bdaf_0         1.4 MB  conda-forge
    libnghttp2-1.58.0          |       h47da74e_0         617 KB  conda-forge
    libssh2-1.11.0             |       h0841786_0         265 KB  conda-forge
    libstdcxx-ng-13.2.0        |       h7e041cc_3         3.7 MB  conda-forge
    pcre2-10.40                |       hc3806b6_0         2.3 MB  conda-forge
    perl-5.32.1                | 4_hd590300_perl5        12.7 MB  conda-forge
    zstd-1.5.5                 |       hfc55251_0         532 KB  conda-forge
    ------------------------------------------------------------
                                           Total:        37.2 MB

The following NEW packages will be INSTALLED:

  c-ares             conda-forge/linux-64::c-ares-1.21.0-hd590300_0 None
  curl               conda-forge/linux-64::curl-8.4.0-hca28451_0 None
  gettext            conda-forge/linux-64::gettext-0.21.1-h27087fc_0 None
  git                conda-forge/linux-64::git-2.42.0-pl5321h86e50cf_0 None
  keyutils           conda-forge/linux-64::keyutils-1.6.1-h166bdaf_0 None
  krb5               conda-forge/linux-64::krb5-1.21.2-h659d440_0 None
  libcurl            conda-forge/linux-64::libcurl-8.4.0-hca28451_0 None
  libedit            conda-forge/linux-64::libedit-3.1.20191231-he28a2e2_2 None
  libev              conda-forge/linux-64::libev-4.33-h516909a_1 None
  libexpat           conda-forge/linux-64::libexpat-2.5.0-hcb278e6_1 None
  libiconv           conda-forge/linux-64::libiconv-1.17-h166bdaf_0 None
  libnghttp2         conda-forge/linux-64::libnghttp2-1.58.0-h47da74e_0 None
  libssh2            conda-forge/linux-64::libssh2-1.11.0-h0841786_0 None
  libstdcxx-ng       conda-forge/linux-64::libstdcxx-ng-13.2.0-h7e041cc_3 None
  pcre2              conda-forge/linux-64::pcre2-10.40-hc3806b6_0 None
  perl               conda-forge/linux-64::perl-5.32.1-4_hd590300_perl5 None
  zstd               conda-forge/linux-64::zstd-1.5.5-hfc55251_0 None



Downloading and Extracting Packages
libexpat-2.5.0       | 76 KB     | ##################################### | 100% 
libev-4.33           | 104 KB    | ##################################### | 100% 
libiconv-1.17        | 1.4 MB    | ##################################### | 100% 
git-2.42.0           | 9.3 MB    | ##################################### | 100% 
krb5-1.21.2          | 1.3 MB    | ##################################### | 100% 
libnghttp2-1.58.0    | 617 KB    | ##################################### | 100% 
zstd-1.5.5           | 532 KB    | ##################################### | 100% 
gettext-0.21.1       | 4.1 MB    | ##################################### | 100% 
curl-8.4.0           | 94 KB     | ##################################### | 100% 
pcre2-10.40          | 2.3 MB    | ##################################### | 100% 
c-ares-1.21.0        | 119 KB    | ##################################### | 100% 
libedit-3.1.20191231 | 121 KB    | ##################################### | 100% 
libcurl-8.4.0        | 377 KB    | ##################################### | 100% 
perl-5.32.1          | 12.7 MB   | ##################################### | 100% 
libssh2-1.11.0       | 265 KB    | ##################################### | 100% 
keyutils-1.6.1       | 115 KB    | ##################################### | 100% 
libstdcxx-ng-13.2.0  | 3.7 MB    | ##################################### | 100% 
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Retrieving notices: ...working... done

Note: you may need to restart the kernel to use updated packages.
Warning: PySpark kernel has been restarted to use updated packages.

 2. Git command not found: After the installation, git did not work in my notebook. The previous message indicated "I have to restart my PySpark kernel". However, I was using inline code to install git that will impossible. 

3. Attempts to Resolve the Issue: I explored potential solutions to direct installation in Libary Management/ Custom Libary by downloading "git-2.42.1.tar.gz" on the git homepage but was unable to successfully resolve it. I got another error.

As a result, I am still unable to use Git on Runtime 1.2 for my project. I would greatly appreciate any further guidance or alternative solutions you could provide.

Thank you very much for your time and support. I look forward to any suggestions or steps you might have.

[Anonymous]

Hi @Nghia ,
As another workaround, you can leverage git. Repo library in python to clone the repo 
Link1

[Nghia]

It did not work. gitpython used cmdline: git clone in the background.

[Nghia]

Dear

@Anonymous 

I hope this message finds you well. I am writing to seek further assistance regarding the installation of Git on Runtime 1.2, as per your previous guidance.

I attempted to install Git using Conda in the existing environment, but unfortunately, I encountered a significant challenge. Here is a summary of the steps I took and the issue that arose:

1. Installing Git: Following your recommendation, I tried to install Git in my current Conda environment. I used the command "%conda install git":

Collecting package metadata (current_repodata.json): done
Solving environment: done


==> WARNING: A newer version of conda exists. <==
  current version: 22.9.0
  latest version: 23.10.0

Please update conda by running

    $ conda update -n base -c conda-forge conda



# All requested packages already installed.

Retrieving notices: ...working... done

Note: you may need to restart the kernel to use updated packages.
Warning: PySpark kernel has been restarted to use updated packages.

2.Git command not found: After the installation, git did not work. 

3. Attempts to Resolve the Issue: I explored your solutions using Repo library in python to clone the repo but was unable to successfully resolve it: gitpython used cmdline: git clone in the background.

...
1006     proc.stdout = cast(BinaryIO, proc.stdout)

GitCommandNotFound: Cmd('git') not found due to: FileNotFoundError('[Errno 2] No such file or directory: 'git'')
cmdline: git clone -v -- https://github.com/trantrongw/build_dv_for_cmc_use_automate_dv.git build_dv_for_cmc_use_automate_dv

As a result, I am still unable to use Git on Runtime 1.2 for my project. I would greatly appreciate any further guidance or alternative solutions you could provide.

Thank you very much for your time and support. I look forward to any suggestions or steps you might have.

Best regards,

Nghia

[Anonymous]

Hi @Nghia ,

Thanks for using Fabric Community.

At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
Appreciate your patience.

[guilhermemendes]

Hi @Anonymous 

Any updates on this topic ?

Thanks in advance 🙂

[Anonymous]

Hi @Nghia ,
Could you please explain why are you trying to use GIT in notebooks? What is the content that you want to include in GIT?

Thanks.