使用 Shell Executor 在 CI-CD 的 GitLab Config yml 文件中激活 Conda 环境

Amy*_*Amy 5 python gitlab anaconda conda gitlab-ci-runner

我想在我的 Gitlab CI-CD 进程中激活 conda 环境。我在与我的工作笔记本电脑不同的本地计算机(UNIX)上使用 Shell Executor 注册了 Gitlab 运行程序(v13.10) 我试图通过我的存储库中存在的环境 yml 文件激活 conda 环境,但它失败并显示 conda 命令未找到!

我编辑了 .gitlab-ci.yml 文件,如下所示:

stages:
  - build
build stage:
    stage: build
    before_script:
        - which python
        - export PIP_CACHE_DIR="/opt/cache/pip"
        - conda env create -f environment.yml
        - source activate env_work
    script:
        - echo "Building"
        - cd parent_dir
        - python main.py new_studies/first_study
    artifacts:
        paths:
            - out/
    only:
        - master
Run Code Online (Sandbox Code Playgroud)

我面临的问题是它抛出一个错误:CONDA Command NOT FOUND

Running with gitlab-runner 13.10.0 (5421146)
  on rig ci runner gZzdceA
Preparing the "shell" executor
00:00
Using Shell executor...
Preparing environment
00:00
Running on rig-machine...
Getting source from Git repository
00:04
Fetching changes with git depth set to 50...
Reinitialized existing Git repository in /home/gitlab-runner/builds/gZzdceA/0/company/gg/product/repo/.git/
Checking out 883ga36 as master...
Skipping Git submodules setup
Executing "step_script" stage of the job script
00:00
$ export PIP_CACHE_DIR="/opt/cache/pip"
$ conda env create -f environment.yml
bash: line 120: conda: command not found
Cleaning up file based variables
00:00
ERROR: Job failed: exit status 1

Run Code Online (Sandbox Code Playgroud)

我提到了像这里这里这样发布的各种问题。另外,我尝试将 anaconda 路径添加到环境路径变量的 bash 文件中。但我不确定我是否做得正确

我的问题是:

  1. 由于它在 shell 执行器上运行并且我已经运行了 conda,为什么它无法拾取它。如何在我的 GitLab 配置文件中修复此问题
  2. 我对 docker 镜像的使用有限制,想坚持使用 Shell 执行器

que*_*ise 1

对我有用的方法是使用 conda docker 映像,并执行命令conda init bashsource ~/.bashrcconda activate env_name。这将是 .gitlab-ci.yml 文件的内容:

image: continuumio/miniconda3

before_script:
    - apt-get update
    # install all required libraries using existing conda environment requirements file:
    - conda env create -f env_name.yml
    - conda init bash
    - source ~/.bashrc
    - conda activate env_name
   
pages:
  stage: deploy
  script:
    # build and publish automated documentation with Sphinx:
    - PYTHONPATH=. sphinx-build -b html . public
  artifacts:
    paths:
    - public
  only:
  - master
Run Code Online (Sandbox Code Playgroud)