Docker:从私人GitHub仓库获取

Question

我正在尝试运行一个容器,它将从我在私有GitHub存储库上的包中公开golang服务.

由于我正在与GCE合作,我的初学者形象是google/debian:wheezy.

安装所有必需的依赖项和工具后,我正在运行

RUN go get github.com/<my_org>/<my_package>

包裹是私人回购的地方.

我添加了我的GitHub SSH密钥以允许从私有仓库克隆到docker文件:

ADD priv/id_rsa /root/.ssh/id_rsa
ADD priv/id_rsa.pub /root/.ssh/id_rsa.pub

在尝试克隆回购时,我在go get过程中遇到错误:

# cd .; git clone https://github.com/<my_org>/<my_package> /gopath/src/github.com/<my_org>/<my_package>
Cloning into '/gopath/src/github.com/<my_org>/<my_package>'...
fatal: could not read Username for 'https://github.com': No such device or address
package github.com/<my_org>/<my_package>: exit status 128

要调试问题,从Dockerfile,我正在运行:

RUN ssh-keyscan -t rsa github.com 2>&1 >> /root/.ssh/known_hosts

这告诉我有一些问题.看起来验证私钥是否正常,但公钥上有些奇怪.这是完整的ssh-keyscan结果:

OpenSSH_6.0p1 Debian-4+deb7u2, OpenSSL 1.0.1e 11 Feb 2013
Pseudo-terminal will not be allocated because stdin is not a terminal.
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for *
debug1: Connecting to github.com [192.30.252.129] port 22.
debug1: Connection established.
debug1: permanently_set_uid: 0/0
debug1: identity file /root/.ssh/id_rsa type 1
debug1: Checking blacklist file /usr/share/ssh/blacklist.RSA-2048
debug1: Checking blacklist file /etc/ssh/blacklist.RSA-2048
debug1: identity file /root/.ssh/id_rsa-cert type -1
debug1: identity file /root/.ssh/id_dsa type -1
debug1: identity file /root/.ssh/id_dsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa type -1
debug1: identity file /root/.ssh/id_ecdsa-cert type -1
debug1: Remote protocol version 2.0, remote software version libssh-0.6.0
debug1: no match: libssh-0.6.0
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_6.0p1 Debian-4+deb7u2
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: server->client aes128-ctr hmac-sha1 none
debug1: kex: client->server aes128-ctr hmac-sha1 none
debug1: sending SSH2_MSG_KEX_ECDH_INIT
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug1: Server host key: RSA 16:27:ac:a5:76:28:2d:36:63:1b:56:4d:eb:df:a6:48
debug1: Host 'github.com' is known and matches the RSA host key.
debug1: Found key in /root/.ssh/known_hosts:1
Warning: Permanently added the RSA host key for IP address '192.30.252.129' to the list of known hosts.
debug1: ssh_rsa_verify: signature correct
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: Roaming not allowed by server
debug1: SSH2_MSG_SERVICE_REQUEST sent
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey
debug1: Next authentication method: publickey
debug1: Offering RSA public key: /root/.ssh/id_rsa
debug1: Server accepts key: pkalg ssh-rsa blen 279
debug1: key_parse_private_pem: PEM_read_PrivateKey failed
debug1: read PEM private key done: type <unknown>
debug1: read_passphrase: can't open /dev/tty: No such device or address
debug1: Trying private key: /root/.ssh/id_dsa
debug1: Trying private key: /root/.ssh/id_ecdsa
debug1: No more authentication methods to try.
Permission denied (publickey).

我在priv/public键上尝试了chmod 600和chmod 700,这没有用.

有线索吗？有没有人成功运行从docker的debian私人回购获取？

Answer 1

go get 正试图使用​​https,完全忽略ssh.

你必须设置~/.netrc:

ADD priv/.netrc /root/.netrc

netrc看起来像:

machine github.com login github-username password github-password

参考:

• /sf/answers/960704601/

Answer 2

在最新版本的 golang (v1.11) 中，现在有modules。

引用来源：

模块是相关 Go 包的集合，它们作为一个单元一起进行版本控制。大多数情况下，单个版本控制存储库与单个模块完全对应。

使用最新版本的 golang 将允许您拥有私有存储库中的依赖项。基本上通过运行该 $ go mod vendor命令将为vendor所有外部依赖项在本地创建一个目录。现在确保您的 docker 镜像具有 Golang v1.11，您将使用以下内容更新您的 Dockerfile：

WORKDIR /<your repostiory>

COPY . ./

Answer 3

经过一番黑客攻击后,我想出了这个.这不是一个理想的解决方案,因为它涉及安装SSH,以及在容器中构建私钥.这个例子基于官方的Docker golang图像(Debian Wheezy):

与您的示例的主要区别在于您需要git config命令来强制ssh而不是默认的https.

FROM golang

RUN apt-get update && apt-get install -y ca-certificates git-core ssh

ADD keys/my_key_rsa /root/.ssh/id_rsa
RUN chmod 700 /root/.ssh/id_rsa
RUN echo "Host github.com\n\tStrictHostKeyChecking no\n" >> /root/.ssh/config
RUN git config --global url.ssh://git@github.com/.insteadOf https://github.com/

ADD . /go/src/github.com/myaccount/myprivaterepo

RUN go get github.com/myaccount/myprivaterepo
RUN go install github.com/myaccount/myprivaterepo

Answer 4

详细阐述OneOfOne的~/.netrc答案，这就是我在Linux上使用Jenkins所做的事情：

FROM golang:1.6

ARG GITHUB_USER=$GITHUB_USER
ARG GITHUB_PASS=$GITHUB_PASS

# Copy local package files to the container's workspace.
ADD . /go/src/github.com/my-org/my-project
WORKDIR /go/src/github.com/my-org/my-project/

# Build application inside the container.
RUN echo "machine github.com\n\tlogin $GITHUB_USER\n\tpassword $GITHUB_PASS" >> ~/.netrc && \
    go get github.com/tools/godep && \
    go get github.com/onsi/ginkgo/ginkgo && \
    godep restore && \
    ginkgo -r --randomizeAllSpecs --randomizeSuites --failOnPending && \
    godep go install && \
    rm -f ~/.netrc

ENTRYPOINT /go/bin/my-project

EXPOSE 8080

docker build命令为：

docker build \
    --build-arg GITHUB_USER=xxxxx \
    --build-arg GITHUB_PASS=yyyyy \
    -t my-project .

这两个ARG指令映射--build-args，因此docker可以在Dockerfile中使用它们。

RUN创建和删除的第一行和最后一行~/.netrc。

在Jenkins中，我在build命令中使用了git pull中的相同凭据。

在此策略中，密码不会在Docker构建过程中回显，也不会保存在Docker映像的任何层上。还要注意，在构建过程中将银杏测试结果打印到控制台。

Answer 5

我在 GitHub 中遇到了这个问题，并使用个人访问令牌修复了它：

1. 用于ARG您的 Dockerfile 变量（输入）
2. 使用 GitHub 个人访问令牌配置您的 git

GITHUB_PAT是 GitHub 个人访问令牌：

FROM golang:1.17 as builder

ARG GITHUB_PAT

WORKDIR /your-app
COPY go.mod .
COPY go.sum .
RUN git config --global url."https://${GITHUB_PAT}:x-oauth-basic@github.com/".insteadOf "https://github.com/"
RUN go mod download
COPY . .
RUN go build -ldflags '-w -s' -o ./out ./main.go


FROM golang:1.17

WORKDIR /app

COPY --from=builder /your-app/out ./
WORKDIR /app/

ENTRYPOINT [ "./out" ]