ArgoCD 应用程序陷入同步/终止状态

Question

我们\xe2\x80\x99在生产中面临一个奇怪的问题，其中一个应用程序陷入终止和同步状态。

\n

ArgoCD版本：2.1.7

\n

背景：

\n

我们手动终止了应用程序的同步，现在应用程序陷入终止同步状态，并且禁用自动同步按钮也不起作用。

\n

注意：\n使用类似的配置创建一个新应用程序是可行的，但我们想调查当前应用程序卡住的原因。

\n

执行的步骤：

\n

\n
• 我们尝试从 UI 和 CLI 禁用自动同步
\n
• 我们尝试终止该应用程序
\n
• 我们尝试同步应用程序
\n

\n

已尝试的命令

\n

argocd app terminate-op APPNAME\nargocd app sync APPNAME\nargocd app sync APPNAME --force --prune \n

\n

一些日志（不确定这些是否相关）：

\n

time="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/spec/preserveUnknownFields\': Unable to remove nonexistent key: preserveUnknownFields: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/status\': Unable to remove nonexistent key: status: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/spec/preserveUnknownFields\': Unable to remove nonexistent key: preserveUnknownFields: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/status\': Unable to remove nonexistent key: status: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/spec/preserveUnknownFields\': Unable to remove nonexistent key: preserveUnknownFields: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/spec/preserveUnknownFields\': Unable to remove nonexistent key: preserveUnknownFields: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/status\': Unable to remove nonexistent key: status: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="Failed to apply normalization: error in remove for path: \'/spec/preserveUnknownFields\': Unable to remove nonexistent key: preserveUnknownFields: missing value"\ntime="2022-01-07T16:19:36Z" level=debug msg="patch: {\\"status\\":{\\"reconciledAt\\":\\"2022-01-07T16:19:36Z\\"}}" application=argocd\ntime="2022-01-07T16:19:36Z" level=info msg="Failed to Update application operation state: etcdserver: request is too large, retrying in 1s"time="2022-01-07T16:19:36Z" level=info msg="Update successful" application=argocd\ntime="2022-01-07T16:19:36Z" level=info msg="Reconciliation completed" application=argocd dedup_ms=0 dest-name= dest-namespace=argocd dest-server="https://417901E660A9365B4057207C70C682EE.gr7.ap-south-1.eks.amazonaws.com" diff_ms=174 fields.level=2 git_ms=13 health_ms=3 live_ms=1 settings_ms=0 sync_ms=0 time_ms=249\ntime="2022-01-07T16:19:36Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd\n

\n

尝试再次运行同步或终止同步时

\n

time="2022-01-07T18:08:00Z" level=warning msg="finished unary call with code FailedPrecondition" error="rpc error: code = FailedPrecondition desc = another operation is already in progress" grpc.code=FailedPrecondition grpc.method=Sync grpc.service=application.ApplicationService grpc.start_time="2022-01-07T18:08:00Z" grpc.time_ms=484.012 span.kind=server system=grpc\n

\n

\n

\n

\n