我创建了 3 个 Glue 作业,其中作业参数键/值之一如下所示: runid id
如果我像这样使用 AWS CLI 执行 Glue 作业,则它工作正常: awsglue start-job-run --jobname $job --arguments='--runid="Runid_10"'
这 3 个 Glue 作业位于一步函数和状态机内,定义为:
{
"Comment":"Sample Step Function",
"StartAt":"First Glue Job",
"States": {
"First Glue Job":{
"Type": "Task",
"Resource": "arn:aws:states:::glue:startJobRun.sync",
"Parameters": {
"JobName": "GlueJob-Firstjob"
},
"Next": "Second Glue Job"
},
"Second Glue Job":{
"Type": "Task",
"Resource": "arn:aws:states:::glue:startJobRun.sync",
"Parameters": {
"JobName": "GlueJob-Secondjob"
},
"Next": "Third Glue Job"
},
"Third Glue Job":{
"Type": "Task",
"Resource": "arn:aws:states:::glue:startJobRun.sync",
"Parameters": {
"JobName": "GlueJob-Thirdjob"
},
"End": true …Run Code Online (Sandbox Code Playgroud)