Nis*_*man 2 aws-step-functions aws-glue
我创建了一个状态机来并行运行一些 Glue/ETL 作业。我正在试验映射状态以利用动态并行性。这是阶跃函数的定义:
{
"StartAt": "Map",
"States": {
"Map": {
"Type": "Map",
"InputPath": "$.data",
"ItemsPath": "$.array",
"MaxConcurrency": 2,
"Iterator": {
"StartAt": "glue job",
"States": {
"glue Job": {
"Type": "Task",
"Resource": "arn:aws:states:::glue:startJobRun.sync",
"End": true,
"Parameters": {
"JobName": "glue-etl-job",
"Arguments": {
"--db": "db-dev",
"--file": "$.file",
"--bucket": "$.bucket"
}
}
}
}
},
"Catch": [
{
"ErrorEquals": [
"States.ALL"
],
"Next": "NotifyError"
}
],
"Next": "NotifySuccess"
},
}
}
Run Code Online (Sandbox Code Playgroud)
传递给步骤函数的输入格式如下:
{
"data": {
"array": [
{"file": "path-to-file1", "bucket": "bucket-name1"},
{"file": "path-to-file2", "bucket": "bucket-name2"},
]
}
}
Run Code Online (Sandbox Code Playgroud)
问题是file和bucket工作参数没有得到解决,它们被传递到像$.file和 这样的粘合工作$.bucket。如何从输入中传递参数实际值?
小智 5
使用state字段作为参数时,需要在参数的'.$'末尾添加。
"--file.$": "$.file",
"--bucket.$": "$.bucket"
Run Code Online (Sandbox Code Playgroud)
如需完整指南,请查看规格表。 https://states-language.net/spec.html#parameters
| 归档时间: |
|
| 查看次数: |
3942 次 |
| 最近记录: |