Emm*_*mma 5 python amazon-web-services pyspark aws-glue
当我使用 Python 在 AWS Glue 中运行 Glue 作业样板时,出现错误
\n\nimport sys\nfrom awsglue.transforms import *\nfrom awsglue.utils import getResolvedOptions\nfrom pyspark.context import SparkContext\nfrom awsglue.context import GlueContext\nfrom awsglue.job import Job\n\nglueContext = GlueContext(SparkContext.getOrCreate())\nspark = glueContext.spark_session\n\nargs = getResolvedOptions(sys.argv, [\'JOB_NAME\'])\njob = Job(glue_context)\njob.init(args[\xe2\x80\x98JOB_NAME\xe2\x80\x99], args)\n
Run Code Online (Sandbox Code Playgroud)\n\n这是错误
\n\nin getResolvedOptions\nFile "/usr/lib64/python2.7/argparse.py", line 1733, in parse_known_args\nnamespace, args = self._parse_known_args(args, namespace)\nFile "/usr/lib64/python2.7/argparse.py", line 1957, in _parse_known_args\nself.error(_(\'argument %s is required\') % name)\nawsglue.utils.GlueArgumentError: argument --JOB_NAME is required\n
Run Code Online (Sandbox Code Playgroud)\n\n这遵循我的代码,然后
\n\njob.commit()\n
Run Code Online (Sandbox Code Playgroud)\n\n但 AWS 表示不提供 JOBNAME。\n我做错了什么?\ngetResolved 是做什么的?我尝试阅读 AWS 文档,但什么也没得到。
\nEmm*_*mma -1
您无法在开发环境中运行以下命令。
args = getResolvedOptions(sys.argv, ['JOB_NAME'])
Run Code Online (Sandbox Code Playgroud)
归档时间: |
|
查看次数: |
17871 次 |
最近记录: |