为 boto3 MTurk 构建 HTMLQuestion XML

Joe*_*aro 4 xml lxml cdata boto3

我正在尝试使用 HTMLQuestion 数据结构和 boto3 的create_hit函数构建 XML 以提交给 Amazon 的 Mechanical Turks 服务。根据文档,XML 的格式应该是这样的

我创建了一个类TurkTaskAssembler,它具有生成 xml 并通过 API 将此 XML 传递到 Mechanical Turks 平台的方法。我使用 boto3 库来处理与亚马逊的通信。

我生成的 XML 的格式似乎不正确,因为当我尝试通过 API 传递此 XML 时,出现验证错误,如下所示:

>>> tta = TurkTaskAssembler("What color is the sky?")
>>> response = tta.create_hit_task()
>>> ParamValidationError: Parameter validation failed: Invalid type for parameter Question, value: <Element HTMLQuestion at 0x1135f68c0>, type: <type 'lxml.etree._Element'>, valid types: <type 'basestring'>
Run Code Online (Sandbox Code Playgroud)

然后我修改了create_question_xml使用该tostring方法将 XML 信封转换为字符串的方法,但这会产生不同的错误:

>>> tta = TurkTaskAssembler("What color is the sky?")
>>> tta.create_hit_task()
>>> ClientError: An error occurred (ParameterValidationError) when calling the CreateHIT operation: There was an error parsing the XML question or answer data in your request.  Please make sure the data is well-formed and validates against the appropriate schema. Details: cvc-elt.1.a: Cannot find the declaration of element 'HTMLQuestion'. (1508611228659 s)
Run Code Online (Sandbox Code Playgroud)

我真的不确定我做错了什么并且几乎没有 XML 经验。

以下是所有相关代码:

import os
import boto3
from lxml.etree import Element, SubElement, CDATA, tostring
from .settings import mturk_access_key_id, mturk_access_secret_key

xml_schema_url = 'http://mechanicalturk.amazonaws.com/AWSMechanicalTurkDataSchemas/2011-11-11/HTMLQuestion.xsd'


class TurkTaskAssembler(object):

    def __init__(self, question):
        self.client = boto3.client(
            service_name='mturk',
            region_name='us-east-1',
            endpoint_url='https://mturk-requester-sandbox.us-east-1.amazonaws.com',
            aws_access_key_id=mturk_access_key_id,
            aws_secret_access_key=mturk_access_secret_key
        )
        self.question = question

    def create_question_xml(self):
        # questionFile = open(os.path.join(__location__, "question.xml"), "r")
        # question = questionFile.read()
        # return question
        XHTML_NAMESPACE = xml_schema_url
        XHTML = "{%s}" % XHTML_NAMESPACE
        NSMAP = {
            None : XHTML_NAMESPACE,
            'xsi': 'http://www.w3.org/2001/XMLSchema-instance',
            ''
            }
        envelope = Element("HTMLQuestion", nsmap=NSMAP)

        html =  """
            <!DOCTYPE html>
            <html>
             <head>
              <meta http-equiv='Content-Type' content='text/html; charset=UTF-8'/>
              <script type='text/javascript' src='https://s3.amazonaws.com/mturk-public/externalHIT_v1.js'></script>
             </head>
             <body>
              <form name='mturk_form' method='post' id='mturk_form' action='https://www.mturk.com/mturk/externalSubmit'>
              <input type='hidden' value='' name='assignmentId' id='assignmentId'/>
              <h1>Answer this question</h1>
              <p>{question}</p>
              <p><textarea name='comment' cols='80' rows='3'></textarea></p>
              <p><input type='submit' id='submitButton' value='Submit' /></p></form>
              <script language='Javascript'>turkSetAssignmentID();</script>
             </body>
            </html>
            """.format(question=self.question)

        html_content = SubElement(envelope, 'HTMLContent')
        html_content.text = CDATA(html)
        xml_meta = """<?xml version="1.1" encoding="utf-8"?>"""
        return xml_meta + tostring(envelope, encoding='utf-8')

    def create_hit_task(self):
        response = self.client.create_hit(
            MaxAssignments=1,
            AutoApprovalDelayInSeconds=10800,
            LifetimeInSeconds=10800,
            AssignmentDurationInSeconds=300,
            Reward='0.05',
            Title='a title',
            Keywords='some keywords',
            Description='a description',
            Question=self.create_question_xml(),
        )
        return response
Run Code Online (Sandbox Code Playgroud)

Man*_*ro1 5

为什么不简单地将 XML 数据放在一个单独的 XML 文件中(如您所做的,但已注释掉)?这将使您不必合并多个模块和大量代码。

使用您在此处描述的模板,创建question.xml

<HTMLQuestion xmlns="http://mechanicalturk.amazonaws.com/AWSMechanicalTurkDataSchemas/2011-11-11/HTMLQuestion.xsd">
  <HTMLContent><![CDATA[
<!DOCTYPE html>
<html>
 <head>
  <meta http-equiv='Content-Type' content='text/html; charset=UTF-8'/>
  <script type='text/javascript' src='https://s3.amazonaws.com/mturk-public/externalHIT_v1.js'></script>
 </head>
 <body>
  <form name='mturk_form' method='post' id='mturk_form' action='https://www.mturk.com/mturk/externalSubmit'>
  <input type='hidden' value='' name='assignmentId' id='assignmentId'/>
  <h1>Answer this question</h1>
  <p>{question}</p>
  <p><textarea name='comment' cols='80' rows='3'></textarea></p>
  <p><input type='submit' id='submitButton' value='Submit' /></p></form>
  <script language='Javascript'>turkSetAssignmentID();</script>
 </body>
</html>
]]>
  </HTMLContent>
  <FrameHeight>450</FrameHeight>
</HTMLQuestion>
Run Code Online (Sandbox Code Playgroud)

然后在你的create_question_xml()函数中:

def create_question_xml(self):
    question_file = open("question.xml", "r").read()
    xml = question_file.format(question=self.question)
    return xml
Run Code Online (Sandbox Code Playgroud)

这应该就是你所需要的。