相关疑难解决方法(0)

783
推荐指数
17
解决办法
54万
查看次数

从 AWS S3 下载文件时的文件编码问题

我在 AWS S3 中有一个 CSV 文件,我试图在本地临时文件中打开它。这是代码:

s3 = Aws::S3::Resource.new
bucket = s3.bucket({bucket name})
obj = bucket.object({object key})
temp = Tempfile.new('temp.csv')
obj.get(response_target: temp)
Run Code Online (Sandbox Code Playgroud)

它从 AWS 中提取文件并将其加载到名为“temp.csv”的新临时文件中。对于某些文件,该obj.get(..)行会引发以下错误:

WARN: Encoding::UndefinedConversionError: "\xEF" from ASCII-8BIT to UTF-8
WARN: /Users/.rbenv/versions/2.5.0/lib/ruby/2.5.0/delegate.rb:349:in `write'
/Users/.rbenv/versions/2.5.0/lib/ruby/2.5.0/delegate.rb:349:in `block in delegating_block'
/Users/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/aws-sdk-core-3.21.2/lib/seahorse/client/http/response.rb:62:in `signal_data'
/Users/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/aws-sdk-core-3.21.2/lib/seahorse/client/net_http/handler.rb:83:in `block (3 levels) in transmit'
...
/Users/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/aws-sdk-s3-1.13.0/lib/aws-sdk-s3/client.rb:2666:in `get_object'
/Users/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/aws-sdk-s3-1.13.0/lib/aws-sdk-s3/object.rb:657:in `get'
Run Code Online (Sandbox Code Playgroud)

Stacktrace 显示错误最初是由.get适用于 Ruby 的 AWS 开发工具包抛出的。

我尝试过的事情:

将文件(对象)上传到 AWS S3 时,您可以指定content_encoding,因此我尝试将其设置为 UTF-8:

obj.upload_file({file path}, content_encoding: 'utf-8')
Run Code Online (Sandbox Code Playgroud)

此外,当您打电话时,.get您可以设置response_content_encoding

obj.get(response_target: …
Run Code Online (Sandbox Code Playgroud)

ruby amazon-s3 amazon-web-services aws-sdk-ruby

4
推荐指数
1
解决办法
6195
查看次数