如何将AWS Kinesis Firehose格式的记录格式化为Redshift？

Question

考虑以下:

• Redshift中的一个名为"people"的表,其中包含字段ID,名称和年龄
• 名为'people'的kinesis firehose流,配置为写入'people'表,'Redshift table columns'的值为'id,name,age'

目前尚不清楚如何格式化'数据'blob.以下是使用制表符分隔的数据代码的示例:

let AWS = require('aws-sdk');
let firehose = new AWS.Firehose();
let params = {
  DeliveryStreamName: 'people',
  // id,name,age
  Records: [{Data: '4ccf6d3a-acdf-11e5-ad54-28cfe91fa8f1\tBob\tSmith'}]
};
firehose.putRecordBatch(params, (err, result) => {
  console.log(err || result);
});

以下是我检查过的一些文档:

• http://docs.aws.amazon.com/firehose/latest/APIReference/API_PutRecordBatch.html
• http://docs.aws.amazon.com/firehose/latest/dev/writing-with-sdk.html
• http://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/Firehose.html#putRecordBatch-property

Answer 1

答案在这里:

http://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-data-format.html

字段必须是管道'|' 默认分开.行应该用新行分隔.

更新的更正代码:

let AWS = require('aws-sdk');
let firehose = new AWS.Firehose();
let params = {
  DeliveryStreamName: 'people',
  // id,name,age
  Records: [{Data: '4ccf6d3a-acdf-11e5-ad54-28cfe91fa8f1|Bob|Smith\n'}]
};
firehose.putRecordBatch(params, (err, result) => {
  console.log(err || result);
});