从位置0开始的行中的JSON解析错误:.行大小大于:2097152

Question

我们尝试从GoogleCloudStorage上传文件,但收到了类似的错误

从位置0开始的行中的JSON解析错误:.行大小大于:2097152.(错误代码:无效)`.一万个客户数据存储在线上.

[{"user_id":1,"address": "london", "birthday":xxxx},{"user_id":2,"address": "london", "birthday":xxxx},{"user_id":3,"address": "NY", "birthday":xxxx},....{"user_id":10000,"address": "NY", "birthday":xxxx}]

Answer 1

为了将JSON从GCS加载到GBQ,您应该将数据转换为如下所示,每个用户信息都在单独的行中 - 这将解决行大小限制并符合newline delimited JSON要求 - 请参阅有关支持的JSON格式的更多信息

{"user_id":1,"address": "london", "birthday":xxxx}
{"user_id":2,"address": "london", "birthday":xxxx}
{"user_id":3,"address": "NY", "birthday":xxxx}
....
{"user_id":10000,"address": "NY", "birthday":xxxx}