小编Thr*_*y J的帖子

将文档插入MongoDB上的集合时,如何处理文档大小超过16MB的错误

任何人都可以建议将文档插入MongoDB上的集合时,如何处理文档大小超过16MB的错误。我有一些像GridFS这样的解决方案。通过使用GridsFS可以解决此问题,但是我需要不使用GridFS的解决方案。有什么方法可以缩小文档或将其拆分为子文档。如果是,我们如何实现?

from pymongo import MongoClient

conn = MongoClient("mongodb://sample_mongo:27017")
db_conn = conn["test"]
db_collection = db_conn["sample"]

# the size of record is 23MB

record = { \
    "name": "drugs",
    "collection_id": 23,
    "timestamp": 1515065002,
    "tokens": [], # contains list of strings
    "tokens_missing": [], # contains list of strings
    "token_mapping": {} # Dictionary contains transformed tokens
 }

db_collection.insert(record, check_keys=False)
Run Code Online (Sandbox Code Playgroud)

我收到错误DocumentTooLarge:BSON文档太大。在MongoDB中,最大的BSON文档大小为16 MB。

  File "/usr/local/lib/python2.7/dist-packages/pymongo-3.5.1-py2.7-linux-x86_64.egg/pymongo/collection.py", line 2501, in insert
check_keys, manipulate, write_concern)
  File "/usr/local/lib/python2.7/dist-packages/pymongo-3.5.1-py2.7-linux-x86_64.egg/pymongo/collection.py", line 575, in _insert
check_keys, manipulate, write_concern, op_id, bypass_doc_val)
  File …
Run Code Online (Sandbox Code Playgroud)

mongodb python-2.7

5
推荐指数
1
解决办法
1325
查看次数

标签 统计

mongodb ×1

python-2.7 ×1