任何人都可以建议将文档插入MongoDB上的集合时,如何处理文档大小超过16MB的错误。我有一些像GridFS这样的解决方案。通过使用GridsFS可以解决此问题,但是我需要不使用GridFS的解决方案。有什么方法可以缩小文档或将其拆分为子文档。如果是,我们如何实现?
from pymongo import MongoClient
conn = MongoClient("mongodb://sample_mongo:27017")
db_conn = conn["test"]
db_collection = db_conn["sample"]
# the size of record is 23MB
record = { \
"name": "drugs",
"collection_id": 23,
"timestamp": 1515065002,
"tokens": [], # contains list of strings
"tokens_missing": [], # contains list of strings
"token_mapping": {} # Dictionary contains transformed tokens
}
db_collection.insert(record, check_keys=False)
Run Code Online (Sandbox Code Playgroud)
我收到错误DocumentTooLarge:BSON文档太大。在MongoDB中,最大的BSON文档大小为16 MB。
File "/usr/local/lib/python2.7/dist-packages/pymongo-3.5.1-py2.7-linux-x86_64.egg/pymongo/collection.py", line 2501, in insert
check_keys, manipulate, write_concern)
File "/usr/local/lib/python2.7/dist-packages/pymongo-3.5.1-py2.7-linux-x86_64.egg/pymongo/collection.py", line 575, in _insert
check_keys, manipulate, write_concern, op_id, bypass_doc_val)
File …Run Code Online (Sandbox Code Playgroud)