令我惊讶的是,我发现使用3.0版本与2.6.4将同一文件导入同一个MongoDB(3.0)的速度要慢得多(> 20倍).有没有人有同样的问题?以及如何解决它?
以下是详细信息:
2.6.4为同一个json文件加载大约16K行
**-logbash-3.2$ mongoimport --host mcp-mongo-dev-1201.sea2.rhapsody.com:27017 --db media
--collection media --upsert --upsertFields _id --type json --file /data/xxx.json
Run Code Online (Sandbox Code Playgroud)
connected to: mcp-mongo-dev-1201.sea2.rhapsody.com:27017
2015-10-08T15:24:02.007-0700 Progress: 8860712/5024041951 0%
2015-10-08T15:24:02.007-0700 54900 18300/second
2015-10-08T15:24:05.004-0700 Progress: 15590853/5024041951 0%
2015-10-08T15:24:05.004-0700 96900 16150/second**
Run Code Online (Sandbox Code Playgroud)这是3.0运行:
-logbash-3.2$ mongoimport30 --version
mongoimport version: 3.0.6
git version: 7588eb887549bd5d2fc7bbc08f7c62d4b29b9d75
-logbash-3.2$ mongoimport30 --host mcp-mongo-dev-1201.sea2.rhapsody.com:27017 --db media
--collection media --upsertFields _id --type json --file /data/mediaingestor2.json --numInsertionWorkers 20000 -v
Run Code Online (Sandbox Code Playgroud)
2015-10-08T15:53:04.393-0700 using upsert fields: [_id]
2015-10-08T15:53:04.393-0700 filesize: 5024041951 bytes
2015-10-08T15:53:04.393-0700 using fields:
2015-10-08T15:53:04.396-0700 connected to: mcp-mongo-dev-1201.sea2.rhapsody.com:27017
2015-10-08T15:53:04.396-0700 …Run Code Online (Sandbox Code Playgroud)