小编use*_*912的帖子

mongoimport 3.0比2.6.4慢

令我惊讶的是,我发现使用3.0版本与2.6.4将同一文件导入同一个MongoDB(3.0)的速度要慢得多(> 20倍).有没有人有同样的问题?以及如何解决它?

以下是详细信息:

  1. 2.6.4为同一个json文件加载大约16K行

    **-logbash-3.2$ mongoimport --host mcp-mongo-dev-1201.sea2.rhapsody.com:27017 --db media 
            --collection media --upsert --upsertFields _id --type json --file /data/xxx.json
    
    Run Code Online (Sandbox Code Playgroud)

    connected to: mcp-mongo-dev-1201.sea2.rhapsody.com:27017
    2015-10-08T15:24:02.007-0700            Progress: 8860712/5024041951    0%
    2015-10-08T15:24:02.007-0700                    54900   18300/second
    2015-10-08T15:24:05.004-0700            Progress: 15590853/5024041951   0%
    2015-10-08T15:24:05.004-0700                    96900   16150/second**
    
    Run Code Online (Sandbox Code Playgroud)
  2. 这是3.0运行:

    -logbash-3.2$ mongoimport30 --version
    
    mongoimport version: 3.0.6
    git version: 7588eb887549bd5d2fc7bbc08f7c62d4b29b9d75
    
    -logbash-3.2$ mongoimport30 --host mcp-mongo-dev-1201.sea2.rhapsody.com:27017 --db media 
          --collection media --upsertFields _id --type json --file /data/mediaingestor2.json  --numInsertionWorkers 20000 -v
    
    Run Code Online (Sandbox Code Playgroud)

    2015-10-08T15:53:04.393-0700    using upsert fields: [_id]
    2015-10-08T15:53:04.393-0700    filesize: 5024041951 bytes
    2015-10-08T15:53:04.393-0700    using fields: 
    2015-10-08T15:53:04.396-0700    connected to: mcp-mongo-dev-1201.sea2.rhapsody.com:27017
    2015-10-08T15:53:04.396-0700 …
    Run Code Online (Sandbox Code Playgroud)

mongodb mongoimport

6
推荐指数
1
解决办法
877
查看次数

标签 统计

mongodb ×1

mongoimport ×1