小编dev*_*evv的帖子

为什么增加工人数量(超过核心数量)仍然会减少执行时间?

我始终确信没有必要拥有比CPU内核更多的线程/进程(从性能角度来看).但是,我的python示例显示了不同的结果.

import concurrent.futures
import random
import time


def doSomething(task_num):
    print("executing...", task_num)
    time.sleep(1)  # simulate heavy operation that takes ~ 1 second    
    return random.randint(1, 10) * random.randint(1, 500)  # real operation, used random to avoid caches and so on...


def main():
    # This part is not taken in consideration because I don't want to
    # measure the worker creation time
    executor = concurrent.futures.ProcessPoolExecutor(max_workers=60)

    start_time = time.time()

    for i in range(1, 100): # execute 100 tasks
        executor.map(doSomething, [i, ])
    executor.shutdown(wait=True)

    print("--- %s …
Run Code Online (Sandbox Code Playgroud)

python parallel-processing multithreading multiprocessing

1
推荐指数
1
解决办法
741
查看次数