ZeroMQ挂在python多处理类/对象解决方案中

Question

我正在尝试在Python（pyzmq）中将ZeroMQ与多处理一起使用。作为一个最小的（不可行的）示例，我有一个服务器类和一个客户端类，它们都继承自multiprocessing.Process。客户端作为子进程应向服务器子进程发送一条消息，该进程应打印该消息：

#mpzmq_class.py

from multiprocessing import Process
import zmq


class Server(Process):
    def __init__(self):
        super(Server, self).__init__()
        self.ctx = zmq.Context()
        self.socket = self.ctx.socket(zmq.PULL)
        self.socket.connect("tcp://localhost:6068")

    def run(self):
        msg = self.socket.recv_string()
        print(msg)


class Client(Process):
    def __init__(self):
        super(Client, self).__init__()
        self.ctx = zmq.Context()
        self.socket = self.ctx.socket(zmq.PUSH)
        self.socket.bind("tcp://*:6068")

    def run(self):
        msg = "Hello World!"
        self.socket.send_string(msg)

if __name__ == "__main__":
    s = Server()
    c = Client()
    s.start()
    c.start()
    s.join()
    c.join()

现在，如果运行此命令，服务器进程似乎会挂在receive-call上msg = socket.receive_string()。在另一个（更复杂的）情况下，它甚至挂在- socket.connect("...")语句上。

如果我重写脚本以使用函数而不是类/对象，那么它将运行良好：

# mpzmq_function.py

from multiprocessing import Process
import zmq


def server():
    ctx = zmq.Context()
    socket = ctx.socket(zmq.PULL)
    socket.connect("tcp://localhost:6068")
    msg = socket.recv_string()
    print(msg)


def client():
    ctx = zmq.Context()
    socket = ctx.socket(zmq.PUSH)
    socket.bind("tcp://*:6068")
    msg = "Hello World!"
    socket.send_string(msg)

if __name__ == "__main__":
    s = Process(target=server)
    c = Process(target=client)
    s.start()
    c.start()
    s.join()
    c.join()

输出：

paul@AP-X:~$ python3 mpzmq_function.py 
Hello World!

有人可以帮我吗？我想这是我对多处理的使用不了解的东西。

谢谢！

Answer 1

我遇到了同样的问题。我想问题是，run方法无法访问上下文对象。可能与C实现有关，并且事实是进程没有共享内存。如果在run方法中实例化上下文，它将起作用。

这是一个工作示例：

#mpzmq_class.py

from multiprocessing import Process
import zmq


class Base(Process):
    """
    Inherit from Process and
    holds the zmq address.
    """
    def __init__(self, address):
        super().__init__()
        self.address = address


class Server(Base):
    def run(self):
        ctx = zmq.Context()
        socket = ctx.socket(zmq.PULL)
        socket.connect(self.address)
        msg = socket.recv_string()
        print(msg)


class Client(Base):
    def run(self):
        ctx = zmq.Context()
        socket = ctx.socket(zmq.PUSH)
        socket.bind(self.address)
        msg = "Hello World!"
        socket.send_string(msg)


if __name__ == "__main__":
    server_addr = "tcp://127.0.1:6068"
    client_addr = "tcp://*:6068"
    s = Server(server_addr)
    c = Client(client_addr)
    s.start()
    c.start()
    s.join()
    c.join()

我添加了一个基类，以演示您仍然可以从run方法访问普通的Python对象。如果将上下文对象放入init方法中，它将无法正常工作。