那些遇到过的问题

在 pip install 上运行 Makefile

Jos*_*osh 6 python makefile pip

我有一些协议缓冲区定义需要作为pip install过程的一部分构建到 Python 源代码中。我已经对setuptools.command.install命令进行了子类化，setup.py但我认为它会在安装包后尝试运行 Makefile，因此无法识别源。

我找不到有关 pip 安装期间发生的情况的信息。任何人都可以发光吗？

设置.py：

import subprocess
import sys

from setuptools import setup
from setuptools.command.install import install

class Install(install):
    """Customized setuptools install command - builds protos on install."""
    def run(self):
        protoc_command = ["make", "python"]
        if subprocess.call(protoc_command) != 0:
            sys.exit(-1)
        install.run(self)


setup(
    name='myprotos',
    version='0.0.1',
    description='Protocol Buffers.',
    install_requires=[],
    cmdclass={
        'install': Install,
    }
)
Run Code Online (Sandbox Code Playgroud)

的输出$ pip install -vvv .：

Processing /path/to/myprotos
  Running setup.py (path:/private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build/setup.py) egg_info for package from file:///path/to/myprotos
    Running command python setup.py egg_info
    running egg_info
    creating pip-egg-info/myprotos.egg-info
    writing pip-egg-info/myprotos.egg-info/PKG-INFO
    writing top-level names to pip-egg-info/myprotos.egg-info/top_level.txt
    writing dependency_links to pip-egg-info/myprotos.egg-info/dependency_links.txt
    writing manifest file 'pip-egg-info/myprotos.egg-info/SOURCES.txt'
    reading manifest file 'pip-egg-info/myprotos.egg-info/SOURCES.txt'
    writing manifest file 'pip-egg-info/myprotos.egg-info/SOURCES.txt'
  Source in /private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build has version 0.0.1, which satisfies requirement myprotos==0.0.1 from file:///path/to/myprotos
Building wheels for collected packages: myprotos
  Running setup.py bdist_wheel for myprotos: started
  Destination directory: /var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/tmpD7dfGKpip-wheel-
  Running command /usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/tmpD7dfGKpip-wheel- --python-tag cp27
  running bdist_wheel
  running build
  installing to build/bdist.macosx-10.12-x86_64/wheel
  running install

  # THIS IS MY MAKEFILE RUNNING
  Grabbing github.com/google/protobuf...
  Building Python protos...
  # MAKEFILE COMPLETE

  running install_egg_info
  running egg_info
  creating myprotos.egg-info
  writing myprotos.egg-info/PKG-INFO
  writing top-level names to myprotos.egg-info/top_level.txt
  writing dependency_links to myprotos.egg-info/dependency_links.txt
  writing manifest file 'myprotos.egg-info/SOURCES.txt'
  reading manifest file 'myprotos.egg-info/SOURCES.txt'
  writing manifest file 'myprotos.egg-info/SOURCES.txt'
  Copying myprotos.egg-info to build/bdist.macosx-10.12-x86_64/wheel/myprotos-0.0.1-py2.7.egg-info
  running install_scripts
  creating build/bdist.macosx-10.12-x86_64/wheel/myprotos-0.0.1.dist-info/WHEEL
  Running setup.py bdist_wheel for myprotos: finished with status 'done'
  Stored in directory: /Users/jds/Library/Caches/pip/wheels/92/0b/37/b5a50146994bc0b6774407139f01d648ba3a9b4853d2719c51
  Removing source in /private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build
Successfully built myprotos
Installing collected packages: myprotos
  Found existing installation: myprotos 0.0.1
    Uninstalling myprotos-0.0.1:
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/DESCRIPTION.rst
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/INSTALLER
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/METADATA
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/RECORD
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/WHEEL
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/metadata.json
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/top_level.txt
      Successfully uninstalled myprotos-0.0.1

Successfully installed myprotos-0.0.1
Cleaning up...
Run Code Online (Sandbox Code Playgroud)

我的 Makefile 是否应该在生成源文件的过程中尽早运行？egg_info例如，在运行之前文件是否需要在那里？

如果我手动运行 Makefile 然后安装包，那么它就可以工作了。

更新

这是我的项目的结构：

import subprocess
import sys

from setuptools import setup
from setuptools.command.install import install

class Install(install):
    """Customized setuptools install command - builds protos on install."""
    def run(self):
        protoc_command = ["make", "python"]
        if subprocess.call(protoc_command) != 0:
            sys.exit(-1)
        install.run(self)


setup(
    name='myprotos',
    version='0.0.1',
    description='Protocol Buffers.',
    install_requires=[],
    cmdclass={
        'install': Install,
    }
)
Run Code Online (Sandbox Code Playgroud)

下面是从 Potocol 缓冲区定义生成 Python 源代码的 Makefile 部分：

Processing /path/to/myprotos
  Running setup.py (path:/private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build/setup.py) egg_info for package from file:///path/to/myprotos
    Running command python setup.py egg_info
    running egg_info
    creating pip-egg-info/myprotos.egg-info
    writing pip-egg-info/myprotos.egg-info/PKG-INFO
    writing top-level names to pip-egg-info/myprotos.egg-info/top_level.txt
    writing dependency_links to pip-egg-info/myprotos.egg-info/dependency_links.txt
    writing manifest file 'pip-egg-info/myprotos.egg-info/SOURCES.txt'
    reading manifest file 'pip-egg-info/myprotos.egg-info/SOURCES.txt'
    writing manifest file 'pip-egg-info/myprotos.egg-info/SOURCES.txt'
  Source in /private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build has version 0.0.1, which satisfies requirement myprotos==0.0.1 from file:///path/to/myprotos
Building wheels for collected packages: myprotos
  Running setup.py bdist_wheel for myprotos: started
  Destination directory: /var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/tmpD7dfGKpip-wheel-
  Running command /usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/tmpD7dfGKpip-wheel- --python-tag cp27
  running bdist_wheel
  running build
  installing to build/bdist.macosx-10.12-x86_64/wheel
  running install

  # THIS IS MY MAKEFILE RUNNING
  Grabbing github.com/google/protobuf...
  Building Python protos...
  # MAKEFILE COMPLETE

  running install_egg_info
  running egg_info
  creating myprotos.egg-info
  writing myprotos.egg-info/PKG-INFO
  writing top-level names to myprotos.egg-info/top_level.txt
  writing dependency_links to myprotos.egg-info/dependency_links.txt
  writing manifest file 'myprotos.egg-info/SOURCES.txt'
  reading manifest file 'myprotos.egg-info/SOURCES.txt'
  writing manifest file 'myprotos.egg-info/SOURCES.txt'
  Copying myprotos.egg-info to build/bdist.macosx-10.12-x86_64/wheel/myprotos-0.0.1-py2.7.egg-info
  running install_scripts
  creating build/bdist.macosx-10.12-x86_64/wheel/myprotos-0.0.1.dist-info/WHEEL
  Running setup.py bdist_wheel for myprotos: finished with status 'done'
  Stored in directory: /Users/jds/Library/Caches/pip/wheels/92/0b/37/b5a50146994bc0b6774407139f01d648ba3a9b4853d2719c51
  Removing source in /private/var/folders/3t/4qwkfyr903d0b7db7by2kj6r0000gn/T/pip-jpgCby-build
Successfully built myprotos
Installing collected packages: myprotos
  Found existing installation: myprotos 0.0.1
    Uninstalling myprotos-0.0.1:
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/DESCRIPTION.rst
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/INSTALLER
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/METADATA
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/RECORD
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/WHEEL
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/metadata.json
      Removing file or directory /usr/local/lib/python2.7/site-packages/myprotos-0.0.1.dist-info/top_level.txt
      Successfully uninstalled myprotos-0.0.1

Successfully installed myprotos-0.0.1
Cleaning up...
Run Code Online (Sandbox Code Playgroud)

Nil*_*ner 6

好的，您需要在这里更改三件事：

  1. 添加Makefile和document.proto到一个新文件MANIFEST.in。

     Makefile
 document.proto
    Run Code Online (Sandbox Code Playgroud)

    如果这样做，.zip由python setup.py sdist（也上传到 PyPI）创建的文件将包含这些文件。

  2. 您需要make在 期间python setup.py build而不是在 期间运行您的命令install。由于您正在生成 Python 代码，因此您需要在build_py此处更改命令：

     import sys
 import subprocess

 from setuptools import setup
 from setuptools.command.build_py import build_py

 class Build(build_py):
     """Customized setuptools build command - builds protos on build."""
     def run(self):
         protoc_command = ["make", "python"]
         if subprocess.call(protoc_command) != 0:
             sys.exit(-1)
         build_py.run(self)


 setup(
     name='buildtest',
     version='1.0',
     description='Python Distribution Utilities',
     packages=['buildtest'],
     cmdclass={
         'build_py': Build,
     }
 )
    Run Code Online (Sandbox Code Playgroud)

    如果您Makefile 生成的机器代码，即来自 C 或任何其他编译语言，您应该更改build_ext命令：

     import sys
 import subprocess

 from setuptools import setup
 from setuptools.command.build_ext import build_ext

 class Build(build_ext):
     """Customized setuptools build command - builds protos on build."""
     def run(self):
         protoc_command = ["make", "python"]
         if subprocess.call(protoc_command) != 0:
             sys.exit(-1)
         build_ext.run(self)


 setup(
     name='buildtest',
     version='1.0',
     description='Python Distribution Utilities',
     packages=['buildtest'],
     has_ext_modules=lambda: True,
     cmdclass={
         'build_ext': Build,
     }
 )
    Run Code Online (Sandbox Code Playgroud)

  3. 最后，你需要告诉setuptools其上安装所产生的包install通过定义属性packages中setup()：

     setup(
     ...
     packages=['myprotos']
 )
    Run Code Online (Sandbox Code Playgroud)

决定跑的原因build_py还是build_ext在于两者跑时的情况：

  • build_py在创建必须是跨平台的源分发时也会运行。编译后的扩展通常不是跨平台的，因此您无法在此步骤中对其进行编译。
  • build_ext仅在您创建特定于平台的二进制分发版时运行。在这里编译为特定于平台的机器代码是可以的。

归档时间：

查看次数：

7025 次

最近记录：

4 年，9 月 前
如何创建构建命令的子类？ 8
更多相关链接
相关归档
将浮点数转换为特定精度,然后复制到字符串 129
psycopg2:AttributeError:'module'对象没有属性'extras' 72
在DataFrame索引上应用函数 62
在python中打印数字的位表示 54
python空类对象 48
如何将变量放入Python docstring中 46
是否可以从coverage.py报告中排除测试目录？ 45
使用"make"C编程(艰难地学习C) 7
在m4的patsubst中,如何用空格替换换行符？ 3
属性文件（ini 文件）不包含在 python 包中 3
难疑归档
什么是依赖注入？ 2984
是否有唯一的Android设备ID？ 2645
我怎么知道通过jQuery选择了哪个单选按钮？ 2583
如何确定变量是"未定义"还是"空"？ 2000
SCSS和Sass有什么区别？ 1760
你如何在YAML中阻止评论？ 1272
有效地使用Git和Dropbox？ 1117
R无法解析 - Android错误 1056
#Hibernate hbm2ddl.auto配置的可能值是什么,它们做了什么 1046
如何删除选择框的所有选项,然后添加一个选项并使用jQuery选择它？ 1028