distribute

Distributing Python module - Spark vs Process Pools

由 丶灬走出姿态 提交于 2019-12-11 15:57:29
问题 I've made a Python module that extracts handwritten text from PDFs. The extraction can sometimes be quite slow (20-30 seconds per file). I have around 100,000 PDFs (some with lots of pages) and I want to run the text extraction on all of them. Essentially something like this: fileNameList = ['file1.pdf','file2.pdf',...,'file100000.pdf'] for pdf in fileList: text = myModule.extractText(pdf) # Distribute this function # Do stuff with text We used Spark once before (a coworker, not me) to

Cannot install distribute: pypi.python.org rejecting http

由 泄露秘密 提交于 2019-12-11 01:49:54
问题 This worked yesterday (I am fairly sure) and started failing only today. Any ideas/workaround on what I can do to install this package? Doing curl to fetch this URL clearly shows the server is just rejecting with " 403 SSL is required" and not even redirecting to the https:// url. # pip install hotqueue Collecting hotqueue Using cached hotqueue-0.2.7.tar.gz Complete output from command python setup.py egg_info: Downloading http://pypi.python.org/packages/source/d/distribute/distribute-0.6.14

What are the use cases for a Python distribution?

由 回眸只為那壹抹淺笑 提交于 2019-12-10 15:06:53
问题 I'm developing a distribution for the Python package I'm writing so I can post it on PyPI. It's my first time working with distutils, setuptools, distribute, pip, setup.py and all that and I'm struggling a bit with a learning curve that's quite a bit steeper than I anticipated :) I was having a little trouble getting some of my test data files to be included in the tarball by specifying them in the data_files parameter in setup.py until I came across a different post here that pointed me

How to determine the name of an egg for a Python package on Github?

由 若如初见. 提交于 2019-12-09 07:53:33
问题 I know I can install with $ pip install -e git+https://git.repo/some_pkg#egg=SomePackage but -- when I'm trying to use somebody else's package -- how do I determine what the name of the egg is? 回答1: Look at the git repo, find the setup.py file in the root and find what is passed to the name keyword in the setup() function call. For example, the Pyramid setup.py has: setup(name='pyramid', so you'd use: $ pip install -e git+https://github.com/Pylons/pyramid.git#egg=pyramid 来源： https:/

unattended install of python module .exe files

由 吃可爱长大的小学妹 提交于 2019-12-08 18:06:38
问题 I'm looking for a way to install a bunch of python modules in .exe format like: ipython-0.13.1.py2-win32-PROPER.exe scipy-0.12.0b1.win32-py2.7.exe numpy-MKL-1.7.0.win32-py2.7.exe pywin32-218.win32-py2.7.exe I can install other modules by installing distribute and call pip from command-line, but I want to know if I can automate installs of .exe files - so users don't have to click buttons of 'next' 'okay'. 回答1: well, this is indeed possible: I used distribute's easy_install and everything

Migration from distribute to setuptools

由 对着背影说爱祢 提交于 2019-12-08 10:08:55
问题 I'm trying to convert a project that I had installing fine with distribute over to a newer setuptools based installer. For some reason I can't get setuptools to run at all. When I run my setup.py I get errors from distutils about unsupported options which are all the extension options provided by setuptools. I can't figure out why setuptools isn't taking care of these correctly. This is on a Debian Wheezy system running Python 2.7. I created a simple test case to demonstrate the problem. It

.net dll version issue when replacing one dll

由 ◇◆丶佛笑我妖孽 提交于 2019-12-07 08:12:25
问题 I have the following problem. I created software, containing several projects in one solution. When I fix a bug in one of my projects which doesn't change how functions behave, (For example a simple string change, or an extra try/catch block within a function) I must recompile and provide all my dll's again, because when I only provide the changed dll, the version doesn't match. I understand that the problem is due to the fact that my dll's are strongly named. But is there any way to

can't not install Distribute, zlib

由 一世执手 提交于 2019-12-07 05:53:48
问题 At first, I only want to use install feedparser with python3.2, while it need Distribute. When I install Distribute with python3.2 setup.py install I got File "/usr/local/lib/python3.2/zipfile.py", line 687, in __init__ "Compression requires the (missing) zlib module") RuntimeError: Compression requires the (missing) zlib module Then I downloaded zlib and installed it with ./configure --prefix=/usr/local/python3.2 make sudo make install After the installation, and tried to install Distribute,

【转载】Python的包管理工具（进化关系）

由 微笑、不失礼 提交于 2019-12-06 10:19:34
刚开始学习 Python 时，发现各类文档和 Blog 中使用的包安装方式各不相同，有的使用 easy_install，setuptools，有的使用 pip，distribute，那麽这几个工具有什么关系呢，看下面这个图就明白了。 可以看出 distribute 是 setuptools 的取代，pip 是 easy_install 的取代 。 正如使用 easy_install 之前需要安装 setuptools ，pip 的使用同样需要依赖 distribute 的安装。 下面简单的介绍一下： Distribute 是对标准库 disutils 模块的增强，我们知道 disutils 主要是用来更加容易的打包和分发包，特别是对其他的包有依赖的包。 Distribute 被创建是因为 Setuptools 包不再维护了。 1.安装 Distribute 可以通过 distribute_setup.py 脚本来安装 Distribute，也可以通过 easy_install，pip，或者源文件来进行安装。不过使用 distribute_setup.py 来安装是最简单和受欢迎的方式。 $ curl -0 http://python-distribute.org/distribute_setup.py $ sudo python distribute_setup.py 2.

Heroku push rejected due to pip/distribute bug. What's the workaround?

由 人走茶凉 提交于 2019-12-05 18:42:35
My local git/virtualenv is using pip version 1.3.1. When I try to push my Python 3.3.2 app to Heroku, I get Downloading/unpacking distribute==0.6.34 (from -r requirements.txt (line 5)) Running setup.py egg_info for package distribute Traceback (most recent call last): File "<string>", line 3, in <module> File "./setuptools/__init__.py", line 2, in <module> from setuptools.extension import Extension, Library File "./setuptools/extension.py", line 5, in <module> from setuptools.dist import _get_unpatched File "./setuptools/dist.py", line 103 except ValueError, e: ^ SyntaxError: invalid syntax
订阅 distribute