How to install pyzmq on a Alpine Linux container?

前端 未结 3 2086
鱼传尺愫
鱼传尺愫 2021-02-10 03:49

I have a container with python:3.6-alpine kernel, I have a problem to install the pyzmq with pip on this:

Dockerfile:

相关标签:
3条回答
  • 2021-02-10 03:56

    Thanks @hoefling, I fixed this dependency problem with install py3-pyzmq package first on Alpine Linux v3.12.

    1. Run the docker container of Alpine 3.12.

      [ chusiang@macOS-11.0.1 ~ ]
      $ docker run -it --rm alpine:3 sh
      
    2. Install the apk package of py3-pyzmq.

      /home # apk add py3-pyzmq
      (1/3) Installing libsodium (1.0.18-r0)
      (2/3) Installing libzmq (4.3.3-r0)
      (3/3) Installing py3-pyzmq (18.1.1-r0)
      OK: 385 MiB in 97 packages
      
    3. Install pip3 package of jupyter notebook.

      /home # pip3 install jupyter
      
    4. DONE !

      /home #  jupyter --version
      jupyter core     : 4.7.0
      jupyter-notebook : 6.1.5
      qtconsole        : 5.0.1
      ipython          : 7.19.0
      ipykernel        : 5.4.1
      jupyter client   : 6.1.7
      jupyter lab      : not installed
      nbconvert        : 6.0.7
      ipywidgets       : 7.5.1
      nbformat         : 5.0.8
      traitlets        : 5.0.5
      

    By the way, I reference this post to upgrade the Python 2 -> 3 on my docker image project of "ansible-jupyter".

    https://github.com/chusiang/ansible-jupyter.dockerfile/commit/200c9a48232b0149adb85fa9e5fc025730691599

    0 讨论(0)
  • 2021-02-10 04:03

    Using py3-zmq package

    From my experience, python:3.6-alpine is not well suited for installing packages with C extensions because of missing Python headers. The alpine images already offer a Python 3.6 distribution and also a precompiled pyzmq package, so it's already sufficient to do:

    FROM alpine:edge
    
    RUN apk update && apk add py3-zmq
    
    CMD ["/bin/sh"]
    

    Check:

    $ docker run --rm -it my/alpine /bin/sh
    / # python3 -c "import zmq; print(zmq.__version__)"
    17.1.0
    

    This is the easiest and most reliable way to install pyzmq in an Alpine container.

    Building from source with pip install

    Alpine is not manylinux1-compatible, so any package containing C extensions must be built from source. This means you have to install the build tools first. Again, I'd use alpine image instead of python:3.6-alpine:

    FROM alpine:edge
    
    RUN apk update && apk add build-base libzmq musl-dev python3 python3-dev zeromq-dev
    
    RUN pip3 install pyzmq
    
    # reduce image size by cleaning up the build packages
    RUN apk del build-base musl-dev python3-dev zeromq-dev
    
    CMD ["/bin/sh"]
    

    Check:

    $ docker run --rm -it my/alpine /bin/sh
    / # python3 -c "import zmq; print(zmq.__version__)"
    17.1.0
    

    If you insist on python:3.6-alpine

    Beware that python:3.6-alpine does not install Python via apk, it has Python built from source and located under /usr/local. So when you inherit from python:3.6-alpine, install python3-dev and run pip install pyzmq, you'll end up with building pyzmq for Python 3.6.6 (coming from python:3.6-alpine) using header files from Python 3.6.4 (coming from apk add python3-dev). In general, this shouldn't be an issue (header files are incompatible only between major Python releases), but may become an issue in case the header files were adapted by the distro maintainer.

    Edit: exact steps to reproduce, with log

    $ docker image rm my/alpine:latest
    Untagged: my/alpine:latest
    Deleted: sha256:2e613cdc3c90c9d44b23d399bd44069217e5b31c1b4a8fc91e501c5226a4ef6a
    Deleted: sha256:d66ac6c96a4fca9c4fe71a73b64a4dd3605a59e570f327974954649b633a7fc5
    Deleted: sha256:114efba5527eb4ab23020ef84b6181b6a6ba790059b83ce046c9a1a6c0bdf419
    
    $ docker image prune
    WARNING! This will remove all dangling images.
    Are you sure you want to continue? [y/N] y
    Deleted Images:
    untagged: alpine@sha256:79c2c5f6db53da44f90bb2731f29f725b5b14c378407a123776b6d3c76e6aebe
    untagged: alpine@sha256:ae8a1f9146d74466ddf1def02088ba33544db9aceef01f4b388c674a5ad1d00b
    deleted: sha256:5c4fa780951b060bb0a75355765bc58112350d9974970d60561671d552aaf2e2
    deleted: sha256:c9e8b5c053a2dda62373bc57fa8cb634230a92ba5f02d2baf5d35b932d04a878
    
    Total reclaimed space: 4.148MB
    
    $ cat ./Dockerfile
    FROM alpine:edge
    
    RUN apk update && apk add py3-zmq
    
    CMD ["/bin/sh"]
    
    $ docker pull alpine:edge
    edge: Pulling from library/alpine
    a0710691c81a: Pull complete
    Digest: sha256:8d9872bf7dc946db1b3cd2bf70752f59085ec3c5035ca1d820d30f1d1267d65d
    Status: Downloaded newer image for alpine:edge
    
    $ docker build -t my/alpine .
    Sending build context to Docker daemon  3.072kB
    Step 1/3 : FROM alpine:edge
     ---> 9d1f27787d39
    Step 2/3 : RUN apk update && apk add py3-zmq
     ---> Running in 0f9bd971b5da
    fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz
    fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
    v3.8.0-1447-g6c9915aaa5 [http://dl-cdn.alpinelinux.org/alpine/edge/main]
    v3.8.0-1459-g2ff55fde23 [http://dl-cdn.alpinelinux.org/alpine/edge/community]
    OK: 9626 distinct packages available
    (1/16) Installing libbz2 (1.0.6-r6)
    (2/16) Installing expat (2.2.5-r0)
    (3/16) Installing libffi (3.2.1-r4)
    (4/16) Installing gdbm (1.13-r1)
    (5/16) Installing xz-libs (5.2.4-r0)
    (6/16) Installing ncurses-terminfo-base (6.1-r0)
    (7/16) Installing ncurses-terminfo (6.1-r0)
    (8/16) Installing ncurses-libs (6.1-r0)
    (9/16) Installing readline (7.0.003-r0)
    (10/16) Installing sqlite-libs (3.24.0-r1)
    (11/16) Installing python3 (3.6.4-r1)
    (12/16) Installing libgcc (6.4.0-r8)
    (13/16) Installing libsodium (1.0.16-r0)
    (14/16) Installing libstdc++ (6.4.0-r8)
    (15/16) Installing libzmq (4.2.3-r0)
    (16/16) Installing py3-zmq (17.1.0-r0)
    Executing busybox-1.28.4-r0.trigger
    OK: 69 MiB in 29 packages
    Removing intermediate container 0f9bd971b5da
     ---> 83a4db72581d
    Step 3/3 : CMD ["/bin/sh"]
     ---> Running in b37e3ef8e639
    Removing intermediate container b37e3ef8e639
     ---> 558bd6427c77
    Successfully built 558bd6427c77
    Successfully tagged my/alpine:latest
    
    $ docker run --rm -it my/alpine python3 -c "import zmq; print(zmq.__version__)"
    17.1.0
    
    0 讨论(0)
  • 2021-02-10 04:10

    Check if this works better with python 3.7, as mentioned in zeromq/pyzmq issue 1050

    The .c files were generated with Cython. It would appear that Python 3.7 has changed its C API, such that the .c files are no longer compatible with Python 3.7. We'll need to wait for a Cython release that fixes support for unreleased Python before we can use it.

    0 讨论(0)
提交回复
热议问题