this post was submitted on 02 Nov 2024
30 points (94.1% liked)

Linux

48684 readers
702 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
 
marty@Marty-PC:~/git/exllama$ pip install numpy
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.
    
    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.
    
    If you wish to install a non-Debian packaged Python application,
    it may be easiest to use pipx install xyz, which will manage a
    virtual environment for you. Make sure you have pipx installed.
    
    See /usr/share/doc/python3.12/README.venv for more information.

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.

I get this error every time I try install any kind of python package. So far, I always just used the --break-system-packages flag, but that seems, well, rather unsafe and breaking.

To this day, I see newly written guides, specifically for Linux, which don't point out this behaviour. They just say [...] And then install this python package with 'pip install numpy'

Is this something specific to my system, or is this a global thing?

all 14 comments
sorted by: hot top controversial new old
[–] [email protected] 18 points 1 month ago

I think the error is quite verbose and tells you everything you need to know.

Generally, do not install packages outside of a virtual environment unless you know what you're doing. Given the option, use your package manager version of the same package. Outside of that, use your python environment manager of choice to install stuff. There are lots of options: conda, uv, venv, virtualenv, pipenv, etc.

The error exists to warn you that you could potentially break critical system installed packages by installing other things at a user or system level with pip.

[–] [email protected] 16 points 1 month ago* (last edited 1 month ago)

The error message is very detailed and there is nothing to add to it.

If you want to install an application/CLI tool, use pipx or your system package manager. If you want to install a library, use a virtual environment (e.g. by using python -m venv) or your system package manager.

[–] [email protected] 8 points 1 month ago (1 children)

I always create a virtual environment for each project I run like that. This way you can have your own versions of packages for each project without them interfearing with each other. This is also what the error message sugests in the beginning, so if you have the time I would investigate it and learn about it: https://python.land/virtual-environments/virtualenv

[–] [email protected] 1 points 1 month ago (1 children)

Is there a reason windows users don't get this error?

[–] [email protected] 9 points 1 month ago

Python is used extensively in Linux distributions and in some or a lot of cases for distribution package management. In order to avoid breaking your 'externally managed' system pip is warning you and providing an easy to use method for using it and any packages you install through it.

[–] [email protected] 7 points 1 month ago (1 children)

It's mostly Debian-focused, but you should probably use venvs. They allow you to have different versions of Python packages for different applications. I especially like it when using it in combination with pythonz for applications that require a different version than the system Python.

I find they prevent the system Python from being a complete pile of anarchy.

Like others have said, the error tells you everything you need to know.

[–] [email protected] 1 points 1 month ago (1 children)

Reading the GitHub page for pythonz makes it seem a little easier to get into than pyenv. I think that might just be documentation learning curve though. Have you tried both?

[–] [email protected] 2 points 1 month ago

I haven't used both.

[–] [email protected] 6 points 1 month ago* (last edited 1 month ago)

A good amount of distros actively have this functionality. To avoid breaking system packages, you can install the distro package for the given module or as the error recommends: use a venv for the given project.

As to why many guides don't include it, I suspect as typical for many Linux-centric articles: they weren't been written by knowledgeable individuals or just in general are writing with knowledge that is often 5+ years out of date.

[–] [email protected] 5 points 1 month ago

In some Linux distributions it blocks you from installing system packages via pip, often there are then packages which can be installed via your distros package manager.

With arch for example:

sudo pacman -S python-'package'

Or, as others mentioned using venv.

[–] [email protected] 3 points 1 month ago

If you want access to it at system-level, you can use pip install --user .... If you run scripts as your user it'll be as if it was installed as a system package.

Only use that if it's something you use to manage your system. If you're using this as a development environment, use venvs.

[–] [email protected] 1 points 1 month ago

Have you tried what the message tells you?

[–] [email protected] 0 points 1 month ago* (last edited 1 month ago)

If you're tired of python's and venv issues, give miniconda a try. It solved most of my issues with dependencies and different python version in scripts.

It's probably a skill issue regarding to pip/pipx/venv... But miniconda really made everything easier.