Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stop installing <PROJECT>_PIP_REQUIREMENTS into system Python with run-task #381

Open
ahal opened this issue Dec 6, 2023 · 0 comments
Open

Comments

@ahal
Copy link
Collaborator

ahal commented Dec 6, 2023

When a repo sets the <PROJECT>_PIP_REQUIREMENTS variable, run-task will automatically install the requirements file after cloning the repo. This is primarily used for bootstrapping Taskgraph in the Decision task, but can also be used for other things.

We recently upgraded the image to Debian 12, which includes Python 3.11. This version of Python fails when you attempt to pip install into the system Python:

[pip-install 2023-12-05T21:39:50.324Z] × This environment is externally managed
[pip-install 2023-12-05T21:39:50.324Z] ╰─> To install Python packages system-wide, try apt install
[pip-install 2023-12-05T21:39:50.324Z]     python3-xyz, where xyz is the package you are trying to
[pip-install 2023-12-05T21:39:50.324Z]     install.
[pip-install 2023-12-05T21:39:50.324Z]     
[pip-install 2023-12-05T21:39:50.324Z]     If you wish to install a non-Debian-packaged Python package,
[pip-install 2023-12-05T21:39:50.324Z]     create a virtual environment using python3 -m venv path/to/venv.
[pip-install 2023-12-05T21:39:50.324Z]     Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
[pip-install 2023-12-05T21:39:50.324Z]     sure you have python3-full installed.
[pip-install 2023-12-05T21:39:50.324Z]     
[pip-install 2023-12-05T21:39:50.324Z]     If you wish to install a non-Debian packaged Python application,
[pip-install 2023-12-05T21:39:50.324Z]     it may be easiest to use pipx install xyz, which will manage a
[pip-install 2023-12-05T21:39:50.324Z]     virtual environment for you. Make sure you have pipx installed.
[pip-install 2023-12-05T21:39:50.324Z]     
[pip-install 2023-12-05T21:39:50.324Z]     See /usr/share/doc/python3.11/README.venv for more information.

We'll work around this by passing --break-system-packages for now (this is probably fine anyway, especially with Docker). But it highlights some poor behaviour. It would be better to create a virtualenv first or use a non-system Python (perhaps installed via pyenv).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant