pyenv/README.md

358 lines
12 KiB
Markdown
Raw Normal View History

# Simple Python Version Management: pyenv
[![Build Status](https://travis-ci.org/yyuu/pyenv.svg)](https://travis-ci.org/yyuu/pyenv)
2014-01-08 07:47:36 -05:00
pyenv lets you easily switch between multiple versions of Python. It's
simple, unobtrusive, and follows the UNIX tradition of single-purpose
tools that do one thing well.
2012-09-28 07:17:26 -04:00
This project was forked from [rbenv](https://github.com/sstephenson/rbenv) and
[ruby-build](https://github.com/sstephenson/ruby-build), and modified for Python.
2014-03-19 15:00:54 -04:00
<img src="http://gyazo.com/9c829fafdf5e58880c820349c4e9197e.png?1346414267" width="849" height="454" />
2012-08-31 07:59:24 -04:00
2012-10-02 22:31:10 -04:00
### pyenv _does..._
* Let you **change the global Python version** on a per-user basis.
* Provide support for **per-project Python versions**.
* Allow you to **override the Python version** with an environment
variable.
2012-09-03 06:40:30 -04:00
* Search commands from **multiple versions of Python at a time**.
2012-08-31 07:59:24 -04:00
This may be helpful to test across Python versions with [tox](http://pypi.python.org/pypi/tox).
2014-03-19 15:00:54 -04:00
2012-10-02 22:31:10 -04:00
### In contrast with pythonbrew and pythonz, pyenv _does not..._
2013-08-27 15:27:57 -04:00
* **Depend on Python itself.** pyenv was made from pure shell scripts.
2012-10-02 22:31:10 -04:00
There is no bootstrap problem of Python.
* **Need to be loaded into your shell.** Instead, pyenv's shim
approach works by adding a directory to your `$PATH`.
* **Manage virtualenv.** Of course, you can create [virtualenv](http://pypi.python.org/pypi/virtualenv)
yourself, or [pyenv-virtualenv](https://github.com/yyuu/pyenv-virtualenv)
2012-10-02 22:31:10 -04:00
to automate the process.
2014-03-19 15:00:54 -04:00
----
## Table of Contents
2014-03-20 09:17:53 -04:00
* **[How It Works](#how-it-works)**
2013-02-06 08:08:16 -05:00
* [Understanding PATH](#understanding-path)
* [Understanding Shims](#understanding-shims)
* [Choosing the Python Version](#choosing-the-python-version)
* [Locating the Python Installation](#locating-the-python-installation)
2014-03-20 09:17:53 -04:00
* **[Installation](#installation)**
2013-02-06 08:08:16 -05:00
* [Basic GitHub Checkout](#basic-github-checkout)
* [Upgrading](#upgrading)
2013-06-13 07:04:37 -04:00
* [Homebrew on Mac OS X](#homebrew-on-mac-os-x)
2013-02-06 08:08:16 -05:00
* [Neckbeard Configuration](#neckbeard-configuration)
* [Uninstalling Python Versions](#uninstalling-python-versions)
2014-03-20 09:17:53 -04:00
* **[Command Reference](#command-reference)**
* **[Development](#development)**
2013-02-06 08:08:16 -05:00
* [Version History](#version-history)
* [License](#license)
2014-03-19 15:00:54 -04:00
----
2013-02-06 08:08:16 -05:00
## How It Works
At a high level, pyenv intercepts Python commands using shim
executables injected into your `PATH`, determines which Python version
has been specified by your application, and passes your commands along
to the correct Python installation.
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
### Understanding PATH
When you run a command like `python` or `pip`, your operating system
searches through a list of directories to find an executable file with
that name. This list of directories lives in an environment variable
called `PATH`, with each directory in the list separated by a colon:
/usr/local/bin:/usr/bin:/bin
Directories in `PATH` are searched from left to right, so a matching
executable in a directory at the beginning of the list takes
precedence over another one at the end. In this example, the
`/usr/local/bin` directory will be searched first, then `/usr/bin`,
then `/bin`.
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
### Understanding Shims
pyenv works by inserting a directory of _shims_ at the front of your
`PATH`:
~/.pyenv/shims:/usr/local/bin:/usr/bin:/bin
Through a process called _rehashing_, pyenv maintains shims in that
directory to match every Python command across every installed version
of Python—`python`, `pip`, and so on.
Shims are lightweight executables that simply pass your command along
to pyenv. So with pyenv installed, when you run, say, `pip`, your
operating system will do the following:
* Search your `PATH` for an executable file named `pip`
* Find the pyenv shim named `pip` at the beginning of your `PATH`
* Run the shim named `pip`, which in turn passes the command along to
pyenv
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
### Choosing the Python Version
When you execute a shim, pyenv determines which Python version to use by
reading it from the following sources, in this order:
2014-03-19 15:00:54 -04:00
1. The `PYENV_VERSION` environment variable (if specified). You can use
2013-02-06 08:08:16 -05:00
the [`pyenv shell`](#pyenv-shell) command to set this environment
variable in your current shell session.
2. The application-specific `.python-version` file in the current
2014-03-19 15:00:54 -04:00
directory (if present). You can modify the current directory's
2013-02-06 08:08:16 -05:00
`.python-version` file with the [`pyenv local`](#pyenv-local)
command.
2014-03-19 15:00:54 -04:00
3. The first `.python-version` file found (if any) by searching each parent
directory, until reaching the root of your filesystem.
2013-02-06 08:08:16 -05:00
4. The global `~/.pyenv/version` file. You can modify this file using
the [`pyenv global`](#pyenv-global) command. If the global version
file is not present, pyenv assumes you want to use the "system"
2014-03-19 15:00:54 -04:00
Python. (In other words, whatever version would run if pyenv weren't in your
`PATH`.)
**NOTE:** You can activate multiple versions at the same time, e.g. `pyenv
2014-11-05 12:17:05 -05:00
global 3.4.2 2.7.8`. This allows for parallel usage of python2 and python3,
and is required with tools like `tox`.
2013-02-06 08:08:16 -05:00
### Locating the Python Installation
Once pyenv has determined which version of Python your application has
specified, it passes the command along to the corresponding Python
installation.
Each Python version is installed into its own directory under
2014-09-02 20:51:22 -04:00
`~/.pyenv/versions`.
2014-03-19 15:00:54 -04:00
For example, you might have these versions installed:
2013-02-06 08:08:16 -05:00
2014-09-11 06:56:56 -04:00
* `~/.pyenv/versions/2.7.8/`
2014-11-05 12:17:05 -05:00
* `~/.pyenv/versions/3.4.2/`
* `~/.pyenv/versions/pypy-2.4.0/`
2013-02-06 08:08:16 -05:00
2014-03-19 15:00:54 -04:00
As far as pyenv is concerned, version names are simply the directories in
2013-02-06 08:08:16 -05:00
`~/.pyenv/versions`.
2014-03-19 15:00:54 -04:00
----
2013-02-06 08:08:16 -05:00
## Installation
2014-03-20 09:17:53 -04:00
If you're on Mac OS X, consider [installing with Homebrew](#homebrew-on-mac-os-x).
2013-06-13 07:04:37 -04:00
2014-03-19 15:00:54 -04:00
### The automatic installer
Visit my other project:
https://github.com/yyuu/pyenv-installer
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
### Basic GitHub Checkout
This will get you going with the latest version of pyenv and make it
easy to fork and contribute any changes back upstream.
2014-09-02 20:51:22 -04:00
1. **Check out pyenv where you want it installed.**
2014-03-20 09:17:53 -04:00
A good place to choose is `$HOME/.pyenv` (but you can install it somewhere else).
$ git clone git://github.com/yyuu/pyenv.git ~/.pyenv
2014-03-19 15:00:54 -04:00
2. **Define environment variable `PYENV_ROOT`** to point to the path where
2014-09-02 20:51:22 -04:00
pyenv repo is cloned and add `$PYENV_ROOT/bin` to your `$PATH` for access
2014-03-20 09:17:53 -04:00
to the `pyenv` command-line utility.
$ echo 'export PYENV_ROOT="$HOME/.pyenv"' >> ~/.bash_profile
$ echo 'export PATH="$PYENV_ROOT/bin:$PATH"' >> ~/.bash_profile
**Zsh note**: Modify your `~/.zshenv` file instead of `~/.bash_profile`.
2013-09-12 20:07:40 -04:00
**Ubuntu note**: Modify your `~/.bashrc` file instead of `~/.bash_profile`.
2014-03-19 15:00:54 -04:00
3. **Add `pyenv init` to your shell** to enable shims and autocompletion.
$ echo 'eval "$(pyenv init -)"' >> ~/.bash_profile
**Zsh note**: Modify your `~/.zshenv` file instead of `~/.bash_profile`.
2013-09-12 20:07:40 -04:00
**Ubuntu note**: Modify your `~/.bashrc` file instead of `~/.bash_profile`.
2014-11-04 11:54:19 -05:00
**General warning**: There are some systems, where the `BASH_ENV` variable is configured
to point to `.bashrc`. On such systems you should almost certainly put the abovementioned line
`eval "$(pyenv init -)` into `.bash_profile`, and **not** into `.bashrc`. Otherwise you
may observe strange behaviour, such as `pyenv` getting into an infinite loop.
See [#264](https://github.com/yyuu/pyenv/issues/264) for details.
2014-09-02 20:51:22 -04:00
4. **Restart your shell so the path changes take effect.**
2014-03-20 09:17:53 -04:00
You can now begin using pyenv.
$ exec $SHELL
2014-09-02 20:51:22 -04:00
5. **Install Python versions into `$PYENV_ROOT/versions`.**
2014-09-11 06:56:56 -04:00
For example, to install Python 2.7.8, download and unpack the source, then run:
2014-09-11 06:56:56 -04:00
$ pyenv install 2.7.8
2014-03-20 09:17:53 -04:00
**NOTE:** If you need to pass configure option to build, please use
```CONFIGURE_OPTS``` environment variable.
2014-09-02 20:51:22 -04:00
**NOTE:** If you are having trouble installing a python version,
please visit the wiki page about
2014-03-20 09:17:53 -04:00
[Common Build Problems](https://github.com/yyuu/pyenv/wiki/Common-build-problems)
2014-09-02 20:51:22 -04:00
6. **Rebuild the shim binaries.**
You should do this any time you install a new Python binary.
2014-03-20 09:17:53 -04:00
(Examples: installing a new Python version, or installing a package that provides a binary.)
$ pyenv rehash
This can be automated for pip using
[pyenv-pip-rehash](https://github.com/yyuu/pyenv-pip-rehash), which invokes
`pyenv rehash` after (un)installing packages using pip.
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
#### Upgrading
If you've installed pyenv using the instructions above, you can
upgrade your installation at any time using git.
To upgrade to the latest development version of pyenv, use `git pull`:
$ cd ~/.pyenv
$ git pull
2014-03-20 09:17:53 -04:00
To upgrade to a specific release of pyenv, check out the corresponding tag:
$ cd ~/.pyenv
$ git fetch
$ git tag
v0.1.0
2012-08-31 07:59:24 -04:00
$ git checkout v0.1.0
2014-03-19 15:00:54 -04:00
2013-06-13 07:04:37 -04:00
### Homebrew on Mac OS X
2014-09-02 20:51:22 -04:00
You can also install pyenv using the [Homebrew](http://brew.sh)
2014-03-20 09:17:53 -04:00
package manager for Mac OS X.
$ brew update
$ brew install pyenv
2013-06-13 07:04:37 -04:00
2014-03-19 15:00:54 -04:00
To upgrade pyenv in the future, just use `upgrade` instead of `install`.
2013-06-13 07:04:37 -04:00
2014-03-19 15:00:54 -04:00
After installation, you'll still need to add `eval "$(pyenv init -)"` to your
profile (as stated in the caveats). You'll only ever have to do this
2013-06-13 07:04:37 -04:00
once.
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
### Neckbeard Configuration
2012-08-31 07:59:24 -04:00
Skip this section unless you must know what every line in your shell
profile is doing.
`pyenv init` is the only command that crosses the line of loading
extra commands into your shell. Coming from rvm, some of you might be
opposed to this idea. Here's what `pyenv init` actually does:
2014-03-19 15:00:54 -04:00
1. **Sets up your shims path.** This is the only requirement for pyenv to
2012-08-31 07:59:24 -04:00
function properly. You can do this by hand by prepending
`~/.pyenv/shims` to your `$PATH`.
2014-03-19 15:00:54 -04:00
2. **Installs autocompletion.** This is entirely optional but pretty
2012-08-31 07:59:24 -04:00
useful. Sourcing `~/.pyenv/completions/pyenv.bash` will set that
up. There is also a `~/.pyenv/completions/pyenv.zsh` for Zsh
users.
2014-03-19 15:00:54 -04:00
3. **Rehashes shims.** From time to time you'll need to rebuild your
2012-08-31 07:59:24 -04:00
shim files. Doing this on init makes sure everything is up to
date. You can always run `pyenv rehash` manually.
2014-03-19 15:00:54 -04:00
4. **Installs the sh dispatcher.** This bit is also optional, but allows
2012-08-31 07:59:24 -04:00
pyenv and plugins to change variables in your current shell, making
commands like `pyenv shell` possible. The sh dispatcher doesn't do
anything crazy like override `cd` or hack your shell prompt, but if
for some reason you need `pyenv` to be a real script rather than a
shell function, you can safely skip it.
2014-03-19 15:00:54 -04:00
To see exactly what happens under the hood for yourself, run `pyenv init -`.
2013-02-06 08:08:16 -05:00
### Uninstalling Python Versions
2014-03-19 15:00:54 -04:00
As time goes on, you will accumulate Python versions in your
2013-02-06 08:08:16 -05:00
`~/.pyenv/versions` directory.
To remove old Python versions, `pyenv uninstall` command to automate
the removal process.
2014-09-02 20:51:22 -04:00
Alternatively, simply `rm -rf` the directory of the version you want
to remove. You can find the directory of a particular Python version
2014-03-19 15:00:54 -04:00
with the `pyenv prefix` command, e.g. `pyenv prefix 2.6.8`.
2013-02-06 08:08:16 -05:00
----
2013-02-06 08:08:16 -05:00
## Command Reference
2014-03-20 09:13:15 -04:00
See [COMMANDS.md](COMMANDS.md).
2012-08-31 07:59:24 -04:00
----
2013-02-06 08:08:16 -05:00
## Development
2014-09-02 20:51:22 -04:00
The pyenv source code is [hosted on GitHub](https://github.com/yyuu/pyenv).
2014-03-20 09:17:53 -04:00
It's clean, modular, and easy to understand--even if you're not a shell hacker.
2014-09-02 20:51:22 -04:00
Please feel free to submit Pull Requests and report bugs on the
2014-03-20 09:17:53 -04:00
[issue tracker](https://github.com/yyuu/pyenv/issues).
2014-03-19 15:00:54 -04:00
2013-02-06 08:08:16 -05:00
### Version History
2014-03-19 15:00:54 -04:00
See [CHANGELOG.md](CHANGELOG.md).
2013-02-06 08:08:16 -05:00
2013-02-06 08:08:16 -05:00
### License
(The MIT license)
2013-02-23 05:06:58 -05:00
* Copyright (c) 2013 Yamashita, Yuu
* Copyright (c) 2013 Sam Stephenson
Permission is hereby granted, free of charge, to any person obtaining
a copy of this software and associated documentation files (the
"Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to
permit persons to whom the Software is furnished to do so, subject to
the following conditions:
The above copyright notice and this permission notice shall be
included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.