website/content/blog/offlinepip.md

84 lines
2.3 KiB
Markdown
Raw Normal View History

2020-01-21 05:39:43 +00:00
---
title: "Offline Pip Packages"
date: 2020-01-20T23:11:05-05:00
draft: false
2020-02-18 04:31:46 +00:00
tags: [ "python", "archive" ]
2020-01-21 05:39:43 +00:00
---
There are a few reasons I can think of to have offline pip packages:
- A package isn't able to compile on a friend's computer since they don't have the million linear algebra libraries that `numpy` /`scipy` require.
- You want to archive everything to run a piece of software
- You want to control the packages available to a closed network
Regardless, to my surprise, setting up a repository of python wheels doesn't take many steps.
## Setup
First I would recommend that you setup a virtual environment. Either through [pyenv](https://brandonrozek.com/blog/pyenv/) or [python-virtualenv](https://brandonrozek.com/blog/virtualenv/).
Then, install whatever packages you would like. Let us use tensorflow as an example:
```bash
pip install tensorflow
```
2020-01-22 02:51:30 +00:00
We're going to need the packages `pip-chill` and `pip-tools` for the next couple steps
2020-01-21 05:39:43 +00:00
```bash
2020-01-22 02:51:30 +00:00
pip install pip-chill pip-tools
2020-01-21 05:39:43 +00:00
```
2020-01-22 02:51:30 +00:00
After you install all the packages you want to be available, freeze the requirements that aren't dependencies to a text file
```bash
pip-chill --no-version > requirements.in
```
We will then use `pip-compile` in `pip-tools` to resolve our dependencies and make our packages as fresh as possible.
```bash
pip-compile requirements.in
```
To sync the current virtual environment with the `requirements.txt` file that gets produced
```bash
pip-sync
```
Now we have a fully working and resolved environment.
From here, we need to install the wheel package to make the binary wheels.
2020-01-21 05:39:43 +00:00
```bash
pip install wheel
```
2020-01-22 02:51:30 +00:00
Then to create the wheels,
2020-01-21 05:39:43 +00:00
```bash
pip wheel --wheel-dir=wheels -r requirements.txt
```
With this you have a whole repository of wheels under the wheels folder!
## Client Side
Now you can get [all fancy with your deployment](https://realpython.com/offline-python-deployments-with-docker/#deploy), though I just assumed that the files were mounted in some shared folder.
The client can install all the wheels
```bash
pip install /path/to/wheels/*
```
Or they can just install the packages they want
```bash
pip install --no-index -f /path/to/wheels/wheels package_name
```
2020-04-10 16:07:50 +00:00
If you don't want to add flags to every command, check out my post on using [configuration files with pip](https://brandonrozek.com/blog/pipconf/).