overleaf/services/history-v1
Christopher Hoskin 5fbd5e21a2 Merge pull request #13274 from overleaf/csh-issue-13004-cleanup-custom-code
Remove apiScheme from GCS

GitOrigin-RevId: c948287cb00c7bc432c797bfdfa92a79b84d1bed
2023-06-02 08:05:10 +00:00
..
api Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
benchmarks Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
config Merge pull request #13274 from overleaf/csh-issue-13004-cleanup-custom-code 2023-06-02 08:05:10 +00:00
migrations Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
storage Merge pull request #12904 from overleaf/bg-history-v1-streams-for-node-18 2023-05-10 08:04:51 +00:00
test Merge pull request #11890 from overleaf/em-fix-deleted-chunks-indexes 2023-02-23 09:05:50 +00:00
.gitignore Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
.mocharc.json Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
.nvmrc Merge pull request #12706 from overleaf/bg-rollback-broken-node-18-services 2023-04-20 08:03:54 +00:00
app.js Merge pull request #13255 from overleaf/em-socket-leak-detection 2023-05-31 08:05:24 +00:00
buildscript.txt Merge pull request #13251 from overleaf/msm-update-mongo-5 2023-06-01 08:05:18 +00:00
docker-compose.ci.yml Merge pull request #13274 from overleaf/csh-issue-13004-cleanup-custom-code 2023-06-02 08:05:10 +00:00
docker-compose.yml Merge pull request #13274 from overleaf/csh-issue-13004-cleanup-custom-code 2023-06-02 08:05:10 +00:00
Dockerfile Merge pull request #12935 from overleaf/jpa-include-patches 2023-05-05 08:04:13 +00:00
knexfile.js Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
Makefile Merge pull request #12575 from overleaf/em-fix-chunk-replace-transaction 2023-04-19 08:03:10 +00:00
nodemon.json Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00
package.json Merge pull request #11210 from overleaf/em-upgrade-jsonwebtoken 2023-01-27 09:04:34 +00:00
README.md Avoid duplicating a math-closing dollar sign (#11227) 2023-01-16 08:41:42 +00:00

Database migrations

The history service uses knex to manage PostgreSQL migrations.

To create a new migrations, run:

npx knex migrate:make migration_name

To apply migrations, run:

npx knex migrate:latest

For more information, consult the knex migrations guide.

Global blobs

Global blobs are blobs that are shared between projects. The list of global blobs is stored in the projectHistoryGlobalBlobs Mongo collection and is read when the service starts. Changing the list of global blobs needs to be done carefully.

Adding a blob to the global blobs list

If we identify a blob that appears in many projects, we might want to move that blob to the global blobs list.

  1. Add a record for the blob to the projectHistoryGlobalBlobs collection.
  2. Restart the history service.
  3. Delete any corresponding project blobs.

Removing a blob from the global blobs list

Removing a blob from the global blobs list is trickier. As soon as the global blob is made unavailable, every project that needs the blob will have to get its own copy. To avoid disruptions, follow these steps:

  1. In the projectHistoryGlobalBlobs collection, set the demoted property to false on the global blob to remove. This will make the history system write new instances of this blob to project blobs, but still read from the global blob.

  2. Restart the history service.

  3. Copy the blob to all projects that need it.

  4. Remove the blob from the projectHistoryGlobalBlobs collection.

  5. Restart the history service.