Commit graph

654 commits

Author SHA1 Message Date
mserranom
0c8873fd2e decaffeinate: rename individual coffee files to js files 2020-02-17 18:35:59 +01:00
mserranom
3183aca524 prettier: convert test/acceptance decaffeinated files to Prettier format 2020-02-17 18:35:59 +01:00
mserranom
011262986d decaffeinate: rename test/acceptance/coffee to test/acceptance/js 2020-02-17 18:35:55 +01:00
decaffeinate
8fdf89b87c decaffeinate: Run post-processing cleanups on AppendingUpdatesTests.coffee and 11 other files 2020-02-17 18:35:50 +01:00
decaffeinate
11c39cde65 decaffeinate: Convert AppendingUpdatesTests.coffee and 11 other files to JS 2020-02-17 18:35:39 +01:00
decaffeinate
c97a2a3c07 decaffeinate: Rename AppendingUpdatesTests.coffee and 11 other files from .coffee to .js 2020-02-17 18:35:33 +01:00
mserranom
7741730574 prettier: convert test/unit decaffeinated files to Prettier format 2020-02-17 18:35:16 +01:00
mserranom
201bfbbf32 decaffeinate: rename test/unit/coffee to test/unit/js 2020-02-17 18:35:11 +01:00
decaffeinate
a35c69c0c8 decaffeinate: Run post-processing cleanups on DiffGeneratorTests.coffee and 13 other files 2020-02-17 18:35:01 +01:00
decaffeinate
86a9593ec0 decaffeinate: Convert DiffGeneratorTests.coffee and 13 other files to JS 2020-02-17 18:34:50 +01:00
decaffeinate
fa5256d3c2 decaffeinate: Rename DiffGeneratorTests.coffee and 13 other files from .coffee to .js 2020-02-17 18:34:39 +01:00
mserranom
3587b42311 prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 18:34:28 +01:00
mserranom
e79e044644 decaffeinate: rename app/coffee dir to app/js 2020-02-17 18:34:25 +01:00
decaffeinate
65ecd31c3a decaffeinate: Run post-processing cleanups on DiffGenerator.coffee and 17 other files 2020-02-17 18:34:21 +01:00
decaffeinate
57345632e0 decaffeinate: Convert DiffGenerator.coffee and 17 other files to JS 2020-02-17 18:34:04 +01:00
decaffeinate
a971c5895b decaffeinate: Rename DiffGenerator.coffee and 17 other files from .coffee to .js 2020-02-17 18:33:53 +01:00
mserranom
0366406dbe decaffeinate: add eslint and prettier packages 2020-02-17 18:33:37 +01:00
mserranom
a77c05c60c decaffeinate: update .gitignore 2020-02-17 18:33:06 +01:00
mserranom
acd09a8a4e decaffeinate: update build scripts to es 2020-02-17 18:33:01 +01:00
mserranom
9cee6c3d22 removed unnecessary default argument 2020-02-17 18:32:47 +01:00
Jakob Ackermann
0cb4f3c24c Merge pull request #74 from overleaf/jpa-dependencies-cleanup
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
2020-02-14 10:56:35 +01:00
Jakob Ackermann
660c9145ad [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i 2020-02-12 14:39:52 +01:00
Brian Gough
883c0e83cf remove unused .travis.yml file 2020-02-12 12:37:01 +00:00
Jakob Ackermann
04e0960f05 [misc] update the build scripts to 1.3.5 2020-02-11 12:27:54 +01:00
Brian Gough
bb033c479f use public node:10.19.0 image 2020-02-07 14:15:41 +00:00
Brian Gough
efb5f1a057 update to gcr.io/overleaf-ops/node:10.19.0 2020-02-06 03:36:52 +00:00
Brian Gough
86a5c27833 upgrade to local node:10.18.1 image 2020-02-04 16:09:56 +00:00
Jakob Ackermann
732860a49e [misc] upgrade node to version 10.18.1 2020-01-31 15:40:19 +01:00
Jakob Ackermann
ca668ad657 [misc] test/acceptance: wait for the s3 container to start 2020-01-27 12:21:31 +01:00
Jakob Ackermann
b0b96ee014 [misc] add support for offline s3 tests
update the build scripts to 1.3.4
2020-01-27 12:21:30 +01:00
Jakob Ackermann
265e30df3d [misc] update build scripts to version 1.3.3 2020-01-27 12:17:52 +01:00
Jakob Ackermann
9e28ceb9db [misc] test/acceptance: do not hard code the logging level
There is an environment variable LOG_LEVEL to set it.
2020-01-24 18:30:03 +01:00
Nate Stemen
4d67c846b9 bump build script to 1.1.24 2019-10-30 10:26:38 -04:00
Nate Stemen
e3b3492f44 add public link to contributing docs 2019-10-30 10:26:18 -04:00
Brian Gough
ebbe728ec1 fix performance of update removal 2019-10-09 11:11:15 +01:00
Brian Gough
4eab16d6f4 add continueOnError in settings 2019-10-01 13:25:02 +01:00
John Lees-Miller
c5d9bf1093 Update config 2019-09-28 11:08:32 +01:00
mserranom
d29ea9f527 Fixed WEB_HOST lookup in settings 2019-07-29 10:28:27 +00:00
mserranom
e84ee6ebeb removed profiler 2019-07-18 09:00:47 +00:00
Shane Kilkelly
61450bb125 update logger and metrics 2019-06-21 16:12:40 +01:00
Timothée Alby
6ff1ca3967 update Git URL in Jenkinsfile 2019-05-07 17:48:59 +01:00
Timothée Alby
63920ce33c Update README.md 2019-05-07 16:21:52 +01:00
Henry Oswald
266c6c368e have track changes make calls to web_api not web 2019-03-08 15:32:58 +00:00
Henry Oswald
e54a376d0e Merge branch 'master' of github.com:sharelatex/track-changes-sharelatex 2019-03-05 17:10:40 +00:00
Henry Oswald
d47dcca0d6 add sentry dsn to config 2019-03-05 17:10:18 +00:00
Brian Gough
79c1dc5c1a use explicit json content-type to avoid security issues with text/html 2019-02-07 15:54:13 +00:00
Henry Oswald
0151826eaf clear error if s3 keys are not set for tests 2019-02-06 12:23:15 +00:00
Henry Oswald
7caf3d4935 remove debugging 2019-02-06 11:29:31 +00:00
Henry Oswald
cef7e1e17b Merge branch 'master' into ho-docker 2019-02-06 11:28:16 +00:00
Henry Oswald
6a3506aed9 update redis key schema for cluster 2019-02-01 19:42:14 +00:00
Henry Oswald
38dbea4b0e bulk upgrade to 1.1.12, moved to npm rather than git 2019-02-01 16:18:23 +00:00
Brian Gough
d4a22a65ac add missing coffeescript to package.json
using the same version as in web
2019-01-14 08:43:11 +00:00
Christopher Hoskin
44762ef498 Add **/*.map to .gitignore 2019-01-11 19:09:39 +00:00
Christopher Hoskin
cc4d9ffcbc Bump buildscript to 1.1.11 2019-01-11 19:07:06 +00:00
Christopher Hoskin
5e1d51d5d7 Add note on acceptance tests to README.md 2019-01-11 19:04:35 +00:00
Christopher Hoskin
86c202af8e Merge branch 'bg-remove-unwanted-modules' into csh-ho-docker-issue-1338-bulk-upgrade 2019-01-11 17:53:48 +00:00
Brian Gough
def7a0eeaa remove unnecessary modules 2019-01-11 15:17:18 +00:00
Christopher Hoskin
fe4c75a2ab Remove grunt 2019-01-08 16:39:46 +00:00
Christopher Hoskin
1c701a2d3d Bump buildscript to v1.1.10 2019-01-08 16:15:04 +00:00
Christopher Hoskin
65e1aba265 Update app.coffee to work with Metrics v2 2019-01-08 16:11:56 +00:00
Christopher Hoskin
85216fbd34 Update metrics to v2.0.12, logger to v1.5.9 and settings to v1.1.0, add npm-shrinkwrap 2019-01-08 16:08:40 +00:00
Henry Oswald
d88a40e383 Merge branch 'master' into ho-docker 2018-12-05 16:50:41 +00:00
Henry Oswald
0529493168 bump metrics 2018-12-05 16:50:20 +00:00
Henry Oswald
c3ec4a534e update config to take DOCUMENT_UPDATER_HOST 2018-12-05 16:49:15 +00:00
Alasdair Smith
a2ff9de0dd Use setting instead of hard-coding port 2018-10-09 11:51:18 +01:00
Henry Oswald
8d8319460e pass tmp path as env var 2018-10-04 11:14:15 +01:00
Henry Oswald
7893ace13f add aws creds 2018-10-04 10:40:34 +01:00
Henry Oswald
0a64983fb4 update config with full mongo conneciton and redis details 2018-10-04 10:34:44 +01:00
Henry Oswald
f26bebca4d update build scripts 2018-10-04 10:32:21 +01:00
Henry Oswald
fca95b5b27 dockerise app
- 1.1.3 build scripts
- add env vars for configuring s3
- add docker file
2018-05-24 12:02:27 +01:00
Alberto Fernández Capel
3de7970e0b Make travis read node version from .nvmrc file 2018-05-01 09:21:20 +01:00
James Allen
dd008e1c7d Provide hosts as environment settings and add npm run start script 2017-12-29 08:18:04 +00:00
Brian Gough
b9adad72be upgrade to ioredis 3 via redis-sharelatex 2017-10-30 11:09:25 +00:00
Brian Gough
dacc7ebabb exit if mock servers fail to start 2017-10-20 15:24:58 +01:00
Joe Green
67be2feb23 Update Jenkinsfile 2017-10-16 14:13:00 +01:00
Joe Green
90f2b85034 only alert on master 2017-10-12 16:57:06 +01:00
Joe Green
dbef5904be use correct node version in jenkinsfile 2017-09-20 15:46:48 +01:00
Joe Green
76cae1acf4 build.txt 2017-09-04 14:57:36 +01:00
Shane Kilkelly
1d0e0e68aa Merge branch 'master' into sk-node-6 2017-08-30 08:33:46 +01:00
Brian Gough
ca991c1efd fix broken unit test
the behaviour of the code changed so that raw ops are always compressed
2017-08-29 15:10:58 +01:00
Shane Kilkelly
1cd80b9dcd Restore a broken test that was commented out temporarily 2017-08-25 14:53:39 +01:00
Shane Kilkelly
ad43ddb6c6 Remove commented-out code 2017-08-25 14:52:14 +01:00
Shane Kilkelly
f6fdc5a827 Remove stray log 2017-08-25 14:50:33 +01:00
Shane Kilkelly
cd2ed24937 Fix WriteStream API 2017-08-25 14:47:07 +01:00
Shane Kilkelly
7c9ca7ccef Revert accidental change 2017-08-25 14:46:47 +01:00
Shane Kilkelly
095ac31347 wip: updating to node 6 2017-08-24 14:32:27 +01:00
Joe Green
004d1c134c Create Jenkinsfile 2017-08-16 10:39:03 +01:00
James Allen
b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen
c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough
e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough
b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough
d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen
c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen
fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough
756563fe42 Merge pull request #36 from sharelatex/bg-improve-archiving
make archiving less noisy
2017-05-10 14:18:18 +01:00
Brian Gough
ff76d1cf62 update to redis-sharelatex v1.0.2 2017-05-10 13:48:43 +01:00
Brian Gough
2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough
c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough
cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough
c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough
9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough
0e8a924f28 Merge pull request #35 from sharelatex/bg-fix-dangling
flush dangling docs
2017-05-05 15:03:41 +01:00
Brian Gough
7cd2911a0a Merge pull request #34 from sharelatex/bg-update-redis-sharelatex-to-v1.0.1
update redis-sharelatex to v1.0.1
2017-05-05 11:51:33 +01:00
Brian Gough
b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough
842b91b93a update redis-sharelatex to v1.0.1
manual edit to npm-shrinkwrap.json to preserve existing versions
2017-05-05 09:38:58 +01:00
Brian Gough
e0ed321d7b fix shrinkwrap file to add redis-sharelatex 2017-05-03 16:37:12 +01:00
Brian Gough
35810fa702 Revert "update shrinkwrap file"
This reverts commit d16d3a1db97049cd99bfd6d965e4fab77453ae67.
2017-05-03 16:32:23 +01:00
Brian Gough
534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough
0966f694da fix acceptance tests to work with redis cluster 2017-04-27 10:14:44 +01:00
Brian Gough
3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough
7836556d10 update shrinkwrap file 2017-04-24 14:24:02 +01:00
Brian Gough
3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough
df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough
a7ff15ec7d remove logging, fix query 2017-04-24 09:49:11 +01:00
Brian Gough
33fb1ddf57 script to flush dangling ops 2017-04-20 16:58:26 +01:00
Brian Gough
2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough
9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough
43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00
Brian Gough
976f19f763 remove spurious call to getAllDocIdsWithHistoryOps 2017-04-20 10:14:44 +01:00
Brian Gough
70ce3a5271 Merge pull request #29 from sharelatex/bg-simple-flush-all
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough
b5b61b98d0 avoid blocking when fetching redis keys
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough
9ce6d77cca add check for dangling updates 2017-04-13 11:31:45 +01:00
Brian Gough
1ec9f87542 update timeouts to allow for 5 second retry delay
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough
d9ed026d91 simple flush for all projects
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
Shane Kilkelly
96f5802462 Merge branch 'sk-upgrade-metrics' 2017-04-04 16:16:37 +01:00
Shane Kilkelly
9a9f0f5c4d Remove the Metrics module, use metrics-sharelatex 2017-04-03 15:17:29 +01:00
Brian Gough
5d6d33966b Merge pull request #27 from sharelatex/bg-retry-web-api-request
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough
7237467cb4 use requestretry to work around web api timeouts 2017-04-03 11:06:50 +01:00
Brian Gough
b0b05d1e1b improve error handling of releaseLock
ported from docupdater
2017-03-31 15:17:13 +01:00
Shane Kilkelly
b10f3adf2b mock out metrics in tests 2017-03-31 11:33:25 +01:00
Shane Kilkelly
9a84798293 Upgrade to latest metrics 2017-03-31 11:32:59 +01:00
Brian Gough
8bb3dd07a4 continue when ops are out of order 2017-03-30 13:37:11 +01:00
Brian Gough
d29141d583 return error when out-of-order ops detected 2017-03-30 11:48:26 +01:00
Brian Gough
70bb95fb36 update logger-sharelatex to v1.5.6 2017-03-30 09:41:42 +01:00
Brian Gough
28d2ec93b8 Revert "Revert "Merge pull request #23 from sharelatex/bg-move-lock""
This reverts commit 85bc45099f047aa8dfa6d189f02f4b4327c9d602.
2017-03-28 12:52:49 +01:00
Shane Kilkelly
5288814bd6 Merge branch 'master' of github.com:sharelatex/track-changes-sharelatex 2017-03-27 14:37:47 +01:00
Shane Kilkelly
715ccbe227 Add a .nvmrc file 2017-03-27 14:37:32 +01:00
Brian Gough
e745cce9f5 Revert "Revert "added v8-profiler to shrinkwrap""
This reverts commit 642641ff7b97034346d494101124bee616927ade.
2017-03-27 13:26:55 +01:00
Brian Gough
0130d3513d Revert "Revert "Merge pull request #24 from sharelatex/bg-add-profile""
This reverts commit a58cd0d787b51634caf694f9d858e638d27178b2.
2017-03-27 13:25:59 +01:00
Brian Gough
8bd3dcca75 Revert "Merge pull request #24 from sharelatex/bg-add-profile"
This reverts commit 8f507dcc9fbcd51072047c82a443137aaac0f377, reversing
changes made to 70abd7a155b396e3b44ce21ff8d36be6ad03a060.
2017-03-24 09:17:38 +00:00
Brian Gough
a73c8ba7b8 Revert "Merge pull request #23 from sharelatex/bg-move-lock"
This reverts commit 72e6756415e390a29fa784529453f926e5144358, reversing
changes made to 8f507dcc9fbcd51072047c82a443137aaac0f377.
2017-03-24 09:17:11 +00:00
Brian Gough
6ada7842a9 Revert "added v8-profiler to shrinkwrap"
This reverts commit 62d481b31ebed2a1714cdfcb037a9c1a9c053756.
2017-03-24 09:12:28 +00:00
Brian Gough
f1a66df4ad added v8-profiler to shrinkwrap 2017-03-23 17:01:01 +00:00
Brian Gough
7802bcc911 Revert "update shrinkwrap file for new npm package"
This reverts commit 68283e2650420c1cedc957b039b52766a8d4ce3c.
2017-03-23 16:57:48 +00:00
Brian Gough
a4cca1f948 update shrinkwrap file for new npm package 2017-03-23 14:21:39 +00:00
Brian Gough
e028de115e Merge pull request #23 from sharelatex/bg-move-lock
move lock inside web http calls
2017-03-23 13:42:52 +00:00
Brian Gough
b897afeb1c Merge pull request #24 from sharelatex/bg-add-profile
add /profile endpoint
2017-03-23 13:39:12 +00:00
Brian Gough
bc7815f7fc remove old processUncompressedUpdates method
replace with new per doc method
2017-03-22 16:59:52 +00:00
Brian Gough
b1c0ebbaae add withLock to processUncompressedUpdatesForDoc 2017-03-22 16:16:04 +00:00
Brian Gough
0dd668416d increase request timeout now it is outside lock 2017-03-22 16:02:50 +00:00
Brian Gough
04b82a49ef add /profile endpoint 2017-03-22 15:38:12 +00:00
Brian Gough
6795820933 move lock inside web http calls 2017-03-21 16:49:23 +00:00
Shane Kilkelly
d520c78ae3 Update metrics version to 1.7.0 2017-03-21 13:45:15 +00:00
James Allen
d60445adfc Pass undo flag to doc updater when restoring from history 2017-03-21 11:32:53 +00:00
Shane Kilkelly
7fbc08d68a Add logger stub to unit test 2017-03-21 09:27:47 +00:00
Shane Kilkelly
118511ae4a Remove commented-out code 2017-03-20 09:39:51 +00:00
Shane Kilkelly
fa7ee739bb Update to new metrics api 2017-03-17 14:58:35 +00:00
Shane Kilkelly
c30e672549 Merge branch 'master' into sk-upgrade-metrics 2017-03-16 15:17:57 +00:00
Shane Kilkelly
c303a1a386 wip: upgrade metrics 2017-03-16 15:17:38 +00:00
Brian Gough
ac5d59211d revert random TTL in favour of delay in archiving
there could be some issues with newer packs expiring before older ones
2017-01-31 15:07:58 +00:00
Henry Oswald
ad5af5f4dd ceil not round 2017-01-26 15:14:20 +00:00
Henry Oswald
1d356f93ec added random up to 30 mins delay to the ttl of mongo objects 2017-01-26 13:07:54 +00:00
James Allen
dadc548f81 Ignore comment updates 2017-01-12 10:04:50 +01:00
James Allen
694be95e66 Swap start_ts and end_ts comparison to correctly break chunks after 5 minutes 2016-10-11 11:03:52 +01:00
James Allen
a197c0d148 Merge pull request #18 from sharelatex/ja-split-on-deletes
Split update summary on big deletes
2016-10-10 08:46:46 +01:00
James Allen
40ed6fee46 Split update summary on big deletes 2016-10-04 15:13:04 +01:00
Brian Gough
92e36023e5 Merge pull request #17 from sharelatex/ja-consistency-tweaks
Retry rewind if doc and update versions don't match
2016-09-30 15:14:27 +01:00
James Allen
f8865e616d Update ensureIndices to reflect reality 2016-09-30 14:34:38 +01:00
James Allen
3c8aeb1262 Log number of retries 2016-09-30 13:38:47 +01:00
James Allen
a7f44bcd01 Add missing return on callback 2016-09-30 13:36:31 +01:00
James Allen
deced1aa15 Fix unit tests with logger.warn stub 2016-09-30 11:41:49 +01:00
James Allen
bddd1fda7d Retry rewind if doc and update versions don't match 2016-09-30 11:36:47 +01:00
James Allen
cce93b95a5 Fetch updates before doc content when building a diff 2016-09-22 11:19:05 +01:00
James Allen
05a048db9a Add in a little more logging 2016-09-22 11:19:05 +01:00
James Allen
8dda44f880 Speed up unit tests by only generating big fixtures once up front 2016-09-16 11:51:41 +01:00
James Allen
dfe26262ec Return a No-op if diff returns nothing 2016-09-16 11:50:44 +01:00
James Allen
80375ae2dd Run a diff against big delete - insert changes which are likely copy-pastes 2016-09-16 11:33:36 +01:00
Brian Gough
6e5eadfa86 include a timeout on WebApiManager requests 2016-04-13 16:42:36 +01:00
Brian Gough
a55b72871f don't let s3 errors stop archive worker 2016-04-13 14:39:11 +01:00
Brian Gough
b343be844e added metrics to pack worker for archiving 2016-04-08 10:29:04 +01:00
Brian Gough
76fe194815 add a metric for append-pack 2016-04-07 15:56:11 +01:00
Brian Gough
25365789b4 use latest sharelatex-metrics package 2016-04-07 15:53:10 +01:00
Brian Gough
78100e40c8 add missing metrics file 2016-04-07 15:33:20 +01:00
Brian Gough
1a1fa8798d log attempted update when throwing error in DiffGenerator 2016-04-07 15:16:50 +01:00
Brian Gough
6db310bf6b add insert/archive/unarchive metrics 2016-04-07 15:16:50 +01:00
Brian Gough
d0e08039da don't modify expiry for temporary packs 2016-04-07 15:16:50 +01:00
Brian Gough
fd49601716 preserve existing history when user upgrades 2016-04-07 15:16:38 +01:00
Brian Gough
e292de5eb0 fix to avoid ever appending permanent changes to expiring packs 2016-04-06 17:00:16 +01:00
Brian Gough
8b7bdd345b consider all packs for archiving 2016-04-06 15:17:31 +01:00
Brian Gough
ef47337c78 remove additional fields 2016-04-06 15:17:20 +01:00
Brian Gough
0b9a0730c0 mark temporary packs with a last_checked date in the far future
they do not need to be checked for archiving
2016-04-06 14:29:49 +01:00
Brian Gough
08fc151eee avoid unnecessary call to insert packs into index 2016-04-06 14:29:21 +01:00
Brian Gough
719e0291aa consider all packs for processing
to allow finalisation of old head packs
2016-04-06 14:27:44 +01:00
Brian Gough
79baa99634 clean up logging 2016-04-06 14:26:54 +01:00
Brian Gough
6ab75795a2 archive head packs after sufficient time 2016-04-06 13:30:09 +01:00
Brian Gough
7a0c2900ab add error handler in tests 2016-04-06 13:29:19 +01:00
Brian Gough
6e18d49736 support archiving from list of project_ids/doc_ids 2016-04-04 17:00:19 +01:00
Brian Gough
6a2ecbac06 upgrade sentry logging 2016-04-04 16:30:17 +01:00
Brian Gough
537a1189e7 update mongodb-core version 2016-03-24 16:10:27 +00:00
Brian Gough
31348141d8 increase logging for discarded updates and version mismatch 2016-03-24 11:55:29 +00:00