Brian Gough
ff2363c876
Merge pull request #41 from sharelatex/bg-error-on-null-bytes
...
null byte check for JSON.stringify in archiving
2017-06-06 09:21:33 +01:00
Brian Gough
e8dfe3099f
add missing callback for null byte check
2017-06-02 14:13:33 +01:00
Brian Gough
b71a15a6a0
null byte check for JSON.stringify in archiving
2017-06-01 13:36:13 +01:00
Brian Gough
853f9eebac
Merge pull request #40 from sharelatex/bg-log-bad-updates
...
log corrupt updates
2017-05-23 13:58:49 +01:00
Brian Gough
d9763eb105
log corrupt updates
2017-05-23 13:55:10 +01:00
James Allen
c6d9df95f3
Merge pull request #38 from sharelatex/ja-redis-cluster
...
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen
fb6e028182
Migrate lock to be redis-cluster compatible
2017-05-15 10:34:24 +01:00
Brian Gough
756563fe42
Merge pull request #36 from sharelatex/bg-improve-archiving
...
make archiving less noisy
2017-05-10 14:18:18 +01:00
Brian Gough
9d5dc20524
Merge pull request #37 from sharelatex/bg-update-redis-sharelatex-npm
...
update to redis-sharelatex v1.0.2
2017-05-10 14:01:43 +01:00
Brian Gough
ff76d1cf62
update to redis-sharelatex v1.0.2
2017-05-10 13:48:43 +01:00
Brian Gough
2781d9fd80
keep track of processed/total docs in archiving
2017-05-09 14:00:16 +01:00
Brian Gough
c26bccd390
make arguments handling for packworker more robust
2017-05-09 14:00:16 +01:00
Brian Gough
cac7556ad5
only check packs for archiving once each week
2017-05-09 14:00:15 +01:00
Brian Gough
c6e83c6cb8
allow archiving to exit properly on hard timeout
2017-05-09 14:00:15 +01:00
Brian Gough
9936710a1a
replace error with warning for archiving timeout
2017-05-09 14:00:15 +01:00
Brian Gough
0e8a924f28
Merge pull request #35 from sharelatex/bg-fix-dangling
...
flush dangling docs
2017-05-05 15:03:41 +01:00
Brian Gough
7cd2911a0a
Merge pull request #34 from sharelatex/bg-update-redis-sharelatex-to-v1.0.1
...
update redis-sharelatex to v1.0.1
2017-05-05 11:51:33 +01:00
Brian Gough
1e56347f4f
Merge pull request #33 from sharelatex/bg-support-scan-on-redis-cluster
...
support scan operations on redis cluster
2017-05-05 11:51:18 +01:00
Brian Gough
b82567ef79
support scan operations on redis cluster
2017-05-05 11:30:55 +01:00
Brian Gough
842b91b93a
update redis-sharelatex to v1.0.1
...
manual edit to npm-shrinkwrap.json to preserve existing versions
2017-05-05 09:38:58 +01:00
Brian Gough
238638b906
Merge pull request #32 from sharelatex/bg-fix-shrinkwrap
...
fix shrinkwrap
2017-05-04 13:13:34 +01:00
Brian Gough
e0ed321d7b
fix shrinkwrap file to add redis-sharelatex
2017-05-03 16:37:12 +01:00
Brian Gough
35810fa702
Revert "update shrinkwrap file"
...
This reverts commit d16d3a1db97049cd99bfd6d965e4fab77453ae67.
2017-05-03 16:32:23 +01:00
Brian Gough
5fb4a7fdc9
Merge pull request #31 from sharelatex/bg-use-redis-sharelatex-cluster
...
use redis sharelatex v1.0.0
2017-05-02 15:00:17 +01:00
Brian Gough
534bd8f7ad
add flushing code with error check for cluster
2017-05-02 14:19:49 +01:00
Brian Gough
0966f694da
fix acceptance tests to work with redis cluster
2017-04-27 10:14:44 +01:00
Brian Gough
3b5a07d530
fix update to work with redis cluster
...
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough
7836556d10
update shrinkwrap file
2017-04-24 14:24:02 +01:00
Brian Gough
3045becbb6
use redis-sharelatex with redis cluster config
2017-04-24 14:23:32 +01:00
Brian Gough
df38893538
remove old single redis flushing code
2017-04-24 11:36:31 +01:00
Brian Gough
a7ff15ec7d
remove logging, fix query
2017-04-24 09:49:11 +01:00
Brian Gough
33fb1ddf57
script to flush dangling ops
2017-04-20 16:58:26 +01:00
Brian Gough
60443f3fa6
Merge branch 'bg-limit-flush'
2017-04-20 14:33:06 +01:00
Brian Gough
2a68b81cc1
randomise order of flush
2017-04-20 14:32:23 +01:00
Brian Gough
7ba45cfc73
Merge pull request #30 from sharelatex/bg-limit-flush
...
allow limit on flushed projects
2017-04-20 12:14:49 +01:00
Brian Gough
9eb36f9692
improve log message for flushing
2017-04-20 11:55:32 +01:00
Brian Gough
43f51355b2
add limit parameter to flushAll
2017-04-20 11:01:46 +01:00
Brian Gough
976f19f763
remove spurious call to getAllDocIdsWithHistoryOps
2017-04-20 10:14:44 +01:00
Brian Gough
70ce3a5271
Merge pull request #29 from sharelatex/bg-simple-flush-all
...
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough
b5b61b98d0
avoid blocking when fetching redis keys
...
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough
8f469db1e5
Merge pull request #28 from sharelatex/bg-upate-timeouts
...
update timeouts to allow for 5 second retry delay
2017-04-19 13:19:05 +01:00
Brian Gough
9ce6d77cca
add check for dangling updates
2017-04-13 11:31:45 +01:00
Brian Gough
1ec9f87542
update timeouts to allow for 5 second retry delay
...
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough
d9ed026d91
simple flush for all projects
...
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
Shane Kilkelly
96f5802462
Merge branch 'sk-upgrade-metrics'
2017-04-04 16:16:37 +01:00
Shane Kilkelly
9a9f0f5c4d
Remove the Metrics module, use metrics-sharelatex
2017-04-03 15:17:29 +01:00
Brian Gough
5d6d33966b
Merge pull request #27 from sharelatex/bg-retry-web-api-request
...
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough
cd1d0cc1f4
Merge pull request #26 from sharelatex/bg-error-check-on-unlock
...
improve error handling of releaseLock
2017-04-03 14:04:59 +01:00
Brian Gough
7237467cb4
use requestretry to work around web api timeouts
2017-04-03 11:06:50 +01:00
Brian Gough
b0b05d1e1b
improve error handling of releaseLock
...
ported from docupdater
2017-03-31 15:17:13 +01:00
