Commit graph

641 commits

Author SHA1 Message Date
James Allen
c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough
ff2363c876 Merge pull request #41 from sharelatex/bg-error-on-null-bytes
null byte check for JSON.stringify in archiving
2017-06-06 09:21:33 +01:00
Brian Gough
e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough
b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough
853f9eebac Merge pull request #40 from sharelatex/bg-log-bad-updates
log corrupt updates
2017-05-23 13:58:49 +01:00
Brian Gough
d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen
c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen
fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough
756563fe42 Merge pull request #36 from sharelatex/bg-improve-archiving
make archiving less noisy
2017-05-10 14:18:18 +01:00
Brian Gough
9d5dc20524 Merge pull request #37 from sharelatex/bg-update-redis-sharelatex-npm
update to redis-sharelatex v1.0.2
2017-05-10 14:01:43 +01:00
Brian Gough
ff76d1cf62 update to redis-sharelatex v1.0.2 2017-05-10 13:48:43 +01:00
Brian Gough
2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough
c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough
cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough
c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough
9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough
0e8a924f28 Merge pull request #35 from sharelatex/bg-fix-dangling
flush dangling docs
2017-05-05 15:03:41 +01:00
Brian Gough
7cd2911a0a Merge pull request #34 from sharelatex/bg-update-redis-sharelatex-to-v1.0.1
update redis-sharelatex to v1.0.1
2017-05-05 11:51:33 +01:00
Brian Gough
1e56347f4f Merge pull request #33 from sharelatex/bg-support-scan-on-redis-cluster
support scan operations on redis cluster
2017-05-05 11:51:18 +01:00
Brian Gough
b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough
842b91b93a update redis-sharelatex to v1.0.1
manual edit to npm-shrinkwrap.json to preserve existing versions
2017-05-05 09:38:58 +01:00
Brian Gough
238638b906 Merge pull request #32 from sharelatex/bg-fix-shrinkwrap
fix shrinkwrap
2017-05-04 13:13:34 +01:00
Brian Gough
e0ed321d7b fix shrinkwrap file to add redis-sharelatex 2017-05-03 16:37:12 +01:00
Brian Gough
35810fa702 Revert "update shrinkwrap file"
This reverts commit d16d3a1db97049cd99bfd6d965e4fab77453ae67.
2017-05-03 16:32:23 +01:00
Brian Gough
5fb4a7fdc9 Merge pull request #31 from sharelatex/bg-use-redis-sharelatex-cluster
use redis sharelatex v1.0.0
2017-05-02 15:00:17 +01:00
Brian Gough
534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough
0966f694da fix acceptance tests to work with redis cluster 2017-04-27 10:14:44 +01:00
Brian Gough
3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough
7836556d10 update shrinkwrap file 2017-04-24 14:24:02 +01:00
Brian Gough
3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough
df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough
a7ff15ec7d remove logging, fix query 2017-04-24 09:49:11 +01:00
Brian Gough
33fb1ddf57 script to flush dangling ops 2017-04-20 16:58:26 +01:00
Brian Gough
60443f3fa6 Merge branch 'bg-limit-flush' 2017-04-20 14:33:06 +01:00
Brian Gough
2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough
7ba45cfc73 Merge pull request #30 from sharelatex/bg-limit-flush
allow limit on flushed projects
2017-04-20 12:14:49 +01:00
Brian Gough
9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough
43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00
Brian Gough
976f19f763 remove spurious call to getAllDocIdsWithHistoryOps 2017-04-20 10:14:44 +01:00
Brian Gough
70ce3a5271 Merge pull request #29 from sharelatex/bg-simple-flush-all
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough
b5b61b98d0 avoid blocking when fetching redis keys
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough
8f469db1e5 Merge pull request #28 from sharelatex/bg-upate-timeouts
update timeouts to allow for 5 second retry delay
2017-04-19 13:19:05 +01:00
Brian Gough
9ce6d77cca add check for dangling updates 2017-04-13 11:31:45 +01:00
Brian Gough
1ec9f87542 update timeouts to allow for 5 second retry delay
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough
d9ed026d91 simple flush for all projects
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
Shane Kilkelly
96f5802462 Merge branch 'sk-upgrade-metrics' 2017-04-04 16:16:37 +01:00
Shane Kilkelly
9a9f0f5c4d Remove the Metrics module, use metrics-sharelatex 2017-04-03 15:17:29 +01:00
Brian Gough
5d6d33966b Merge pull request #27 from sharelatex/bg-retry-web-api-request
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough
cd1d0cc1f4 Merge pull request #26 from sharelatex/bg-error-check-on-unlock
improve error handling of releaseLock
2017-04-03 14:04:59 +01:00
Brian Gough
7237467cb4 use requestretry to work around web api timeouts 2017-04-03 11:06:50 +01:00