Commit graph

323 commits

Author SHA1 Message Date
Jakob Ackermann
9dddf59a9d [misc] migrate acceptance tests to the native mongo driver, drop mongojs 2020-09-10 17:39:16 +01:00
Jakob Ackermann
c630cbb4e3 [misc] migrate the app to the native mongo driver
acceptance tests to follow in a separate commit.
2020-09-10 17:39:12 +01:00
Jakob Ackermann
3a4aa45e2e Merge branches 'jpa-bump-bson', 'jpa-mongo-find-query-cleanup', 'jpa-mongo-js-cleanup' and 'jpa-mongo-update-query-cleanup' into jpa-mongodb-native 2020-09-10 16:41:45 +01:00
Jakob Ackermann
c42561c38a [misc] update the bson package 2020-09-10 16:40:56 +01:00
Jakob Ackermann
6d3fa2ee5b [misc] mongodb: use findOne and find().toArray() 2020-09-10 14:54:18 +01:00
Jakob Ackermann
b86acf3ea1 [misc] mongodb: change findAndModify queries to updateOne
There is no need to fetch mongo data when the call-site does not look at
 it. Also handle mongo errors in `setTTLOnArchivedPack`.
2020-09-10 14:18:14 +01:00
Jakob Ackermann
e74af0bee6 [misc] PackWorker: drop workaround for db.close in mongojs@1
REF: 3ed3932ee837920e95661b0308dee012f40a71dd
2020-09-10 11:10:59 +01:00
Miguel Serrano
105335c62a Remove source maps 2020-06-19 19:19:15 +02:00
Tim Alby
d3a7ffd1a9 fix formatting 2020-06-04 10:24:21 +02:00
mserranom
79f6b9a877 updated express to v4 2020-03-23 11:10:24 +01:00
mserranom
3587b42311 prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 18:34:28 +01:00
mserranom
e79e044644 decaffeinate: rename app/coffee dir to app/js 2020-02-17 18:34:25 +01:00
decaffeinate
65ecd31c3a decaffeinate: Run post-processing cleanups on DiffGenerator.coffee and 17 other files 2020-02-17 18:34:21 +01:00
decaffeinate
57345632e0 decaffeinate: Convert DiffGenerator.coffee and 17 other files to JS 2020-02-17 18:34:04 +01:00
decaffeinate
a971c5895b decaffeinate: Rename DiffGenerator.coffee and 17 other files from .coffee to .js 2020-02-17 18:33:53 +01:00
mserranom
9cee6c3d22 removed unnecessary default argument 2020-02-17 18:32:47 +01:00
Jakob Ackermann
b0b96ee014 [misc] add support for offline s3 tests
update the build scripts to 1.3.4
2020-01-27 12:21:30 +01:00
Brian Gough
ebbe728ec1 fix performance of update removal 2019-10-09 11:11:15 +01:00
Brian Gough
79c1dc5c1a use explicit json content-type to avoid security issues with text/html 2019-02-07 15:54:13 +00:00
Brian Gough
def7a0eeaa remove unnecessary modules 2019-01-11 15:17:18 +00:00
James Allen
b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen
c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough
e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough
b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough
d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen
c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen
fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough
2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough
c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough
cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough
c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough
9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough
b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough
534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough
3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough
3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough
df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough
2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough
9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough
43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00
Brian Gough
976f19f763 remove spurious call to getAllDocIdsWithHistoryOps 2017-04-20 10:14:44 +01:00
Brian Gough
70ce3a5271 Merge pull request #29 from sharelatex/bg-simple-flush-all
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough
b5b61b98d0 avoid blocking when fetching redis keys
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough
9ce6d77cca add check for dangling updates 2017-04-13 11:31:45 +01:00
Brian Gough
1ec9f87542 update timeouts to allow for 5 second retry delay
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough
d9ed026d91 simple flush for all projects
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
Shane Kilkelly
96f5802462 Merge branch 'sk-upgrade-metrics' 2017-04-04 16:16:37 +01:00
Shane Kilkelly
9a9f0f5c4d Remove the Metrics module, use metrics-sharelatex 2017-04-03 15:17:29 +01:00
Brian Gough
5d6d33966b Merge pull request #27 from sharelatex/bg-retry-web-api-request
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough
7237467cb4 use requestretry to work around web api timeouts 2017-04-03 11:06:50 +01:00