Jakob Ackermann
8ef3aa1767
[misc] bump metrics module to 3.4.1
...
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:20 +00:00
Jakob Ackermann
68a1b4d459
[misc] bump @overleaf/redis-wrapper to version 2.0.0
2020-11-11 16:21:11 +00:00
Jakob Ackermann
2c8916f2e0
[PackWorker] fix the db cleanup process -- we do not expose db.close
2020-09-29 12:23:18 +01:00
Jakob Ackermann
41a65ee41e
[PackWorker] wait for the db setup before starting to process updates
2020-09-29 12:22:22 +01:00
Jakob Ackermann
9dddf59a9d
[misc] migrate acceptance tests to the native mongo driver, drop mongojs
2020-09-10 17:39:16 +01:00
Jakob Ackermann
c630cbb4e3
[misc] migrate the app to the native mongo driver
...
acceptance tests to follow in a separate commit.
2020-09-10 17:39:12 +01:00
Jakob Ackermann
3a4aa45e2e
Merge branches 'jpa-bump-bson', 'jpa-mongo-find-query-cleanup', 'jpa-mongo-js-cleanup' and 'jpa-mongo-update-query-cleanup' into jpa-mongodb-native
2020-09-10 16:41:45 +01:00
Jakob Ackermann
c42561c38a
[misc] update the bson package
2020-09-10 16:40:56 +01:00
Jakob Ackermann
6d3fa2ee5b
[misc] mongodb: use findOne and find().toArray()
2020-09-10 14:54:18 +01:00
Jakob Ackermann
b86acf3ea1
[misc] mongodb: change findAndModify queries to updateOne
...
There is no need to fetch mongo data when the call-site does not look at
it. Also handle mongo errors in `setTTLOnArchivedPack`.
2020-09-10 14:18:14 +01:00
Jakob Ackermann
e74af0bee6
[misc] PackWorker: drop workaround for db.close in mongojs@1
...
REF: 3ed3932ee837920e95661b0308dee012f40a71dd
2020-09-10 11:10:59 +01:00
Miguel Serrano
105335c62a
Remove source maps
2020-06-19 19:19:15 +02:00
Tim Alby
d3a7ffd1a9
fix formatting
2020-06-04 10:24:21 +02:00
mserranom
79f6b9a877
updated express to v4
2020-03-23 11:10:24 +01:00
mserranom
3587b42311
prettier: convert app/js decaffeinated files to Prettier format
2020-02-17 18:34:28 +01:00
mserranom
e79e044644
decaffeinate: rename app/coffee dir to app/js
2020-02-17 18:34:25 +01:00
decaffeinate
65ecd31c3a
decaffeinate: Run post-processing cleanups on DiffGenerator.coffee and 17 other files
2020-02-17 18:34:21 +01:00
decaffeinate
57345632e0
decaffeinate: Convert DiffGenerator.coffee and 17 other files to JS
2020-02-17 18:34:04 +01:00
decaffeinate
a971c5895b
decaffeinate: Rename DiffGenerator.coffee and 17 other files from .coffee to .js
2020-02-17 18:33:53 +01:00
mserranom
9cee6c3d22
removed unnecessary default argument
2020-02-17 18:32:47 +01:00
Jakob Ackermann
b0b96ee014
[misc] add support for offline s3 tests
...
update the build scripts to 1.3.4
2020-01-27 12:21:30 +01:00
Brian Gough
ebbe728ec1
fix performance of update removal
2019-10-09 11:11:15 +01:00
Brian Gough
79c1dc5c1a
use explicit json content-type to avoid security issues with text/html
2019-02-07 15:54:13 +00:00
Brian Gough
def7a0eeaa
remove unnecessary modules
2019-01-11 15:17:18 +00:00
James Allen
b8d0eb2823
Merge branch 'master' into ja-return-latest-doc-on-no-version
2017-08-04 09:31:19 +02:00
James Allen
c5252f893b
Don't return all updates if no version is given
2017-06-28 15:38:31 +01:00
Brian Gough
e8dfe3099f
add missing callback for null byte check
2017-06-02 14:13:33 +01:00
Brian Gough
b71a15a6a0
null byte check for JSON.stringify in archiving
2017-06-01 13:36:13 +01:00
Brian Gough
d9763eb105
log corrupt updates
2017-05-23 13:55:10 +01:00
James Allen
c6d9df95f3
Merge pull request #38 from sharelatex/ja-redis-cluster
...
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen
fb6e028182
Migrate lock to be redis-cluster compatible
2017-05-15 10:34:24 +01:00
Brian Gough
2781d9fd80
keep track of processed/total docs in archiving
2017-05-09 14:00:16 +01:00
Brian Gough
c26bccd390
make arguments handling for packworker more robust
2017-05-09 14:00:16 +01:00
Brian Gough
cac7556ad5
only check packs for archiving once each week
2017-05-09 14:00:15 +01:00
Brian Gough
c6e83c6cb8
allow archiving to exit properly on hard timeout
2017-05-09 14:00:15 +01:00
Brian Gough
9936710a1a
replace error with warning for archiving timeout
2017-05-09 14:00:15 +01:00
Brian Gough
b82567ef79
support scan operations on redis cluster
2017-05-05 11:30:55 +01:00
Brian Gough
534bd8f7ad
add flushing code with error check for cluster
2017-05-02 14:19:49 +01:00
Brian Gough
3b5a07d530
fix update to work with redis cluster
...
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough
3045becbb6
use redis-sharelatex with redis cluster config
2017-04-24 14:23:32 +01:00
Brian Gough
df38893538
remove old single redis flushing code
2017-04-24 11:36:31 +01:00
Brian Gough
2a68b81cc1
randomise order of flush
2017-04-20 14:32:23 +01:00
Brian Gough
9eb36f9692
improve log message for flushing
2017-04-20 11:55:32 +01:00
Brian Gough
43f51355b2
add limit parameter to flushAll
2017-04-20 11:01:46 +01:00
Brian Gough
976f19f763
remove spurious call to getAllDocIdsWithHistoryOps
2017-04-20 10:14:44 +01:00
Brian Gough
70ce3a5271
Merge pull request #29 from sharelatex/bg-simple-flush-all
...
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough
b5b61b98d0
avoid blocking when fetching redis keys
...
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough
9ce6d77cca
add check for dangling updates
2017-04-13 11:31:45 +01:00
Brian Gough
1ec9f87542
update timeouts to allow for 5 second retry delay
...
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough
d9ed026d91
simple flush for all projects
...
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
