Commit graph

333 commits

Author SHA1 Message Date
Eric Mc Sween
b83c35fdbb Merge pull request #4665 from overleaf/bg-zip-manager
add streaming zip export of history (migrated from track-changes#117)

GitOrigin-RevId: 45e6a66332541f463241f148892817725c0be39c
2021-08-17 08:03:24 +00:00
Jakob Ackermann
181a895c04 [misc] temporary override a few new/changed eslint rules 2021-07-13 12:24:37 +01:00
Jakob Ackermann
9178394dd6 [misc] run format_fix and lint:fix 2021-07-13 12:04:43 +01:00
Jakob Ackermann
b5bb7c3b04 [misc] switch from settings-sharelatex to @overleaf/settings 2021-07-12 17:47:16 +01:00
Jakob Ackermann
ed70b99d8a [misc] exportProject: collect and send user ids of updates in trailer 2021-02-25 09:52:54 +00:00
Jakob Ackermann
f411049b82 [misc] add a new endpoint for exporting all the project history 2021-02-23 18:02:58 +00:00
Jakob Ackermann
8ef3aa1767 [misc] bump metrics module to 3.4.1
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:20 +00:00
Jakob Ackermann
68a1b4d459 [misc] bump @overleaf/redis-wrapper to version 2.0.0 2020-11-11 16:21:11 +00:00
Jakob Ackermann
2c8916f2e0 [PackWorker] fix the db cleanup process -- we do not expose db.close 2020-09-29 12:23:18 +01:00
Jakob Ackermann
41a65ee41e [PackWorker] wait for the db setup before starting to process updates 2020-09-29 12:22:22 +01:00
Jakob Ackermann
9dddf59a9d [misc] migrate acceptance tests to the native mongo driver, drop mongojs 2020-09-10 17:39:16 +01:00
Jakob Ackermann
c630cbb4e3 [misc] migrate the app to the native mongo driver
acceptance tests to follow in a separate commit.
2020-09-10 17:39:12 +01:00
Jakob Ackermann
3a4aa45e2e Merge branches 'jpa-bump-bson', 'jpa-mongo-find-query-cleanup', 'jpa-mongo-js-cleanup' and 'jpa-mongo-update-query-cleanup' into jpa-mongodb-native 2020-09-10 16:41:45 +01:00
Jakob Ackermann
c42561c38a [misc] update the bson package 2020-09-10 16:40:56 +01:00
Jakob Ackermann
6d3fa2ee5b [misc] mongodb: use findOne and find().toArray() 2020-09-10 14:54:18 +01:00
Jakob Ackermann
b86acf3ea1 [misc] mongodb: change findAndModify queries to updateOne
There is no need to fetch mongo data when the call-site does not look at
 it. Also handle mongo errors in `setTTLOnArchivedPack`.
2020-09-10 14:18:14 +01:00
Jakob Ackermann
e74af0bee6 [misc] PackWorker: drop workaround for db.close in mongojs@1
REF: 3ed3932ee837920e95661b0308dee012f40a71dd
2020-09-10 11:10:59 +01:00
Miguel Serrano
105335c62a Remove source maps 2020-06-19 19:19:15 +02:00
Tim Alby
d3a7ffd1a9 fix formatting 2020-06-04 10:24:21 +02:00
mserranom
79f6b9a877 updated express to v4 2020-03-23 11:10:24 +01:00
mserranom
3587b42311 prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 18:34:28 +01:00
mserranom
e79e044644 decaffeinate: rename app/coffee dir to app/js 2020-02-17 18:34:25 +01:00
decaffeinate
65ecd31c3a decaffeinate: Run post-processing cleanups on DiffGenerator.coffee and 17 other files 2020-02-17 18:34:21 +01:00
decaffeinate
57345632e0 decaffeinate: Convert DiffGenerator.coffee and 17 other files to JS 2020-02-17 18:34:04 +01:00
decaffeinate
a971c5895b decaffeinate: Rename DiffGenerator.coffee and 17 other files from .coffee to .js 2020-02-17 18:33:53 +01:00
mserranom
9cee6c3d22 removed unnecessary default argument 2020-02-17 18:32:47 +01:00
Jakob Ackermann
b0b96ee014 [misc] add support for offline s3 tests
update the build scripts to 1.3.4
2020-01-27 12:21:30 +01:00
Brian Gough
ebbe728ec1 fix performance of update removal 2019-10-09 11:11:15 +01:00
Brian Gough
79c1dc5c1a use explicit json content-type to avoid security issues with text/html 2019-02-07 15:54:13 +00:00
Brian Gough
def7a0eeaa remove unnecessary modules 2019-01-11 15:17:18 +00:00
James Allen
b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen
c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough
e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough
b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough
d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen
c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen
fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough
2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough
c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough
cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough
c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough
9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough
b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough
534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough
3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough
3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough
df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough
2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough
9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough
43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00