Eric Mc Sween
12e7471213
Merge pull request #12916 from overleaf/bg-move-stream-buffer-code-to-library
...
move stream-related code to separate `@overleaf/stream-utils` library
GitOrigin-RevId: a79a873109b927b4fc0ae36f47d5c67e0df58041
2023-06-02 08:05:57 +00:00
Jakob Ackermann
5714deaa08
Merge pull request #12986 from overleaf/jpa-docstore-archiving-disabled
...
[docstore] skip mongo/object-persistor calls when archiving is disabled
GitOrigin-RevId: 71bb7d77e987d6f32e37fd888311b6cc2a461170
2023-05-09 08:04:09 +00:00
Jakob Ackermann
e983f70730
Merge pull request #12375 from overleaf/jpa-fix-size
...
[docstore] initialize size with 0
GitOrigin-RevId: 9716cecb2ea87bb3596b3cdb64e9bd9f61dc86db
2023-03-30 08:02:57 +00:00
Jakob Ackermann
24d2cf426f
Merge pull request #12368 from overleaf/jlm-jpa-switch-to-json-parse-from-bytes
...
[docstore] potential optimization for parsing a large JSON from buffer
GitOrigin-RevId: 1c2fb82eb27e2f5d58f75b99fab5dffc2d9b51d0
2023-03-30 08:02:51 +00:00
Jakob Ackermann
ff492d572c
Merge pull request #12367 from overleaf/jlm-jpa-log-large-unarchive-job
...
[docstore] log a warning when a potentially large doc is unarchived
GitOrigin-RevId: 665b6cf700e76e7ea433788c09413823f95e7829
2023-03-30 08:02:48 +00:00
Eric Mc Sween
49f1312b27
Merge pull request #12205 from overleaf/em-camel-case-docstore
...
Camel case variables in docstore
GitOrigin-RevId: e6c2015cfb63ce125fd32ba8b4f904712b2bb9aa
2023-03-17 09:05:12 +00:00
Brian Gough
53d2074315
Merge pull request #9723 from overleaf/bg-log-large-docs-in-docstore-archive
...
warn about oversized docs in docstore archiving
GitOrigin-RevId: 296a49b37b7f6733ef33f682ae40a8d3d478d9e8
2022-09-27 08:03:49 +00:00
Eric Mc Sween
de4091f955
Merge pull request #7869 from overleaf/em-docstore-archive-lock
...
Add a lock around doc archiving
GitOrigin-RevId: eaf85dbc3b491edd15eeb2c1a84df3a2883fb61d
2022-05-18 08:04:44 +00:00
Eric Mc Sween
e0d91eaa26
Merge pull request #7906 from overleaf/em-downgrade-logs
...
Downgrade all INFO logs to DEBUG
GitOrigin-RevId: 05ed582ef0721fcada059f0ad158565f50feca27
2022-05-17 08:05:26 +00:00
Eric Mc Sween
ddb94d159a
Merge pull request #7627 from overleaf/em-docstore-archiving
...
Safer doc unarchiving
GitOrigin-RevId: 60f7aa39401d2f09c13570097c4f376cc401931f
2022-04-27 08:03:57 +00:00
Eric Mc Sween
f7275a6c4b
Merge pull request #6079 from overleaf/em-upgrade-logger
...
Upgrade logger and metrics in all services
GitOrigin-RevId: 2baf63eeeab77fb3559cf763ddacfbf4b745cd0b
2021-12-15 09:04:25 +00:00
Brian Gough
26d5241eaa
Merge pull request #5891 from overleaf/tm-unarchive-checksum-mismatches
...
Test checksum against buffer, before converting to a JS string
GitOrigin-RevId: 645d8a89a3881275ff555fda00eb4985677c6b34
2021-11-30 09:02:57 +00:00
Brian Gough
0095a381b0
refactor unarchiveDoc to use a separate getDoc helper
2021-07-30 16:03:43 +01:00
Jakob Ackermann
540b52c128
[misc] run format_fix and lint:fix
2021-07-13 12:04:48 +01:00
Jakob Ackermann
2c35adaf48
[misc] switch from settings-sharelatex to @overleaf/settings
2021-07-12 17:47:20 +01:00
Jakob Ackermann
d69c29e4dc
[misc] apply review feedback on naming functions and parameters
...
Co-Authored-By: Simon Detheridge <s@sd.ai>
2021-06-08 19:29:10 +01:00
Jakob Ackermann
4996f8bbcd
[DocArchiveManager] (un-)archive docs in batches and let db filter docs
...
Also drop the broken 404 logic after switching to db-side filtering.
2021-06-08 12:59:13 +01:00
Jakob Ackermann
9ba8237850
[DocArchiveManager] retry the deletion of doc archives three times
2021-05-05 10:58:33 +01:00
Jakob Ackermann
3f94dd4dbf
[DocArchiveManager] destroy in small batches
...
Also add settings options for PARALLEL_JOBS and DESTROY_BATCH_SIZE.
2021-04-16 09:51:41 +01:00
Jakob Ackermann
12bef53645
[DocArchiveManager] optionally do not un-archive soft deleted docs
2021-02-09 11:20:26 +00:00
Jakob Ackermann
9298f486ad
[app] add a new route for archiving a single doc
...
There is a minor opportunity for optimizing the mongo call(s) for
archiving: we should include `{ inS3: false }` in the queries instead
of filtering locally. It's been like that for years now, so it can
stay a little longer.
2021-01-04 13:47:55 +00:00
Simon Detheridge
31c757cce2
Don't throw 404 errors when unarchiving, if the doc is already unarchived
2020-09-25 09:17:01 +01:00
Simon Detheridge
90a6642b33
Replace tiny-async-pool with p-map
2020-09-14 16:34:34 +01:00
Simon Detheridge
1575cd41eb
Don't pass empty array to asyncPool when archiving
2020-08-10 15:44:41 +01:00
Simon Detheridge
cb8c2bf4b5
AsyncPool -> asyncPool
2020-07-31 16:21:59 +01:00
Simon Detheridge
9724407e31
Export .promises from MongoManager
2020-07-31 16:20:07 +01:00
Simon Detheridge
268f436461
Don't call AsyncPool with an empty array
2020-07-24 11:51:18 +01:00
Simon Detheridge
6e04db552a
Implement object-persistor support
2020-07-23 19:42:49 +01:00
Tim Alby
c854f1f570
prettier auto-format
2020-05-28 15:20:54 +02:00
Simon Detheridge
fb931e206c
prettier: convert app/js decaffeinated files to Prettier format
2020-02-17 10:49:00 +00:00
Simon Detheridge
c1805978c4
decaffeinate: rename app/coffee dir to app/js
2020-02-17 10:48:58 +00:00
