Eric Mc Sween
bce5a31267
Merge pull request #15741 from overleaf/em-read-version-from-docs
...
Read doc version from the docs collection
GitOrigin-RevId: 1aad4f9d1e1781dae64768938413f36fd2d26703
2023-11-14 09:04:48 +00:00
Eric Mc Sween
f397d79439
Merge pull request #15648 from overleaf/em-promisify-doc-manager
...
Promisify DocManager
GitOrigin-RevId: c9ab368086492900e1617d5d96943d405f25883d
2023-11-09 09:03:10 +00:00
Eric Mc Sween
12e7471213
Merge pull request #12916 from overleaf/bg-move-stream-buffer-code-to-library
...
move stream-related code to separate `@overleaf/stream-utils` library
GitOrigin-RevId: a79a873109b927b4fc0ae36f47d5c67e0df58041
2023-06-02 08:05:57 +00:00
Jakob Ackermann
5714deaa08
Merge pull request #12986 from overleaf/jpa-docstore-archiving-disabled
...
[docstore] skip mongo/object-persistor calls when archiving is disabled
GitOrigin-RevId: 71bb7d77e987d6f32e37fd888311b6cc2a461170
2023-05-09 08:04:09 +00:00
Jakob Ackermann
e983f70730
Merge pull request #12375 from overleaf/jpa-fix-size
...
[docstore] initialize size with 0
GitOrigin-RevId: 9716cecb2ea87bb3596b3cdb64e9bd9f61dc86db
2023-03-30 08:02:57 +00:00
Jakob Ackermann
24d2cf426f
Merge pull request #12368 from overleaf/jlm-jpa-switch-to-json-parse-from-bytes
...
[docstore] potential optimization for parsing a large JSON from buffer
GitOrigin-RevId: 1c2fb82eb27e2f5d58f75b99fab5dffc2d9b51d0
2023-03-30 08:02:51 +00:00
Jakob Ackermann
ff492d572c
Merge pull request #12367 from overleaf/jlm-jpa-log-large-unarchive-job
...
[docstore] log a warning when a potentially large doc is unarchived
GitOrigin-RevId: 665b6cf700e76e7ea433788c09413823f95e7829
2023-03-30 08:02:48 +00:00
Jakob Ackermann
c1e6b2c990
Merge pull request #12230 from overleaf/jpa-upsert-rev-check
...
[docstore] add rev-check to doc upsert and retry update once
GitOrigin-RevId: 754f005024ed809ae7365ef38f10a961c5546171
2023-03-23 09:05:02 +00:00
Jakob Ackermann
e4efe121da
Merge pull request #12229 from overleaf/jpa-reject-decrement-doc-version
...
[docstore] reject doc updates that decrement the doc version
GitOrigin-RevId: 533cc5ece8d5684c85b2f63fa2a093c68f6b5877
2023-03-22 09:04:55 +00:00
Eric Mc Sween
49f1312b27
Merge pull request #12205 from overleaf/em-camel-case-docstore
...
Camel case variables in docstore
GitOrigin-RevId: e6c2015cfb63ce125fd32ba8b4f904712b2bb9aa
2023-03-17 09:05:12 +00:00
Eric Mc Sween
74eeec2ba3
Merge pull request #11680 from overleaf/em-mongo-pool-monitoring
...
Mongo connection pool monitoring
GitOrigin-RevId: 050e50e7e67061ccbf39a710ca4532eafd423365
2023-02-09 14:34:35 +00:00
Eric Mc Sween
1f566c3556
Merge pull request #10911 from overleaf/em-upgrade-mongo-docstore
...
Upgrade the Mongo driver in docstore
GitOrigin-RevId: 35e5de558e7900fcb455f1044703912077273d47
2022-12-16 09:02:59 +00:00
Jakob Ackermann
d62e2d99c8
Merge pull request #9926 from overleaf/jpa-fallback-lines
...
[docstore] getAllDocs: ensure returned docs have a lines field
GitOrigin-RevId: 8b1eb7ef7e68e50501442cc6700b3d5cb8d4361f
2022-10-12 08:04:07 +00:00
Brian Gough
53d2074315
Merge pull request #9723 from overleaf/bg-log-large-docs-in-docstore-archive
...
warn about oversized docs in docstore archiving
GitOrigin-RevId: 296a49b37b7f6733ef33f682ae40a8d3d478d9e8
2022-09-27 08:03:49 +00:00
Eric Mc Sween
de4091f955
Merge pull request #7869 from overleaf/em-docstore-archive-lock
...
Add a lock around doc archiving
GitOrigin-RevId: eaf85dbc3b491edd15eeb2c1a84df3a2883fb61d
2022-05-18 08:04:44 +00:00
Eric Mc Sween
e0d91eaa26
Merge pull request #7906 from overleaf/em-downgrade-logs
...
Downgrade all INFO logs to DEBUG
GitOrigin-RevId: 05ed582ef0721fcada059f0ad158565f50feca27
2022-05-17 08:05:26 +00:00
Eric Mc Sween
f282b5cb17
Merge pull request #7767 from overleaf/em-relax-unarchive-docs
...
Allow concurrent doc unarchive operations
GitOrigin-RevId: 7edd1bd764125a0dc8e4a5fec643558a56e20f30
2022-04-27 08:04:33 +00:00
Eric Mc Sween
ddb94d159a
Merge pull request #7627 from overleaf/em-docstore-archiving
...
Safer doc unarchiving
GitOrigin-RevId: 60f7aa39401d2f09c13570097c4f376cc401931f
2022-04-27 08:03:57 +00:00
Eric Mc Sween
552d6d4baa
Merge pull request #7581 from overleaf/em-docstore-decaf
...
Decaf cleanup in docstore
GitOrigin-RevId: 84553cec7f184d567dc796c4016d6a412fb8db99
2022-04-20 08:04:15 +00:00
Eric Mc Sween
f7275a6c4b
Merge pull request #6079 from overleaf/em-upgrade-logger
...
Upgrade logger and metrics in all services
GitOrigin-RevId: 2baf63eeeab77fb3559cf763ddacfbf4b745cd0b
2021-12-15 09:04:25 +00:00
Thomas
7bcc585465
Merge pull request #5949 from overleaf/tm-doc-rev-nan-errors
...
Add error for if doc revision is NaN when we check revs
GitOrigin-RevId: 22149c506c9fe1604c76e92b40ac23aca6c40f81
2021-12-01 09:03:05 +00:00
Brian Gough
26d5241eaa
Merge pull request #5891 from overleaf/tm-unarchive-checksum-mismatches
...
Test checksum against buffer, before converting to a JS string
GitOrigin-RevId: 645d8a89a3881275ff555fda00eb4985677c6b34
2021-11-30 09:02:57 +00:00
Jakob Ackermann
669606f797
Merge pull request #5568 from overleaf/jpa-node-no-callback-literal
...
[misc] fix eslint violations for node/no-callback-literal
GitOrigin-RevId: af5aace52e1476b1b0ee48cc8be2aabbe04efac6
2021-10-28 08:03:33 +00:00
Jakob Ackermann
7f9fd00bda
Merge pull request #5367 from overleaf/jpa-node-handle-callback-err
...
[misc] fix eslint violations for node/handle-callback-err
GitOrigin-RevId: 83a4900e8861010df1917bff49382bd9c93375bd
2021-10-28 08:03:26 +00:00
Brian Gough
4688cb7b54
Merge pull request #5575 from overleaf/bg-improve-undelete-doc-admin-page
...
add deletedAt timestamp to undelete doc admin page
GitOrigin-RevId: 46893aae35290e42886320731a5f68811fb3ed46
2021-10-27 08:03:29 +00:00
Brian Gough
8afdc8cbd4
add unit test for withRevCheck method
2021-08-02 11:36:43 +01:00
Brian Gough
7b904d9a9d
fix case of WithRevCheck method
2021-08-02 11:02:12 +01:00
Brian Gough
69339aeb9d
return the origin of peeked docs
2021-08-02 10:25:03 +01:00
Brian Gough
6ce28271eb
peek at docs without unarchiving
2021-07-30 16:06:16 +01:00
Brian Gough
0095a381b0
refactor unarchiveDoc to use a separate getDoc helper
2021-07-30 16:03:43 +01:00
Jakob Ackermann
22a5d5bd80
[misc] temporary override a few new/changed eslint rules
2021-07-13 12:24:42 +01:00
Jakob Ackermann
540b52c128
[misc] run format_fix and lint:fix
2021-07-13 12:04:48 +01:00
Jakob Ackermann
2c35adaf48
[misc] switch from settings-sharelatex to @overleaf/settings
2021-07-12 17:47:20 +01:00
Jakob Ackermann
d69c29e4dc
[misc] apply review feedback on naming functions and parameters
...
Co-Authored-By: Simon Detheridge <s@sd.ai>
2021-06-08 19:29:10 +01:00
Jakob Ackermann
4996f8bbcd
[DocArchiveManager] (un-)archive docs in batches and let db filter docs
...
Also drop the broken 404 logic after switching to db-side filtering.
2021-06-08 12:59:13 +01:00
Jakob Ackermann
9ba8237850
[DocArchiveManager] retry the deletion of doc archives three times
2021-05-05 10:58:33 +01:00
Jakob Ackermann
54c6cce902
Merge pull request #100 from overleaf/jpa-drop-name-filter
...
[MongoManager] drop name filter from getProjectsDeletedDocs
2021-04-21 14:38:40 +02:00
Jakob Ackermann
74aaa73ad2
Merge pull request #101 from overleaf/jpa-destroy-in-small-batches
...
[DocArchiveManager] destroy in small batches
2021-04-16 11:24:04 +02:00
Jakob Ackermann
3f94dd4dbf
[DocArchiveManager] destroy in small batches
...
Also add settings options for PARALLEL_JOBS and DESTROY_BATCH_SIZE.
2021-04-16 09:51:41 +01:00
Jakob Ackermann
5bcd142b6f
[MongoManager] drop name filter from getProjectsDeletedDocs
...
All the doc names we had in the projects collection are back-filled now.
A few docs will get dummy values back-filled.
2021-04-12 17:31:26 +01:00
Jakob Ackermann
e80d013268
[misc] drop the deleteDoc endpoint -- use patchDoc instead
2021-04-12 17:31:18 +01:00
Jakob Ackermann
8915e1d026
[misc] add a new endpoint for getting deleted docs
2021-02-18 10:10:14 +00:00
Jakob Ackermann
0c169cb242
[HttpController] double down on request validation
2021-02-17 11:31:27 +00:00
Jakob Ackermann
26bc074098
[DocstoreManager] patchDoc: allow updates after deletion
2021-02-17 11:31:01 +00:00
Jakob Ackermann
dd4f4057f4
[misc] add a new endpoint for changing a docs meta data -- incl. deleted
...
- Validate the request payload with joi -- includes acceptance tests.
- Reject updates to docs that have been deleted.
2021-02-15 13:13:48 +00:00
Jakob Ackermann
12bef53645
[DocArchiveManager] optionally do not un-archive soft deleted docs
2021-02-09 11:20:26 +00:00
Jakob Ackermann
708bdfd197
[DocManager] optionally flush docs out of mongo when deleting them
2021-02-09 11:17:46 +00:00
Jakob Ackermann
2cf9ff7b41
Merge pull request #89 from overleaf/jpa-is-doc-deleted
...
[misc] add a new endpoint for querying the deleted status of a doc
2021-02-09 11:14:28 +00:00
Jakob Ackermann
3ef1f91f47
Merge pull request #86 from overleaf/jpa-drop-expensive-default
...
[misc] MongoManager: drop unused, potentially expensive default options
2021-02-09 11:14:02 +00:00
Jakob Ackermann
28b1ad3243
[misc] add a new endpoint for querying the deleted status of a doc
...
`/project/:project_id/doc/:doc_id/deleted` responds with:
- 404: the doc does not exist
- 200 and body `{"deleted":true}`: doc exists and is deleted
- 200 and body `{"deleted":false}`: doc exists and is not deleted
2021-01-15 14:49:27 +00:00