Commit graph

430 commits

Author SHA1 Message Date
Jakob Ackermann
ae453d463d Merge pull request #84 from overleaf/jpa-offload-deleted-items
[app] add a new route for archiving a single doc
2021-02-09 11:10:12 +00:00
Jakob Ackermann
28b1ad3243 [misc] add a new endpoint for querying the deleted status of a doc
`/project/:project_id/doc/:doc_id/deleted` responds with:

- 404: the doc does not exist
- 200 and body `{"deleted":true}`: doc exists and is deleted
- 200 and body `{"deleted":false}`: doc exists and is not deleted
2021-01-15 14:49:27 +00:00
Christopher Hoskin
ad45f295ef Merge branch 'master' into csh-issue-3895-node-10-23-1 2021-01-07 08:20:37 +00:00
Christopher Hoskin
fa101a44f7 Update Node to 10.23.1 2021-01-06 09:57:08 +00:00
Jakob Ackermann
1edc628454 [misc] MongoManager: drop unused, potentially expensive default options
All call-sites specify an options object.
2021-01-04 16:07:14 +00:00
Jakob Ackermann
9298f486ad [app] add a new route for archiving a single doc
There is a minor opportunity for optimizing the mongo call(s) for
 archiving: we should include `{ inS3: false }` in the queries instead
 of filtering locally. It's been like that for years now, so it can
 stay a little longer.
2021-01-04 13:47:55 +00:00
Jakob Ackermann
bbcc47a2c4 [misc] fix ci -- pin fake-gcs to a compatible version 2021-01-04 11:57:35 +00:00
dependabot[bot]
2d69ba69c3 Bump ini from 1.3.5 to 1.3.8
Bumps [ini](https://github.com/isaacs/ini) from 1.3.5 to 1.3.8.
- [Release notes](https://github.com/isaacs/ini/releases)
- [Commits](https://github.com/isaacs/ini/compare/v1.3.5...v1.3.8)

Signed-off-by: dependabot[bot] <support@github.com>
2020-12-13 07:35:09 +00:00
Jakob Ackermann
9d633c5fa7 [misc] install @overleaf/object-persistor from tar-ball 2020-12-02 12:39:01 +00:00
Eric Mc Sween
fe39cf053d Merge pull request #79 from overleaf/em-docker-compose-healthchecks
Upgrade build-scripts to 3.4.0
2020-11-26 10:54:40 -05:00
Jakob Ackermann
1e4bc43e08 [misc] bump metrics module to 3.4.1
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:23 +00:00
Eric Mc Sween
f472594819 Upgrade build-scripts to 3.4.0
This version fixes docker-compose health checks for dependent services. See
https://github.com/overleaf/dev-environment/pull/409 for details.
2020-11-24 08:03:29 -05:00
Simon Detheridge
31c757cce2 Don't throw 404 errors when unarchiving, if the doc is already unarchived 2020-09-25 09:17:01 +01:00
Simon Detheridge
0386b871ee Merge pull request #67 from overleaf/jpa-mongodb-shared-db
[misc] simplify mongodb collection access using a shared db construct
2020-09-17 15:42:02 +01:00
Simon Detheridge
867a145843 Merge pull request #74 from overleaf/dependabot-npm_and_yarn-node-fetch-2.6.1
Bump node-fetch from 2.6.0 to 2.6.1
2020-09-17 15:41:45 +01:00
Jakob Ackermann
3644db6848 [misc] mongodb: use the new db connector by default
mongojs was enabling it by default as well.
2020-09-17 15:40:23 +01:00
Jakob Ackermann
b37e27f023 [misc] run the codemod for moving mongo projections into options 2020-09-17 15:40:20 +01:00
Jakob Ackermann
54a82b8c62 [misc] mongodb: export a helper for adding new collections to db
Co-Authored-By: Eric Mc Sween <eric.mcsween@overleaf.com>
Co-Authored-By: Simon Detheridge <s@sd.ai>
2020-09-17 15:39:46 +01:00
Jakob Ackermann
1e7fa2246d [misc] mongodb: refactor the process of setting up the db construct
Co-Authored-By: John Lees-Miller <jdleesmiller@gmail.com>
2020-09-17 15:39:46 +01:00
Jakob Ackermann
8a8a830ad3 [misc] simplify mongodb collection access using a shared db construct
Resolve the getCollection Promises once and store the result in a shared
 `db` object which can get imported by all the call-sites.

The http server is starting only after a Promise of `waitForDb()`
 resolves. This covers the app code and the acceptance tests.
2020-09-17 15:39:44 +01:00
Simon Detheridge
f90d12ed21 Merge pull request #77 from overleaf/spd-node-upgrade
Upgrade node to 10.22.1
2020-09-17 15:37:59 +01:00
dependabot[bot]
7dd2d95b16 Bump node-fetch from 2.6.0 to 2.6.1
Bumps [node-fetch](https://github.com/bitinn/node-fetch) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases)
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md)
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1)

Signed-off-by: dependabot[bot] <support@github.com>
2020-09-17 14:37:55 +00:00
Simon Detheridge
360830d3cd Merge pull request #76 from overleaf/spd-remove-old-scripts
Remove rearchive script
2020-09-17 15:37:48 +01:00
Simon Detheridge
9ec93ca0d6 Merge pull request #75 from overleaf/spd-p-map
Replace tiny-async-pool with p-map
2020-09-17 15:37:37 +01:00
Simon Detheridge
1b73733625 Merge pull request #73 from overleaf/spd-metrics-upgrade
Upgrade metrics to @overleaf/metrics'
2020-09-17 15:37:08 +01:00
Simon Detheridge
2ce0ea7e72 Merge pull request #68 from overleaf/dependabot-npm_and_yarn-bl-2.2.1
Bump bl from 2.2.0 to 2.2.1
2020-09-17 15:36:15 +01:00
Simon Detheridge
465bf473d9 Upgrade node to 10.22.1 2020-09-17 14:30:25 +01:00
Simon Detheridge
5d76859622 Remove rearchive script 2020-09-14 16:41:40 +01:00
Simon Detheridge
90a6642b33 Replace tiny-async-pool with p-map 2020-09-14 16:34:34 +01:00
Simon Detheridge
96b85da43e Update package hashes 2020-09-14 16:13:18 +01:00
Simon Detheridge
ad4531ff01 Upgrade metrics to @overleaf/metrics' 2020-09-10 18:07:14 +01:00
Simon Detheridge
1988d0afb5 Update scripts/rearchive-all-docs.js
Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>
2020-09-04 14:50:50 +01:00
Simon Detheridge
0911011624 Add 'endId' parameter to rearchive script 2020-09-04 14:14:20 +01:00
dependabot[bot]
96f909deaa Bump bl from 2.2.0 to 2.2.1
Bumps [bl](https://github.com/rvagg/bl) from 2.2.0 to 2.2.1.
- [Release notes](https://github.com/rvagg/bl/releases)
- [Commits](https://github.com/rvagg/bl/compare/v2.2.0...v2.2.1)

Signed-off-by: dependabot[bot] <support@github.com>
2020-09-03 19:15:41 +00:00
Simon Detheridge
f9862081b7 Add script to migrate data from S3 2020-08-26 11:46:40 +01:00
Jakob Ackermann
2fa09928ee [misc] migrate acceptance tests to the native mongo driver, drop mongojs 2020-08-25 09:41:23 +01:00
Jakob Ackermann
df0747ec48 [misc] migrate the app to the native mongo driver
acceptance tests to follow in a separate commit
2020-08-25 09:40:59 +01:00
Christopher Hoskin
16c9ab38b2 Fix formating 2020-08-12 15:29:19 +01:00
Christopher Hoskin
2be47a6820 Add missing eslint-plugin-chai-friendly@^0.5.0 2020-08-12 15:24:43 +01:00
Christopher Hoskin
d1da5e43af [misc] bump logger-sharelatex to version 2.2.0 2020-08-12 15:17:06 +01:00
Simon Detheridge
d5214d4351 Update object-persistor module 2020-08-10 16:53:18 +01:00
Simon Detheridge
1575cd41eb Don't pass empty array to asyncPool when archiving 2020-08-10 15:44:41 +01:00
Simon Detheridge
e4d7c253c0 Fallback to AWS_BUCKET env var in settings for backwards compatiblity 2020-08-10 11:55:39 +01:00
Simon Detheridge
a18146612a Remove unhandled-promise-rejection handler 2020-07-31 16:25:33 +01:00
Simon Detheridge
a4d0813acb Update build scripts 2020-07-31 16:24:41 +01:00
Simon Detheridge
cb8c2bf4b5 AsyncPool -> asyncPool 2020-07-31 16:21:59 +01:00
Simon Detheridge
9724407e31 Export .promises from MongoManager 2020-07-31 16:20:07 +01:00
Simon Detheridge
268f436461 Don't call AsyncPool with an empty array 2020-07-24 11:51:18 +01:00
Simon Detheridge
fdefb311ab Fix sha1 package hashes 2020-07-24 11:50:53 +01:00
Simon Detheridge
04ae868fe2 Update unit tests for object-persistor 2020-07-23 19:43:51 +01:00
Simon Detheridge
e302c1d844 Update acceptance tests for object-persistor and gcs 2020-07-23 19:43:33 +01:00
Simon Detheridge
6e04db552a Implement object-persistor support 2020-07-23 19:42:49 +01:00
Simon Detheridge
812c996c47 Add required settings for object-persistor 2020-07-23 19:42:20 +01:00
Simon Detheridge
287d705671 Update buildscripts to use fake-gcs instead of S3 credentials 2020-07-23 19:30:13 +01:00
Simon Detheridge
99a3266105 Add object-persistor module and upgrade deps to latest minor release 2020-07-23 19:29:25 +01:00
Christopher Hoskin
4cfeccf593 Revert "Revert "Move acceptance test cred config to docker-compose-config.yml""
This reverts commit 703447d33883b45d119ddccee1df4b9ad098b0c2.
2020-07-21 10:03:34 +01:00
Christopher Hoskin
19c871c5f8 Revert "Revert "Add note on running tests""
This reverts commit 81fdd6a5d1068cbb9f44adecc399e8871ce99dad.
2020-07-21 10:03:14 +01:00
Christopher Hoskin
ab63007391 Revert "Revert "Bump buildscript to 2.3.0""
This reverts commit 8f631e450cb17beac28fa6e62303bcb413562c46.
2020-07-21 10:02:43 +01:00
Christopher Hoskin
d5fba45a2e Revert "Bump buildscript to 2.3.0"
This reverts commit 57b9d3ef79f0b8bf466cb3a66c27eda92d21c05f.
2020-07-21 09:59:19 +01:00
Christopher Hoskin
942c4b6fbe Revert "Add note on running tests"
This reverts commit 735084fef85f9721849184958b64a50eed65cea0.
2020-07-21 09:59:07 +01:00
Christopher Hoskin
e6a2a1922a Revert "Move acceptance test cred config to docker-compose-config.yml"
This reverts commit e59452567f79540c303b6451638bfe83b294fb79.
2020-07-21 09:58:44 +01:00
Christopher Hoskin
6b92c5d21d Move acceptance test cred config to docker-compose-config.yml 2020-07-21 09:37:48 +01:00
Christopher Hoskin
b42a945a1d Add note on running tests 2020-07-21 09:29:45 +01:00
Christopher Hoskin
bd4b9ed177 Bump buildscript to 2.3.0 2020-07-21 09:23:23 +01:00
Jakob Ackermann
32bef75ba7 Merge pull request #60 from overleaf/csh-issue-1123-bump-logger-210
Update logger to 2.1.0
2020-07-02 15:52:58 +02:00
Ersun Warncke
06ec5556b0 [misc] fix express deprecations
Co-Authored-By: Jakob Ackermann <jakob.ackermann@overleaf.com>
2020-07-02 14:48:11 +01:00
Christopher Hoskin
19177b68dd Update logger to 2.1.0 2020-07-01 15:57:13 +01:00
Brian Gough
960dbc2e87 update buildscript.txt to node 10.21.0 2020-06-03 11:12:03 +01:00
Brian Gough
7585209fb6 update to node 10.21.0 2020-06-03 10:22:48 +01:00
Tim Alby
c854f1f570 prettier auto-format 2020-05-28 15:20:54 +02:00
Tim Alby
9712f518bd update build scripts to 2.2.0 2020-05-28 15:19:48 +02:00
Jakob Ackermann
80095785b8 [misc] test/unit: fix process usage for node v12
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-04-20 16:50:51 +02:00
Eric Mc Sween
56d044b546 Upgrade metrics-sharelatex to 2.6.2
This version fixes the HTTP request timing metrics, which were not
reporting correctly.
2020-03-25 10:07:26 -04:00
mserranom
91a1fadbb1 updated async and bunyan 2020-03-23 12:45:29 +01:00
mserranom
25704ea301 updated chai, mocha, sinon and sandboxed-module 2020-03-23 12:39:09 +01:00
mserranom
97a3fd3202 updated minor/patch dependencies and known safe updates 2020-03-23 12:32:25 +01:00
mserranom
d78e8d7d3f npm audit fix 2020-03-23 12:30:33 +01:00
mserranom
9f88236f31 updated build scripts 2020-03-23 12:30:16 +01:00
Eric Mc Sween
f8a5feae18 Make max doc length configurable via an env variable 2020-03-09 08:38:03 -04:00
dependabot[bot]
fbece45717 Bump request from 2.34.0 to 2.47.0
Bumps [request](https://github.com/request/request) from 2.34.0 to 2.47.0.
- [Release notes](https://github.com/request/request/releases)
- [Changelog](https://github.com/request/request/blob/master/CHANGELOG.md)
- [Commits](https://github.com/request/request/compare/v2.34.0...v2.47.0)

Signed-off-by: dependabot[bot] <support@github.com>
2020-02-17 10:49:38 +00:00
dependabot[bot]
e57545a532 Bump express from 4.1.2 to 4.5.0
Bumps [express](https://github.com/expressjs/express) from 4.1.2 to 4.5.0.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.1.2...4.5.0)

Signed-off-by: dependabot[bot] <support@github.com>
2020-02-17 10:49:36 +00:00
Simon Detheridge
cfad4b585d Fix linting errors missed by bulk-decaffienate 2020-02-17 10:49:34 +00:00
Simon Detheridge
746791766c Additional prettier fix 2020-02-17 10:49:32 +00:00
Simon Detheridge
10a3eadde9 Upgrade sha1 hashes to sha512 2020-02-17 10:49:29 +00:00
Simon Detheridge
5fc8c3a3c7 Uninstall coffee-script 2020-02-17 10:49:28 +00:00
Simon Detheridge
5bca0c9bab prettier: convert individual decaffeinated files to Prettier format 2020-02-17 10:49:26 +00:00
Simon Detheridge
421d6dabab decaffeinate: convert individual files to js 2020-02-17 10:49:24 +00:00
Simon Detheridge
b8aa04b9ff decaffeinate: rename individual coffee files to js files 2020-02-17 10:49:22 +00:00
Simon Detheridge
785a6cb544 prettier: convert test/acceptance decaffeinated files to Prettier format 2020-02-17 10:49:20 +00:00
Simon Detheridge
7e131e4c71 decaffeinate: rename test/acceptance/coffee to test/acceptance/js 2020-02-17 10:49:18 +00:00
decaffeinate
1391ae96e7 decaffeinate: Run post-processing cleanups on ArchiveDocsTests.coffee and 6 other files 2020-02-17 10:49:16 +00:00
decaffeinate
73b0bc023f decaffeinate: Convert ArchiveDocsTests.coffee and 6 other files to JS 2020-02-17 10:49:14 +00:00
decaffeinate
93c718dae9 decaffeinate: Rename ArchiveDocsTests.coffee and 6 other files from .coffee to .js 2020-02-17 10:49:13 +00:00
Simon Detheridge
088fd29391 prettier: convert test/unit decaffeinated files to Prettier format 2020-02-17 10:49:11 +00:00
Simon Detheridge
75f1245610 decaffeinate: rename test/unit/coffee to test/unit/js 2020-02-17 10:49:08 +00:00
decaffeinate
6e498152fd decaffeinate: Run post-processing cleanups on DocArchiveManagerTests.coffee and 4 other files 2020-02-17 10:49:06 +00:00
decaffeinate
06bdba5c14 decaffeinate: Convert DocArchiveManagerTests.coffee and 4 other files to JS 2020-02-17 10:49:04 +00:00
decaffeinate
5098fa6d40 decaffeinate: Rename DocArchiveManagerTests.coffee and 4 other files from .coffee to .js 2020-02-17 10:49:02 +00:00
Simon Detheridge
fb931e206c prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 10:49:00 +00:00
Simon Detheridge
c1805978c4 decaffeinate: rename app/coffee dir to app/js 2020-02-17 10:48:58 +00:00
decaffeinate
d31a747c72 decaffeinate: Run post-processing cleanups on DocArchiveManager.coffee and 7 other files 2020-02-17 10:48:57 +00:00
decaffeinate
afa2577381 decaffeinate: Convert DocArchiveManager.coffee and 7 other files to JS 2020-02-17 10:48:55 +00:00
decaffeinate
88badb15c4 decaffeinate: Rename DocArchiveManager.coffee and 7 other files from .coffee to .js 2020-02-17 10:48:53 +00:00
Simon Detheridge
b4aec5394b decaffeinate: add eslint and prettier packages 2020-02-17 10:48:52 +00:00
Simon Detheridge
b54e4cd276 decaffeinate: update .gitignore 2020-02-17 10:48:50 +00:00
Simon Detheridge
8fd7dbf133 decaffeinate: update build scripts to es 2020-02-16 13:59:59 +00:00
Jakob Ackermann
6c832439a2 Merge pull request #51 from overleaf/jpa-dependencies-cleanup
[misc] cleanup unused dependency on redis
2020-02-14 10:55:52 +01:00
Jakob Ackermann
f2577a16cc [misc] cleanup unused dependency on redis 2020-02-12 14:43:19 +01:00
Brian Gough
f8c93b644c remove unused .travis.yml file 2020-02-12 12:37:00 +00:00
Jakob Ackermann
710577cdb1 [misc] update the build scripts to 1.3.5 2020-02-11 12:27:58 +01:00
Brian Gough
31349a40cd update node version in buildscript.txt 2020-02-07 15:31:03 +00:00
Brian Gough
f93ee6ab57 update .nvmrc 2020-02-07 15:30:41 +00:00
Brian Gough
1132932dfc update to node 10.19.0 2020-02-07 14:16:31 +00:00
Shane Kilkelly
641608c6be Merge pull request #43 from overleaf/sk-update-node-10
Update to node 10, and move to package-lock.json
2019-11-06 11:33:10 +00:00
Nate Stemen
bfa4cc0023 bump build script to 1.1.24 2019-10-25 12:59:47 -04:00
Nate Stemen
bec7e7c0e1 replace private link with public one 2019-10-25 12:59:28 -04:00
Shane Kilkelly
67735bb2db Update to node 10, and move to package-lock.json
In this case, the npm-shrinkwrap file was using the old v0 format,
and npm needed to effectively re-write the entire file.
2019-09-27 16:22:15 +01:00
Simon Detheridge
03b8a1901d Account for ranges in large json payloads and add line-count limit 2019-08-06 09:50:04 +01:00
Simon Detheridge
e1868e2b54 Log request on error 2019-07-31 15:07:28 +01:00
Simon Detheridge
a9d8e938ca Merge pull request #39 from overleaf/sk-dep-upgrades-2019-06
update logger and metrics
2019-07-08 14:03:58 +01:00
Simon Detheridge
5261e1b0be Add endpoint to completely purge a document 2019-07-02 15:02:37 +01:00
Shane Kilkelly
a9b35dde00 update logger and metrics 2019-06-19 09:37:54 +01:00
Timothée Alby
3de8e93815 update Git URL in Jenkinsfile 2019-05-07 18:39:09 +02:00
Timothée Alby
0ee7a81a02 Update README.md 2019-05-07 16:25:59 +01:00
Henry Oswald
cfd6225b1c bulk upgrade to 1.1.12, moved to npm rather than git 2019-01-31 15:48:17 +00:00
Christopher Hoskin
5b70587765 Add **/*.map to .gitignore 2019-01-09 10:32:59 +00:00
Christopher Hoskin
27709709f3 Remove grunt 2019-01-09 10:31:42 +00:00
Christopher Hoskin
6760dd6ce0 Shrinkwrap 2019-01-09 10:29:24 +00:00
Christopher Hoskin
93443c737f Add note on running acceptance tests to README 2019-01-09 10:24:25 +00:00
Christopher Hoskin
b563b1b003 Bump logger to v1.5.9 and settings to v1.1.0 2019-01-09 08:50:53 +00:00
Christopher Hoskin
d1854c1897 Adapt for metrics v2 2019-01-09 08:49:32 +00:00
Christopher Hoskin
5dc2df2a70 Merge branch 'master' into csh-ho-docker-issue-1338-bulk-upgrade 2019-01-09 08:41:10 +00:00
Henry Oswald
06babdf789 remove inline maps 2018-12-11 14:49:29 +00:00
Henry Oswald
7358f91ea9 inline source maps, remove grunt, clean dev deps 2018-12-11 14:43:39 +00:00
Henry Oswald
b68d7d46a2 update coffeescript 2018-12-11 14:36:35 +00:00
Henry Oswald
36a0216f44 trying source context 2018-12-11 14:26:06 +00:00
Henry Oswald
3a963c1832 bump metrics 2018-12-11 14:17:38 +00:00
Henry Oswald
bd7a764b7e bump metrics 2018-12-10 22:04:16 +00:00
Henry Oswald
b8f3fbd1cf bump build script 2018-12-10 21:42:14 +00:00
Henry Oswald
30368dd8b9 try new mongo metrics 2018-11-27 12:07:40 +00:00
Henry Oswald
04cfb8fa0e use labels metrics 2018-11-26 09:47:05 +00:00
Henry Oswald
53654b3eaf bump metrics 2018-11-23 15:42:29 +00:00
Henry Oswald
4ea9328099 bump metrics 2018-11-20 17:17:29 +00:00
Henry Oswald
459d07dd69 bump metrics 2018-11-20 16:29:02 +00:00
Henry Oswald
56047f884c bump metrics 2018-11-20 16:14:14 +00:00
Henry Oswald
ff29557fb4 bump metrics version 2018-11-20 16:06:36 +00:00
Henry Oswald
f321341227 bump metrics to work with promethious 2018-11-20 14:58:19 +00:00
Henry Oswald
7e3c6ddb3f also delete doc ops 2018-10-19 12:10:33 +01:00
Henry Oswald
2ccc4d8d3f also delete doc ops 2018-10-19 11:54:19 +01:00
Henry Oswald
2828df74e5 hard delete a doc on health check 2018-10-18 18:06:05 +01:00