Commit graph

514 commits

Author SHA1 Message Date
Jakob Ackermann
b37e27f023 [misc] run the codemod for moving mongo projections into options 2020-09-17 15:40:20 +01:00
Jakob Ackermann
54a82b8c62 [misc] mongodb: export a helper for adding new collections to db
Co-Authored-By: Eric Mc Sween <eric.mcsween@overleaf.com>
Co-Authored-By: Simon Detheridge <s@sd.ai>
2020-09-17 15:39:46 +01:00
Jakob Ackermann
1e7fa2246d [misc] mongodb: refactor the process of setting up the db construct
Co-Authored-By: John Lees-Miller <jdleesmiller@gmail.com>
2020-09-17 15:39:46 +01:00
Jakob Ackermann
8a8a830ad3 [misc] simplify mongodb collection access using a shared db construct
Resolve the getCollection Promises once and store the result in a shared
 `db` object which can get imported by all the call-sites.

The http server is starting only after a Promise of `waitForDb()`
 resolves. This covers the app code and the acceptance tests.
2020-09-17 15:39:44 +01:00
Simon Detheridge
f90d12ed21 Merge pull request #77 from overleaf/spd-node-upgrade
Upgrade node to 10.22.1
2020-09-17 15:37:59 +01:00
dependabot[bot]
7dd2d95b16 Bump node-fetch from 2.6.0 to 2.6.1
Bumps [node-fetch](https://github.com/bitinn/node-fetch) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases)
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md)
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1)

Signed-off-by: dependabot[bot] <support@github.com>
2020-09-17 14:37:55 +00:00
Simon Detheridge
360830d3cd Merge pull request #76 from overleaf/spd-remove-old-scripts
Remove rearchive script
2020-09-17 15:37:48 +01:00
Simon Detheridge
9ec93ca0d6 Merge pull request #75 from overleaf/spd-p-map
Replace tiny-async-pool with p-map
2020-09-17 15:37:37 +01:00
Simon Detheridge
1b73733625 Merge pull request #73 from overleaf/spd-metrics-upgrade
Upgrade metrics to @overleaf/metrics'
2020-09-17 15:37:08 +01:00
Simon Detheridge
2ce0ea7e72 Merge pull request #68 from overleaf/dependabot-npm_and_yarn-bl-2.2.1
Bump bl from 2.2.0 to 2.2.1
2020-09-17 15:36:15 +01:00
Simon Detheridge
465bf473d9 Upgrade node to 10.22.1 2020-09-17 14:30:25 +01:00
Simon Detheridge
5d76859622 Remove rearchive script 2020-09-14 16:41:40 +01:00
Simon Detheridge
90a6642b33 Replace tiny-async-pool with p-map 2020-09-14 16:34:34 +01:00
Simon Detheridge
96b85da43e Update package hashes 2020-09-14 16:13:18 +01:00
Simon Detheridge
ad4531ff01 Upgrade metrics to @overleaf/metrics' 2020-09-10 18:07:14 +01:00
Simon Detheridge
1988d0afb5 Update scripts/rearchive-all-docs.js
Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>
2020-09-04 14:50:50 +01:00
Simon Detheridge
0911011624 Add 'endId' parameter to rearchive script 2020-09-04 14:14:20 +01:00
dependabot[bot]
96f909deaa Bump bl from 2.2.0 to 2.2.1
Bumps [bl](https://github.com/rvagg/bl) from 2.2.0 to 2.2.1.
- [Release notes](https://github.com/rvagg/bl/releases)
- [Commits](https://github.com/rvagg/bl/compare/v2.2.0...v2.2.1)

Signed-off-by: dependabot[bot] <support@github.com>
2020-09-03 19:15:41 +00:00
Simon Detheridge
f9862081b7 Add script to migrate data from S3 2020-08-26 11:46:40 +01:00
Jakob Ackermann
2fa09928ee [misc] migrate acceptance tests to the native mongo driver, drop mongojs 2020-08-25 09:41:23 +01:00
Jakob Ackermann
df0747ec48 [misc] migrate the app to the native mongo driver
acceptance tests to follow in a separate commit
2020-08-25 09:40:59 +01:00
Christopher Hoskin
16c9ab38b2 Fix formating 2020-08-12 15:29:19 +01:00
Christopher Hoskin
2be47a6820 Add missing eslint-plugin-chai-friendly@^0.5.0 2020-08-12 15:24:43 +01:00
Christopher Hoskin
d1da5e43af [misc] bump logger-sharelatex to version 2.2.0 2020-08-12 15:17:06 +01:00
Simon Detheridge
d5214d4351 Update object-persistor module 2020-08-10 16:53:18 +01:00
Simon Detheridge
1575cd41eb Don't pass empty array to asyncPool when archiving 2020-08-10 15:44:41 +01:00
Simon Detheridge
e4d7c253c0 Fallback to AWS_BUCKET env var in settings for backwards compatiblity 2020-08-10 11:55:39 +01:00
Simon Detheridge
a18146612a Remove unhandled-promise-rejection handler 2020-07-31 16:25:33 +01:00
Simon Detheridge
a4d0813acb Update build scripts 2020-07-31 16:24:41 +01:00
Simon Detheridge
cb8c2bf4b5 AsyncPool -> asyncPool 2020-07-31 16:21:59 +01:00
Simon Detheridge
9724407e31 Export .promises from MongoManager 2020-07-31 16:20:07 +01:00
Simon Detheridge
268f436461 Don't call AsyncPool with an empty array 2020-07-24 11:51:18 +01:00
Simon Detheridge
fdefb311ab Fix sha1 package hashes 2020-07-24 11:50:53 +01:00
Simon Detheridge
04ae868fe2 Update unit tests for object-persistor 2020-07-23 19:43:51 +01:00
Simon Detheridge
e302c1d844 Update acceptance tests for object-persistor and gcs 2020-07-23 19:43:33 +01:00
Simon Detheridge
6e04db552a Implement object-persistor support 2020-07-23 19:42:49 +01:00
Simon Detheridge
812c996c47 Add required settings for object-persistor 2020-07-23 19:42:20 +01:00
Simon Detheridge
287d705671 Update buildscripts to use fake-gcs instead of S3 credentials 2020-07-23 19:30:13 +01:00
Simon Detheridge
99a3266105 Add object-persistor module and upgrade deps to latest minor release 2020-07-23 19:29:25 +01:00
Christopher Hoskin
4cfeccf593 Revert "Revert "Move acceptance test cred config to docker-compose-config.yml""
This reverts commit 703447d33883b45d119ddccee1df4b9ad098b0c2.
2020-07-21 10:03:34 +01:00
Christopher Hoskin
19c871c5f8 Revert "Revert "Add note on running tests""
This reverts commit 81fdd6a5d1068cbb9f44adecc399e8871ce99dad.
2020-07-21 10:03:14 +01:00
Christopher Hoskin
ab63007391 Revert "Revert "Bump buildscript to 2.3.0""
This reverts commit 8f631e450cb17beac28fa6e62303bcb413562c46.
2020-07-21 10:02:43 +01:00
Christopher Hoskin
d5fba45a2e Revert "Bump buildscript to 2.3.0"
This reverts commit 57b9d3ef79f0b8bf466cb3a66c27eda92d21c05f.
2020-07-21 09:59:19 +01:00
Christopher Hoskin
942c4b6fbe Revert "Add note on running tests"
This reverts commit 735084fef85f9721849184958b64a50eed65cea0.
2020-07-21 09:59:07 +01:00
Christopher Hoskin
e6a2a1922a Revert "Move acceptance test cred config to docker-compose-config.yml"
This reverts commit e59452567f79540c303b6451638bfe83b294fb79.
2020-07-21 09:58:44 +01:00
Christopher Hoskin
6b92c5d21d Move acceptance test cred config to docker-compose-config.yml 2020-07-21 09:37:48 +01:00
Christopher Hoskin
b42a945a1d Add note on running tests 2020-07-21 09:29:45 +01:00
Christopher Hoskin
bd4b9ed177 Bump buildscript to 2.3.0 2020-07-21 09:23:23 +01:00
Jakob Ackermann
32bef75ba7 Merge pull request #60 from overleaf/csh-issue-1123-bump-logger-210
Update logger to 2.1.0
2020-07-02 15:52:58 +02:00
Ersun Warncke
06ec5556b0 [misc] fix express deprecations
Co-Authored-By: Jakob Ackermann <jakob.ackermann@overleaf.com>
2020-07-02 14:48:11 +01:00
Christopher Hoskin
19177b68dd Update logger to 2.1.0 2020-07-01 15:57:13 +01:00
Brian Gough
960dbc2e87 update buildscript.txt to node 10.21.0 2020-06-03 11:12:03 +01:00
Brian Gough
7585209fb6 update to node 10.21.0 2020-06-03 10:22:48 +01:00
Tim Alby
c854f1f570 prettier auto-format 2020-05-28 15:20:54 +02:00
Tim Alby
9712f518bd update build scripts to 2.2.0 2020-05-28 15:19:48 +02:00
Jakob Ackermann
80095785b8 [misc] test/unit: fix process usage for node v12
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-04-20 16:50:51 +02:00
Eric Mc Sween
56d044b546 Upgrade metrics-sharelatex to 2.6.2
This version fixes the HTTP request timing metrics, which were not
reporting correctly.
2020-03-25 10:07:26 -04:00
mserranom
91a1fadbb1 updated async and bunyan 2020-03-23 12:45:29 +01:00
mserranom
25704ea301 updated chai, mocha, sinon and sandboxed-module 2020-03-23 12:39:09 +01:00
mserranom
97a3fd3202 updated minor/patch dependencies and known safe updates 2020-03-23 12:32:25 +01:00
mserranom
d78e8d7d3f npm audit fix 2020-03-23 12:30:33 +01:00
mserranom
9f88236f31 updated build scripts 2020-03-23 12:30:16 +01:00
Eric Mc Sween
f8a5feae18 Make max doc length configurable via an env variable 2020-03-09 08:38:03 -04:00
dependabot[bot]
fbece45717 Bump request from 2.34.0 to 2.47.0
Bumps [request](https://github.com/request/request) from 2.34.0 to 2.47.0.
- [Release notes](https://github.com/request/request/releases)
- [Changelog](https://github.com/request/request/blob/master/CHANGELOG.md)
- [Commits](https://github.com/request/request/compare/v2.34.0...v2.47.0)

Signed-off-by: dependabot[bot] <support@github.com>
2020-02-17 10:49:38 +00:00
dependabot[bot]
e57545a532 Bump express from 4.1.2 to 4.5.0
Bumps [express](https://github.com/expressjs/express) from 4.1.2 to 4.5.0.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.1.2...4.5.0)

Signed-off-by: dependabot[bot] <support@github.com>
2020-02-17 10:49:36 +00:00
Simon Detheridge
cfad4b585d Fix linting errors missed by bulk-decaffienate 2020-02-17 10:49:34 +00:00
Simon Detheridge
746791766c Additional prettier fix 2020-02-17 10:49:32 +00:00
Simon Detheridge
10a3eadde9 Upgrade sha1 hashes to sha512 2020-02-17 10:49:29 +00:00
Simon Detheridge
5fc8c3a3c7 Uninstall coffee-script 2020-02-17 10:49:28 +00:00
Simon Detheridge
5bca0c9bab prettier: convert individual decaffeinated files to Prettier format 2020-02-17 10:49:26 +00:00
Simon Detheridge
421d6dabab decaffeinate: convert individual files to js 2020-02-17 10:49:24 +00:00
Simon Detheridge
b8aa04b9ff decaffeinate: rename individual coffee files to js files 2020-02-17 10:49:22 +00:00
Simon Detheridge
785a6cb544 prettier: convert test/acceptance decaffeinated files to Prettier format 2020-02-17 10:49:20 +00:00
Simon Detheridge
7e131e4c71 decaffeinate: rename test/acceptance/coffee to test/acceptance/js 2020-02-17 10:49:18 +00:00
decaffeinate
1391ae96e7 decaffeinate: Run post-processing cleanups on ArchiveDocsTests.coffee and 6 other files 2020-02-17 10:49:16 +00:00
decaffeinate
73b0bc023f decaffeinate: Convert ArchiveDocsTests.coffee and 6 other files to JS 2020-02-17 10:49:14 +00:00
decaffeinate
93c718dae9 decaffeinate: Rename ArchiveDocsTests.coffee and 6 other files from .coffee to .js 2020-02-17 10:49:13 +00:00
Simon Detheridge
088fd29391 prettier: convert test/unit decaffeinated files to Prettier format 2020-02-17 10:49:11 +00:00
Simon Detheridge
75f1245610 decaffeinate: rename test/unit/coffee to test/unit/js 2020-02-17 10:49:08 +00:00
decaffeinate
6e498152fd decaffeinate: Run post-processing cleanups on DocArchiveManagerTests.coffee and 4 other files 2020-02-17 10:49:06 +00:00
decaffeinate
06bdba5c14 decaffeinate: Convert DocArchiveManagerTests.coffee and 4 other files to JS 2020-02-17 10:49:04 +00:00
decaffeinate
5098fa6d40 decaffeinate: Rename DocArchiveManagerTests.coffee and 4 other files from .coffee to .js 2020-02-17 10:49:02 +00:00
Simon Detheridge
fb931e206c prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 10:49:00 +00:00
Simon Detheridge
c1805978c4 decaffeinate: rename app/coffee dir to app/js 2020-02-17 10:48:58 +00:00
decaffeinate
d31a747c72 decaffeinate: Run post-processing cleanups on DocArchiveManager.coffee and 7 other files 2020-02-17 10:48:57 +00:00
decaffeinate
afa2577381 decaffeinate: Convert DocArchiveManager.coffee and 7 other files to JS 2020-02-17 10:48:55 +00:00
decaffeinate
88badb15c4 decaffeinate: Rename DocArchiveManager.coffee and 7 other files from .coffee to .js 2020-02-17 10:48:53 +00:00
Simon Detheridge
b4aec5394b decaffeinate: add eslint and prettier packages 2020-02-17 10:48:52 +00:00
Simon Detheridge
b54e4cd276 decaffeinate: update .gitignore 2020-02-17 10:48:50 +00:00
Simon Detheridge
8fd7dbf133 decaffeinate: update build scripts to es 2020-02-16 13:59:59 +00:00
Jakob Ackermann
6c832439a2 Merge pull request #51 from overleaf/jpa-dependencies-cleanup
[misc] cleanup unused dependency on redis
2020-02-14 10:55:52 +01:00
Jakob Ackermann
f2577a16cc [misc] cleanup unused dependency on redis 2020-02-12 14:43:19 +01:00
Brian Gough
f8c93b644c remove unused .travis.yml file 2020-02-12 12:37:00 +00:00
Jakob Ackermann
710577cdb1 [misc] update the build scripts to 1.3.5 2020-02-11 12:27:58 +01:00
Brian Gough
31349a40cd update node version in buildscript.txt 2020-02-07 15:31:03 +00:00
Brian Gough
f93ee6ab57 update .nvmrc 2020-02-07 15:30:41 +00:00
Brian Gough
1132932dfc update to node 10.19.0 2020-02-07 14:16:31 +00:00
Shane Kilkelly
641608c6be Merge pull request #43 from overleaf/sk-update-node-10
Update to node 10, and move to package-lock.json
2019-11-06 11:33:10 +00:00
Nate Stemen
bfa4cc0023 bump build script to 1.1.24 2019-10-25 12:59:47 -04:00
Nate Stemen
bec7e7c0e1 replace private link with public one 2019-10-25 12:59:28 -04:00
Shane Kilkelly
67735bb2db Update to node 10, and move to package-lock.json
In this case, the npm-shrinkwrap file was using the old v0 format,
and npm needed to effectively re-write the entire file.
2019-09-27 16:22:15 +01:00
Simon Detheridge
03b8a1901d Account for ranges in large json payloads and add line-count limit 2019-08-06 09:50:04 +01:00
Simon Detheridge
e1868e2b54 Log request on error 2019-07-31 15:07:28 +01:00
Simon Detheridge
a9d8e938ca Merge pull request #39 from overleaf/sk-dep-upgrades-2019-06
update logger and metrics
2019-07-08 14:03:58 +01:00
Simon Detheridge
5261e1b0be Add endpoint to completely purge a document 2019-07-02 15:02:37 +01:00
Shane Kilkelly
a9b35dde00 update logger and metrics 2019-06-19 09:37:54 +01:00
Timothée Alby
3de8e93815 update Git URL in Jenkinsfile 2019-05-07 18:39:09 +02:00
Timothée Alby
0ee7a81a02 Update README.md 2019-05-07 16:25:59 +01:00
Henry Oswald
cfd6225b1c bulk upgrade to 1.1.12, moved to npm rather than git 2019-01-31 15:48:17 +00:00
Christopher Hoskin
5b70587765 Add **/*.map to .gitignore 2019-01-09 10:32:59 +00:00
Christopher Hoskin
27709709f3 Remove grunt 2019-01-09 10:31:42 +00:00
Christopher Hoskin
6760dd6ce0 Shrinkwrap 2019-01-09 10:29:24 +00:00
Christopher Hoskin
93443c737f Add note on running acceptance tests to README 2019-01-09 10:24:25 +00:00
Christopher Hoskin
b563b1b003 Bump logger to v1.5.9 and settings to v1.1.0 2019-01-09 08:50:53 +00:00
Christopher Hoskin
d1854c1897 Adapt for metrics v2 2019-01-09 08:49:32 +00:00
Christopher Hoskin
5dc2df2a70 Merge branch 'master' into csh-ho-docker-issue-1338-bulk-upgrade 2019-01-09 08:41:10 +00:00
Henry Oswald
06babdf789 remove inline maps 2018-12-11 14:49:29 +00:00
Henry Oswald
7358f91ea9 inline source maps, remove grunt, clean dev deps 2018-12-11 14:43:39 +00:00
Henry Oswald
b68d7d46a2 update coffeescript 2018-12-11 14:36:35 +00:00
Henry Oswald
36a0216f44 trying source context 2018-12-11 14:26:06 +00:00
Henry Oswald
3a963c1832 bump metrics 2018-12-11 14:17:38 +00:00
Henry Oswald
bd7a764b7e bump metrics 2018-12-10 22:04:16 +00:00
Henry Oswald
b8f3fbd1cf bump build script 2018-12-10 21:42:14 +00:00
Henry Oswald
30368dd8b9 try new mongo metrics 2018-11-27 12:07:40 +00:00
Henry Oswald
04cfb8fa0e use labels metrics 2018-11-26 09:47:05 +00:00
Henry Oswald
53654b3eaf bump metrics 2018-11-23 15:42:29 +00:00
Henry Oswald
4ea9328099 bump metrics 2018-11-20 17:17:29 +00:00
Henry Oswald
459d07dd69 bump metrics 2018-11-20 16:29:02 +00:00
Henry Oswald
56047f884c bump metrics 2018-11-20 16:14:14 +00:00
Henry Oswald
ff29557fb4 bump metrics version 2018-11-20 16:06:36 +00:00
Henry Oswald
f321341227 bump metrics to work with promethious 2018-11-20 14:58:19 +00:00
Henry Oswald
7e3c6ddb3f also delete doc ops 2018-10-19 12:10:33 +01:00
Henry Oswald
2ccc4d8d3f also delete doc ops 2018-10-19 11:54:19 +01:00
Henry Oswald
2828df74e5 hard delete a doc on health check 2018-10-18 18:06:05 +01:00
Henry Oswald
a756b1a967 hard delete a doc on health check 2018-10-03 14:57:01 +01:00
Henry Oswald
14073a6544 remove debug line 2018-09-28 13:31:49 +01:00
Henry Oswald
68a950a20c add debug line 2018-09-28 13:20:03 +01:00
Henry Oswald
7a90d49f42 add HEALTH_CHECK_PROJECT_ID 2018-09-28 12:39:11 +01:00
Henry Oswald
afc0058b87 update buildscripts to 1.1.9 2018-09-28 12:13:53 +01:00
Henry Oswald
94603f9855 use overleaf-ops project 2018-09-28 12:02:20 +01:00
Henry Oswald
ed4e2775c2 Merge branch 'ho-docker' of github.com:sharelatex/docstore-sharelatex into ho-docker 2018-09-28 11:59:39 +01:00
Henry Oswald
73171b80cf change mongo connection string temporaraly 2018-09-28 11:50:19 +01:00
Brian Gough
3d1e6fb28a increase body parser limit to 64kb
the 16kb limit is not enough when the doc has too many escape characters
2018-08-06 12:00:40 +01:00
Christopher Hoskin
e396b6b79e Update to Build Script 1.1.4 (draft 2) 2018-05-29 15:30:45 +01:00
Christopher Hoskin
ff9e67c87d Update to Build Script 1.1.4 (draft) 2018-05-29 13:59:19 +01:00
Henry Oswald
c334c224bf pass missing env var 2018-05-23 12:35:22 +01:00
Henry Oswald
bff7f96d70 standarise env vars 2018-05-23 12:32:37 +01:00
Henry Oswald
833bf67622 rewrite jenkins acceptence line 2018-05-23 12:29:16 +01:00
Henry Oswald
ddae704f88 log settings 2018-05-23 12:20:37 +01:00
Henry Oswald
984b5a0ca4 pass env vars all the way through (mvp) 2018-05-23 12:17:46 +01:00
Henry Oswald
a8f40a4fda remove env block 2018-05-23 11:45:50 +01:00
Henry Oswald
352a8d3f19 try withCredentials 2018-05-23 11:43:54 +01:00
Henry Oswald
37ef1ba816 add empty env block 2018-05-23 11:35:30 +01:00
Henry Oswald
c1947c5cbd dockerise app, 1.1.3 build scripts 2018-05-23 11:27:31 +01:00
Shane Kilkelly
cdfc6b6131 Merge pull request #30 from sharelatex/sk-upgrade-node-8
Upgrade NodeJS to version 6
2018-04-26 10:53:07 +01:00
Shane Kilkelly
0433692aec remove package-lock file 2018-04-26 10:34:05 +01:00
Shane Kilkelly
f0495d8ec6 Change to Node 6 2018-04-26 10:24:59 +01:00
Alberto Fernández-Capel
71256b58d2 Merge pull request #31 from sharelatex/afc-fix-travisci-build
Do not specify the node version in .travis.yml
2018-04-23 10:51:34 +01:00
Alberto Fernández Capel
6757f70daa Do not specify the node version in .travis.yml
So travis picks it from .nvmrc
2018-04-19 14:08:41 +01:00
Shane Kilkelly
dd7386bb54 Upgrade NodeJS to version 8 2018-04-16 14:44:59 +01:00
James Allen
f06bd26572 Add coffee script dependency 2017-12-29 10:35:40 +00:00
James Allen
a4cc02dbc3 Provide hosts as environment settings and add npm run start script 2017-12-29 08:12:31 +00:00
Joe Green
c864cd24bf Update Jenkinsfile 2017-10-16 14:09:54 +01:00
Joe Green
80eb7a8eda alert only on master 2017-10-12 17:07:29 +01:00
James Allen
d86a964081 Remove another verbose log object 2017-09-20 09:52:28 +02:00
James Allen
05a1939547 Don't log out doc lines and ranges 2017-09-20 09:42:08 +02:00
Joe Green
a0e33ae1e8 added build.txt 2017-09-04 14:48:21 +01:00
Shane Kilkelly
65697cb2f6 Upgrade sinonjs, and fix unit tests.
- use `sinon.match.has` for error matching
- restore previous use of `calledWith`
2017-08-22 15:20:43 +01:00
Shane Kilkelly
1f3b0a3713 Upgrade mongojs dependency to version 2.4.0
- Upgrade in package.json
- Use new connection syntax
- Fix unit tests, issues with object equality
2017-08-22 08:26:30 +01:00
Joe Green
172060c066 Use correct env vars 2017-08-14 15:44:40 +01:00
Joe Green
26ab98f04a run acceptance tests 2017-08-14 15:34:34 +01:00
Joe Green
ca42638ab3 Create Jenkinsfile 2017-08-11 11:09:41 +01:00
Brian Gough
abe90cad10 Revert "Merge pull request #23 from sharelatex/bg-optimise-get-all-docs"
This reverts commit c1337cf23f37bd9ba48419accf1f54c00390e0ea, reversing
changes made to fbb2fa15bf4239db006db742f906554d61a0eac4.
2017-06-30 14:54:11 +01:00
Brian Gough
a2ac37ac99 comments about optimistic loading 2017-06-28 10:06:50 +01:00
Brian Gough
b9b0596d83 optimistically load all docs 2017-06-27 16:58:20 +01:00
James Allen
e10d09d040 Merge pull request #22 from sharelatex/ja-archive-ranges
Archive ranges as well as doc lines
2017-05-17 12:02:42 +01:00
Shane Kilkelly
6a6fdc13a5 Merge branch 'sk-upgrade-metrics' 2017-04-04 09:34:45 +01:00
James Allen
7a64f040f1 Test and fix _mongoDocToS3Doc 2017-04-03 16:04:54 +01:00
James Allen
bf187f30ec Add tests for _s3DocToMongo 2017-04-03 15:50:33 +01:00
Shane Kilkelly
b14039715f Stub out logger in tests 2017-03-31 11:25:23 +01:00
Shane Kilkelly
f7bc400f22 upgrade to most recent metrics 2017-03-31 11:18:31 +01:00
James Allen
f94e33a3a9 Merge branch 'master' into ja-archive-ranges
Conflicts:
	app/coffee/DocArchiveManager.coffee
	test/acceptance/coffee/ArchiveDocsTests.coffee
2017-03-30 17:19:42 +01:00
James Allen
a9ab7b739d Archive ranges as well as doc lines 2017-03-30 17:13:43 +01:00
Shane Kilkelly
ce01b39967 Update metrics version to 1.7.0 2017-03-21 13:48:21 +00:00
Shane Kilkelly
bc37c844ea update to new metrics api 2017-03-17 15:27:36 +00:00
Shane Kilkelly
e879f9c742 Upgrade metrics 2017-03-16 16:46:58 +00:00
Henry Oswald
c0e23df82b break getDoc into multiple helpers, stop passing filters though from other calls 2017-03-15 22:09:56 +00:00
Henry Oswald
ffd1aa0ca4 just get doc_id for quick check to see if it exists 2017-03-10 11:45:03 +00:00
Henry Oswald
7adc67d13a add missing error handler 2017-03-10 10:37:11 +00:00
Henry Oswald
c2b96c7e1e Merge pull request #17 from sharelatex/ho-always-check-s3
Always get inS3 when getting doc
2017-03-10 10:36:59 +00:00
Henry Oswald
f067c039fe always search for inS3 when getting a doc 2017-03-09 18:51:54 +00:00
Henry Oswald
d6146b2970 got failing acceptence test 2017-03-09 18:18:50 +00:00
Henry Oswald
8bd0df3530 also log out lines in error message 2017-03-09 17:36:28 +00:00
Henry Oswald
dbfe5ac712 error if doc lines are not array when unarchiving 2017-03-09 17:34:33 +00:00
Shane Kilkelly
d09a4cb275 Lengthen sleep for acceptance tests 2017-03-06 15:11:04 +00:00
Shane Kilkelly
929ffbd83a Don't npm rebuild inside container 2017-02-20 10:07:30 +00:00
James Allen
315a1d5e80 Add ranges into health check 2017-01-31 10:23:51 +01:00
James Allen
fb39bb0442 Validate that ranges are present in a set document request 2017-01-19 12:15:14 +01:00
James Allen
5e730b33b2 Support new comment op format 2016-12-16 16:44:08 +00:00
James Allen
0174495f75 Add an end point to get all the ranges in a project 2016-12-09 14:37:24 +00:00
James Allen
6fa8b89154 Be explicit about the data we return from mongo 2016-12-05 17:27:31 +00:00
James Allen
a6ec672d84 Merge branch 'ja-delete-refactor' into ja-track-changes
Conflicts:
	test/acceptance/coffee/ArchiveDocsTests.coffee
2016-12-05 16:58:29 +00:00
James Allen
3d195de3e9 Improve testing of archiving and be explicit about include_deleted parameter 2016-12-05 16:48:01 +00:00
James Allen
7717625534 Include deleted docs when archiving 2016-12-05 16:31:51 +00:00
James Allen
2985cb587a Add tests for RangeManager 2016-12-05 15:38:38 +00:00
James Allen
b8a97731e4 Merge branch 'master' into ja-track-changes
Conflicts:
	test/acceptance/coffee/GettingAllDocsTests.coffee
2016-12-05 14:58:57 +00:00
James Allen
bd5086c054 Don't return deleted docs with all project docs 2016-12-05 14:37:44 +00:00
James Allen
0a65a5eabf Set and get ranges along with lines 2016-12-05 14:21:49 +00:00
James Allen
ca96d168dd Make attributes that can be set in mongo flexible 2016-12-02 15:22:08 +00:00
James Allen
144bae3a55 Add an error guard around the version being present 2016-12-02 15:17:38 +00:00
James Allen
ab527c3c5d remove code left over from migration 2016-12-02 15:02:54 +00:00
James Allen
e156d8017c Be explicit in version filter 2016-11-30 15:29:43 +00:00
James Allen
8b95a04a36 Don't look up version in mongo if not needed 2016-11-30 15:08:56 +00:00
James Allen
7ede096903 Merge branch 'master' into ja-set-version-in-docstore 2016-11-29 17:24:53 +00:00
James Allen
50f2983912 Log out version when updating doc 2016-11-29 16:49:35 +00:00
James Allen
10008fa9c4 Don't add colours in automated test script 2016-11-29 14:41:12 +00:00
James Allen
7204c08fb2 Rebuild npm modules as part of acceptance test docker run 2016-11-29 14:29:51 +00:00
James Allen
f7ba554658 set up acceptance tests to run via docker 2016-11-28 16:51:43 +00:00
James Allen
eb9a3b314a Set/get version in docOps via docstore HTTP API 2016-11-28 14:55:16 +00:00
Brian Gough
f95fc2f779 add route parameters 2016-09-05 11:14:41 +01:00
Brian Gough
7a28fb58e7 clean up mongo query 2016-09-05 11:14:41 +01:00
Brian Gough
0a0a8e23fe remove unused modules 2016-09-05 11:14:41 +01:00
Shane Kilkelly
56c0604b96 upgrade to node 4.2.1 2016-06-03 10:58:53 +01:00
Henry Oswald
1541eb319c add more null checks to health check 2015-12-02 10:10:52 +00:00
Henry Oswald
a964119b5e check err in health check and null check res 2015-12-01 21:50:18 +00:00
James Allen
7185657f06 Use max_doc_length rather than max_doc_size to be consistent with other services 2015-11-09 15:24:21 +00:00
James Allen
27d3ebc1fd Add configurable max_doc_length 2015-11-06 12:43:53 +00:00
Henry Oswald
29c812cece moved the build opts down 2015-10-16 12:57:05 +01:00
Henry Oswald
4f5669591a add timeout to health check requests and always try the delete 2015-10-16 12:30:53 +01:00
Henry Oswald
de9a24f7bb pulled health check into its own file and use project_id from settings 2015-10-16 10:13:54 +01:00
Henry Oswald
491d4c69b1 Merge branch 'master' of https://github.com/sharelatex/docstore-sharelatex 2015-10-15 22:22:44 +01:00
Henry Oswald
9826d125e3 added basic health check to docstore 2015-10-15 22:22:20 +01:00
James Allen
5fef2a82b8 Acceptance tests no longer run on Travis 2015-10-07 18:40:12 +01:00
Henry Oswald
f1bf0c97ec make archive and unarchive parallelLimit to speed it up 2015-09-22 09:41:26 +01:00
Henry Oswald
9cfa4b3f84 Don't put docs which are already in s3 through archive job
This fixes the bug we saw with 'RangeError: Maximum call stack size exceeded'
if lots of docs are already in s3 cb() gets called synchronously multiple times quickly
which can cause the execption. I am not sure where the recursion is, maybe inside async.

doing setImmediate(cb) also fixes the issue as I beilve it gives the
process chance to clear the stack. Similar to process.nextTick
2015-09-07 14:11:02 +01:00
Henry Oswald
ae75b855b4 added failing test for trying to archive load of docs which are already
in s3
2015-09-07 14:06:20 +01:00
Henry Oswald
738e33a052 change crypto to always use utf-8 as it works with aws 2015-09-01 16:52:02 +01:00
Henry Oswald
aaa2a099f1 change acceptance test to use big naught list of strings 2015-09-01 16:51:10 +01:00
Henry Oswald
192b0af15a added utf-8 char which fails the archive option 2015-09-01 15:47:16 +01:00
Henry Oswald
5dd33ea313 changed back to standard /archive /unarchive 2015-08-18 14:10:53 +01:00
Henry Oswald
5765b59e0c added /deactivate and /reactivate endpoints as web will call those
also fixed acceptence test
2015-08-18 13:31:26 +01:00
Henry Oswald
599b9770f4 add un archive endpoint 2015-08-13 22:48:45 +01:00
Henry Oswald
cf07e2fec5 improve archve doc acceptence tests 2015-08-13 22:48:17 +01:00
Henry Oswald
ef4e437c3f improve doc manager so it calls get doc recursivly 2015-08-13 22:47:33 +01:00
Henry Oswald
6ea284b17b Merge pull request #9 from sharelatex/s3-archive
S3 archive
2015-08-13 14:20:46 +01:00
Henry Oswald
32bf64236b fixed config to work with s3 correctly 2015-08-13 14:16:40 +01:00
Henry Oswald
ddf4692f0d added acceptance test for large doc ~1mb 2015-08-13 13:59:40 +01:00
Henry Oswald
b8884352f6 added some better error logging 2015-08-13 13:59:22 +01:00
Henry Oswald
859e8a0e57 - deal with calling archive twice on same project
- clean up unit tests
- change s3 keys
- use err not error
2015-08-13 13:00:09 +01:00
Henry Oswald
9af2c07c3b always add archiving root in 2015-08-13 12:59:04 +01:00