Eric Mc Sween
75f9b0ff10
Decaf cleanup: handle errors
2020-05-08 15:01:34 -04:00
Eric Mc Sween
150c4a88f1
Decaf cleanup: simplify null checks
2020-05-08 15:01:34 -04:00
Eric Mc Sween
dc5d77998c
Decaf cleanup: remove unnecessary returns
2020-05-08 15:01:34 -04:00
Eric Mc Sween
ff2d31c066
Decaf cleanup: remove Array.from()
2020-05-08 15:01:34 -04:00
Eric Mc Sween
e8f935d046
Make max JSON request size configurable and default to 8 MB
...
This is to allow multi-document updates, for example when creating a new
project from a zip file.
2020-05-08 15:01:34 -04:00
Eric Mc Sween
e60d9237d0
Decaf cleanup: simplify null checks
2020-05-08 15:01:34 -04:00
Eric Mc Sween
18b92adcef
Decaf cleanup: remove __guard__()
2020-05-08 15:01:34 -04:00
Eric Mc Sween
7b2420413c
Decaf cleanup: unnecessary returns and arrow functions in callbacks
2020-05-08 15:01:33 -04:00
Eric Mc Sween
53d79d86a9
Decaf cleanup: remove Array.from()
2020-05-08 14:54:54 -04:00
Tim Alby
9f6ea07002
fix SyntaxError on export
var
2020-05-06 12:17:08 +02:00
Tim Alby
cf87daa754
fix Metrics module stub
2020-05-06 12:17:03 +02:00
Tim Alby
8176cb3e8d
remove requires for coffee-script package in tests
2020-05-06 12:16:59 +02:00
Tim Alby
ed7d277f98
lint & format app.js
2020-05-06 12:16:53 +02:00
Tim Alby
e089cfc93c
format config/settings.defaults.js & lib/diff_match_patch.js
2020-05-06 12:16:48 +02:00
Tim Alby
4184976099
fix lint errors in config/settings.defaults.js
2020-05-06 12:16:10 +02:00
Tim Alby
96e7a668b7
disable linting for lib/diff_match_patch.js
2020-05-06 12:16:04 +02:00
Tim Alby
6fdc094b5c
Uninstall coffee-script
2020-05-06 12:13:24 +02:00
Tim Alby
29d5e8f8b9
prettier: convert individual decaffeinated files to Prettier format
2020-05-06 12:13:11 +02:00
Tim Alby
877bae34b3
decaffeinate: convert individual files to js
2020-05-06 12:13:10 +02:00
Tim Alby
86c6c38a6e
decaffeinate: rename individual coffee files to js files
2020-05-06 12:13:07 +02:00
Tim Alby
0bae747b3e
prettier: convert test/stress decaffeinated files to Prettier format
2020-05-06 12:13:07 +02:00
Tim Alby
02b29bfaa1
decaffeinate: rename test/stress/coffee to test/stress/js
2020-05-06 12:13:03 +02:00
decaffeinate
86a3b0842a
decaffeinate: Run post-processing cleanups on run.coffee
2020-05-06 12:12:57 +02:00
decaffeinate
3b6c0d8ca6
decaffeinate: Convert run.coffee to JS
2020-05-06 12:12:55 +02:00
decaffeinate
b6cc463a1e
decaffeinate: Rename run.coffee from .coffee to .js
2020-05-06 12:12:53 +02:00
Tim Alby
d15738cb98
prettier: convert test/acceptance decaffeinated files to Prettier format
2020-05-06 12:12:47 +02:00
Tim Alby
9680e62bb1
decaffeinate: rename test/acceptance/coffee to test/acceptance/js
2020-05-06 12:12:41 +02:00
decaffeinate
24ac4d4935
decaffeinate: Run post-processing cleanups on ApplyingUpdatesToADocTests.coffee and 14 other files
2020-05-06 12:12:36 +02:00
decaffeinate
adffde3059
decaffeinate: Convert ApplyingUpdatesToADocTests.coffee and 14 other files to JS
2020-05-06 12:12:17 +02:00
decaffeinate
f46fe5be7f
decaffeinate: Rename ApplyingUpdatesToADocTests.coffee and 14 other files from .coffee to .js
2020-05-06 12:12:02 +02:00
Tim Alby
9a2f8ecbd4
prettier: convert test/unit decaffeinated files to Prettier format
2020-05-06 12:11:36 +02:00
Tim Alby
bb20394243
decaffeinate: rename test/unit/coffee to test/unit/js
2020-05-06 12:11:30 +02:00
decaffeinate
21850f1e6f
decaffeinate: Run post-processing cleanups on DiffCodecTests.coffee and 23 other files
2020-05-06 12:11:22 +02:00
decaffeinate
c781526af0
decaffeinate: Convert DiffCodecTests.coffee and 23 other files to JS
2020-05-06 12:10:51 +02:00
decaffeinate
6c4d7fb838
decaffeinate: Rename DiffCodecTests.coffee and 23 other files from .coffee to .js
2020-05-06 12:10:11 +02:00
Tim Alby
dbf9e88dc3
prettier: convert app/js decaffeinated files to Prettier format
2020-05-06 12:09:33 +02:00
Tim Alby
a519980c10
decaffeinate: rename app/coffee dir to app/js
2020-05-06 12:09:23 +02:00
decaffeinate
dad1d1212f
decaffeinate: Run post-processing cleanups on DeleteQueueManager.coffee and 58 other files
2020-05-06 12:09:15 +02:00
decaffeinate
1fa8882674
decaffeinate: Convert DeleteQueueManager.coffee and 58 other files to JS
2020-05-06 12:08:21 +02:00
decaffeinate
249b7247b5
decaffeinate: Rename DeleteQueueManager.coffee and 58 other files from .coffee to .js
2020-05-06 12:07:29 +02:00
Tim Alby
e2e8593f57
decaffeinate: add eslint and prettier packages
2020-05-06 12:06:28 +02:00
Tim Alby
16c98b3d15
decaffeinate: update .gitignore
2020-05-06 12:04:26 +02:00
Tim Alby
569a1f5824
decaffeinate: update build scripts to es
2020-05-06 12:04:19 +02:00
Tim Alby
bb9a5340f4
update build scripts to 2.2.0
2020-05-06 12:03:41 +02:00
Miguel Serrano
93a5ee063a
regenerated lockfile
2020-04-27 13:41:23 +02:00
Miguel Serrano
f935c392bc
Merge branch 'master' into sk-upgrade-dependencies
2020-04-27 13:38:21 +02:00
Brian Gough
79c934759c
add default redis settings for project history
2020-04-22 14:04:28 +01:00
Brian Gough
2e24d1670c
remove old unused ioredis keepalive option
2020-04-22 13:51:14 +01:00
Brian Gough
61da130cf4
keep maxRetriesPerRequest for project_history redis config
2020-04-22 13:50:39 +01:00
Brian Gough
a51f61a555
remove redis migration code
2020-04-21 14:48:47 +01:00
Brian Gough
248edc03fa
add comment about the two history clients
2020-04-21 14:44:19 +01:00
Brian Gough
af93193d6e
remove new_project_history and use project_history instead
2020-04-21 14:43:48 +01:00
Brian Gough
8e210fe441
update unit tests
2020-04-21 14:41:30 +01:00
Brian Gough
ac68f59487
Merge branch 'master' into bg-use-separate-redis-for-project-history
2020-04-16 15:48:21 +01:00
Brian Gough
55cbfd9962
Merge branch 'master' into bg-add-queue-metrics
2020-04-06 12:12:12 +01:00
Brian Gough
c095feaa06
upgrade logger-sharelatex
2020-04-06 10:43:53 +01:00
Brian Gough
beb3691795
add metrics for redis get/update
2020-04-06 10:00:48 +01:00
Brian Gough
2b72ec49a1
add comments for redis metrics
2020-04-02 11:33:52 +01:00
Brian Gough
21824d49da
Merge branch 'bg-add-queue-metrics' of github.com:overleaf/document-updater into bg-add-queue-metrics
2020-04-01 16:04:52 +01:00
Brian Gough
3a8c362fba
add doclines set/del metric
2020-04-01 15:59:25 +01:00
Brian Gough
00b11bda96
use separate loop for pendingUpdates metric
2020-04-01 14:50:55 +01:00
Henry Oswald
c2b050e286
bump redis to 1.0.12
2020-03-31 10:21:50 +01:00
Jakob Ackermann
17c2add0cf
[misc] track redis pub/sub payload sizes on publish
2020-03-30 11:31:43 +02:00
Shane Kilkelly
861ab5be80
update metrics and logger for latest bug fixes
2020-03-26 13:40:47 +00:00
Brian Gough
fcb72b9bf7
update tests
2020-03-25 14:27:41 +00:00
Brian Gough
1a0550364d
add metric for getdoc bytes
2020-03-25 14:27:41 +00:00
Brian Gough
891fcc696b
add metric for pending updates queue
2020-03-25 14:27:41 +00:00
Brian Gough
e293d86c14
add metric for project history queue
2020-03-25 12:15:16 +00:00
Jakob Ackermann
b2d1718a2e
[misc] bump logger-sharelatex to 1.9.1
2020-03-23 16:18:05 +01:00
Shane Kilkelly
ada4fba3dc
Fix express deprecations
2020-03-19 15:39:57 +00:00
Shane Kilkelly
21194e52ca
more upgrades
2020-03-19 15:23:45 +00:00
Shane Kilkelly
f069a2515d
upgrade express
2020-03-19 15:20:32 +00:00
Shane Kilkelly
aa324a1920
npm audit fix
2020-03-19 15:08:59 +00:00
Shane Kilkelly
b631a741ac
update build scripts
2020-03-19 15:06:36 +00:00
Brian Gough
e2564c9cdd
update metrics module to 2.5.1
...
reduce time window for summary metrics to 60s
2020-03-11 10:25:48 +00:00
Brian Gough
69125df44b
Merge pull request #121 from overleaf/bg-clean-up-package-json
...
clean up package.json
2020-03-11 10:20:30 +00:00
Eric Mc Sween
ff32104fe6
Merge pull request #123 from overleaf/em-doc-hard-delete
...
Add ignore_flush_errors option to the doc delete endpoint
2020-03-10 10:11:00 -04:00
Eric Mc Sween
d9caced0d6
Change skip_flush option to ignore_flush_errors in delete doc
...
Instead of skipping the flush, we'll still try to flush and proceed with
the doc deletion, even when the flush fails.
2020-03-10 09:40:49 -04:00
Eric Mc Sween
9b70eb75b3
Rename flush param to skip_flush in delete doc
...
Also move it to the query string instead of the body.
2020-03-09 16:27:32 -04:00
Eric Mc Sween
c09bc0e868
Add a "flush: false" option to the doc delete endpoint
...
This will delete the document from Redis without flushing to web,
docstore or history. To be used when something is broken.
2020-03-07 08:59:15 -05:00
nate stemen
ffd8d0745d
use empty object for ranges if it doesn't exist
2020-03-06 13:49:30 -05:00
Brian Gough
852ae5fbae
move bunyan out of devDependencies
...
(needed by @google-cloud/logging-bunyan)
2020-02-26 09:47:38 +00:00
Brian Gough
0419039d4d
Merge branch 'master' into bg-use-separate-redis-for-project-history
2020-02-21 14:13:33 +00:00
Brian Gough
2e178b0e2d
resolve merge conflicts
2020-02-21 14:06:58 +00:00
Brian Gough
922f237c39
Revert "add redislabs ca cert to repository"
...
This reverts commit eb7419b0f45992228393086caf7ed6f66296801f.
2020-02-19 09:26:59 +00:00
Brian Gough
412eabc306
Revert "add tls settings"
...
This reverts commit 72a4994cebab2731f99f0ada7a094c8a0acb3293.
2020-02-19 09:26:42 +00:00
Brian Gough
4e7c5c9046
update requestretry
2020-02-18 09:29:53 +00:00
Brian Gough
3aa997a0bc
update package-lock.json
2020-02-17 14:06:13 +00:00
Brian Gough
d9138c91f4
upgrade request to latest version
2020-02-17 14:05:59 +00:00
Brian Gough
583af0bfc4
update package-lock.json
2020-02-17 13:42:57 +00:00
Brian Gough
638688a854
remove unused lynx module
2020-02-17 13:41:53 +00:00
Brian Gough
908e916779
move sinon and sandboxed-module to devDependencies
2020-02-17 13:41:34 +00:00
Brian Gough
dec18e0773
Merge pull request #120 from overleaf/dependabot/npm_and_yarn/lodash-4.17.13
...
Bump lodash from 4.17.4 to 4.17.13
2020-02-17 11:09:49 +00:00
Brian Gough
0969a39291
Merge pull request #119 from overleaf/dependabot/npm_and_yarn/sshpk-1.16.1
...
Bump sshpk from 1.13.1 to 1.16.1
2020-02-17 11:02:45 +00:00
Brian Gough
30567ca2da
Merge pull request #118 from overleaf/dependabot/npm_and_yarn/stringstream-0.0.6
...
Bump stringstream from 0.0.5 to 0.0.6
2020-02-17 10:59:59 +00:00
dependabot[bot]
9a92cd7b31
Bump lodash from 4.17.4 to 4.17.13
...
Bumps [lodash](https://github.com/lodash/lodash ) from 4.17.4 to 4.17.13.
- [Release notes](https://github.com/lodash/lodash/releases )
- [Commits](https://github.com/lodash/lodash/compare/4.17.4...4.17.13 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-02-14 09:56:26 +00:00
dependabot[bot]
3fb0ed414c
Bump sshpk from 1.13.1 to 1.16.1
...
Bumps [sshpk](https://github.com/joyent/node-sshpk ) from 1.13.1 to 1.16.1.
- [Release notes](https://github.com/joyent/node-sshpk/releases )
- [Commits](https://github.com/joyent/node-sshpk/compare/v1.13.1...v1.16.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-02-14 09:56:25 +00:00
dependabot[bot]
2acd4c0f23
Bump stringstream from 0.0.5 to 0.0.6
...
Bumps [stringstream](https://github.com/mhart/StringStream ) from 0.0.5 to 0.0.6.
- [Release notes](https://github.com/mhart/StringStream/releases )
- [Commits](https://github.com/mhart/StringStream/compare/v0.0.5...v0.0.6 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-02-14 09:56:24 +00:00
dependabot[bot]
c4bec0dcc7
Bump extend from 3.0.1 to 3.0.2
...
Bumps [extend](https://github.com/justmoon/node-extend ) from 3.0.1 to 3.0.2.
- [Release notes](https://github.com/justmoon/node-extend/releases )
- [Changelog](https://github.com/justmoon/node-extend/blob/master/CHANGELOG.md )
- [Commits](https://github.com/justmoon/node-extend/compare/v3.0.1...v3.0.2 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-02-14 09:56:23 +00:00
Jakob Ackermann
5fb8c0a098
Merge pull request #116 from overleaf/jpa-dependencies-cleanup
...
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
2020-02-14 10:55:54 +01:00
Jakob Ackermann
af4211d167
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
2020-02-12 14:39:51 +01:00
Brian Gough
81e21c5e76
remove unused .travis.yml file
2020-02-12 12:37:00 +00:00
Jakob Ackermann
82ab2f7d14
Merge pull request #65 from das7pad/hotfix-redis-config
...
[redis] use the correct instance for the real time updates
2020-02-12 13:21:04 +01:00
Jakob Ackermann
e73978410c
Merge pull request #67 from das7pad/hotfix-static-queue-check
...
[misc] tests: fix a static test
2020-02-12 13:20:55 +01:00
Jakob Ackermann
776d85b5b0
Merge pull request #114 from overleaf/jpa-build-scripts-1-3-5
...
[misc] update the build scripts to 1.3.5
2020-02-12 13:20:44 +01:00
Brian Gough
26d8d07e7a
remove unused redis settings from rate limit unit test
2020-02-11 14:32:49 +00:00
Jakob Ackermann
9cfc59734a
[misc] update the build scripts to 1.3.5
2020-02-11 12:27:53 +01:00
Brian Gough
2d2e3bc2b1
Merge pull request #111 from overleaf/bg-add-comment-about-null-bytes
...
add comment about null byte check
2020-02-10 10:26:24 +00:00
Brian Gough
afe43fa252
update to node 10.19.0
2020-02-07 14:16:31 +00:00
Jakob Ackermann
4070b0ef6f
[misc] tests: fix a static test
...
`ProjectHistoryRedisManager.queueOps` is masked and can not push
changes into redis during the unittest.
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-02-07 12:36:46 +01:00
Jakob Ackermann
10d177f41b
[misc] test/unit: stub the correct redis settings
2020-02-07 12:24:57 +01:00
Brian Gough
338d3609f5
add comment about null byte check
2020-01-30 15:17:13 +00:00
Brian Gough
544ae05212
added note about rollback
2020-01-23 16:22:26 +00:00
Brian Gough
626e19ed1a
add logging of migration phase at startup
2020-01-23 15:46:54 +00:00
Brian Gough
d5a2b96df9
add note about deleting the migration key entries
2020-01-23 14:36:59 +00:00
Jakob Ackermann
fcfa3ecc9d
[misc] upgrade node to 10.18.1
2020-01-23 10:05:57 +01:00
Brian Gough
31324fb65a
add environment variable for migration_phase setting
2020-01-22 15:36:06 +00:00
Brian Gough
ad58fe76b2
add tls settings
2020-01-21 15:36:33 +00:00
Brian Gough
531d9b77b9
add redislabs ca cert to repository
2020-01-21 09:49:41 +00:00
Brian Gough
7036803acf
add missing argument to metrics.inc
...
also track retries rather than attempts (which is always 1 for a successful request)
2020-01-14 15:00:21 +00:00
Brian Gough
3caa0e7c05
add failure/retry metrics for web-api requests
2020-01-14 13:53:50 +00:00
Brian Gough
a638ef4251
add comment about locking in redis migration
2020-01-13 15:56:28 +00:00
Brian Gough
c2714f9ae9
add acceptance tests for RedisMigrationManager
2020-01-06 16:50:06 +00:00
Brian Gough
27044c2d02
allow migration phase to be modified at runtime for testing
2020-01-06 16:46:35 +00:00
Brian Gough
8ae95ebf60
fix rclient check in migration metrics
2020-01-06 16:45:36 +00:00
Brian Gough
97cbf46160
add metrics for migration
2019-12-16 11:46:35 +00:00
Brian Gough
a2e63d009e
fix migration phase check
2019-12-16 09:55:26 +00:00
Brian Gough
a85dffbcef
fix acceptance tests
2019-12-16 09:27:00 +00:00
Brian Gough
d0c5eb5698
support migration of project history keys to separate redis instance
2019-12-13 16:38:41 +00:00
Brian Gough
1bb12a5035
allow pending updates to clear in acceptance tests
2019-12-11 14:43:59 +00:00
Brian Gough
ad19fee667
add setting so that double flush is the default
...
can be disabled to stop flushing to track-changes
2019-11-25 13:36:25 +00:00
Brian Gough
4f6583bbf2
fix getDocVersion and add tests
2019-11-25 13:28:36 +00:00
Brian Gough
68e12f4d2d
add metrics for queue operations
2019-11-25 10:51:10 +00:00
Brian Gough
8b73bb9f13
Merge branch 'master' into bg-filter-track-changes-updates
2019-11-22 10:41:33 +00:00
Brian Gough
b7055eecee
add metrics for history flushes
2019-11-22 09:14:32 +00:00
Brian Gough
65cf4cf7c7
make flush to track-changes failsafe
2019-11-21 14:58:35 +00:00
Brian Gough
dcd7649bad
filter track-changes updates for projects using project-history
2019-11-19 10:02:56 +00:00
Brian Gough
08ee58abb8
remove console.log from tests
2019-11-15 09:34:13 +00:00
Brian Gough
82a72c9b73
fix missing bodyParser limit
2019-11-14 16:32:59 +00:00
dependabot[bot]
6871889bfb
Bump request from 2.25.0 to 2.47.0
...
Bumps [request](https://github.com/request/request ) from 2.25.0 to 2.47.0.
- [Release notes](https://github.com/request/request/releases )
- [Changelog](https://github.com/request/request/blob/master/CHANGELOG.md )
- [Commits](https://github.com/request/request/compare/v2.25.0...v2.47.0 )
Signed-off-by: dependabot[bot] <support@github.com>
2019-11-05 11:38:25 +00:00
dependabot[bot]
ccc072e9da
Bump express from 3.3.4 to 3.11.0
...
Bumps [express](https://github.com/expressjs/express ) from 3.3.4 to 3.11.0.
- [Release notes](https://github.com/expressjs/express/releases )
- [Changelog](https://github.com/expressjs/express/blob/master/History.md )
- [Commits](https://github.com/expressjs/express/compare/3.3.4...3.11.0 )
Signed-off-by: dependabot[bot] <support@github.com>
2019-10-30 13:38:50 +00:00
Nate Stemen
1d3a1d22be
bump build script to 1.1.24
2019-10-25 12:50:45 -04:00
Nate Stemen
1620956e2e
replace private link with public one
2019-10-25 12:50:33 -04:00
Brian Gough
a9428c9ece
Merge pull request #96 from overleaf/bg-add-ioredis-maxretriesperrequest
...
add ioredis maxRetriesPerRequest
2019-10-16 08:55:36 +01:00
Brian Gough
21a9126847
set maxRetriesPerRequest from environment variable
2019-10-16 08:44:08 +01:00
Brian Gough
781e01b8b4
Merge pull request #95 from overleaf/bg-update-ioredis
...
update to ioredis 4.14.1
2019-10-14 09:21:39 +01:00
Brian Gough
5a62632cfd
add ioredis option maxRetriesPerRequest: 0
...
see https://github.com/luin/ioredis/issues/965
2019-10-04 11:53:14 +01:00
Brian Gough
51a821c03c
remove old unused ioredis keepalive option
2019-10-04 11:51:37 +01:00
Brian Gough
18ccd11224
update to ioredis 4.14.1
2019-10-04 11:32:08 +01:00
Henry Oswald
e9efd6b93b
logs out when a redis event occurs
2019-10-03 11:10:31 +01:00