decaffeinate
0b62828041
decaffeinate: Run post-processing cleanups on settings.defaults.coffee
2021-05-19 17:24:23 +01:00
decaffeinate
3acf183240
decaffeinate: Convert settings.defaults.coffee to JS
2021-05-19 17:24:23 +01:00
decaffeinate
8786542ad6
decaffeinate: Rename settings.defaults.coffee from .coffee to .js
2021-05-19 17:24:22 +01:00
nate stemen
1f10b45ce7
Merge pull request #147 from overleaf/dependabot-npm_and_yarn-lodash-4.17.21
...
Bump lodash from 4.17.20 to 4.17.21
2021-05-18 10:20:48 -04:00
nate stemen
948b4929c7
Merge pull request #146 from overleaf/jpa-explicit-dependencies
...
[misc] add linting for missing explicit dependencies and fix any errors
2021-05-18 10:20:27 -04:00
dependabot[bot]
ce32ca9238
Bump hosted-git-info from 2.8.8 to 2.8.9
...
Bumps [hosted-git-info](https://github.com/npm/hosted-git-info ) from 2.8.8 to 2.8.9.
- [Release notes](https://github.com/npm/hosted-git-info/releases )
- [Changelog](https://github.com/npm/hosted-git-info/blob/v2.8.9/CHANGELOG.md )
- [Commits](https://github.com/npm/hosted-git-info/compare/v2.8.8...v2.8.9 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-05-11 12:30:36 +00:00
dependabot[bot]
78c0b90eb7
Bump lodash from 4.17.20 to 4.17.21
...
Bumps [lodash](https://github.com/lodash/lodash ) from 4.17.20 to 4.17.21.
- [Release notes](https://github.com/lodash/lodash/releases )
- [Commits](https://github.com/lodash/lodash/compare/4.17.20...4.17.21 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-05-11 03:28:23 +00:00
Jakob Ackermann
126f5bef11
[misc] add linting for missing explicit dependencies and fix any errors
2021-04-29 15:30:51 +01:00
Jakob Ackermann
189897cb30
Merge pull request #145 from overleaf/dependabot-npm_and_yarn-y18n-4.0.1
...
Bump y18n from 4.0.0 to 4.0.1
2021-04-07 14:11:01 +02:00
dependabot[bot]
96697eb91b
Bump y18n from 4.0.0 to 4.0.1
...
Bumps [y18n](https://github.com/yargs/y18n ) from 4.0.0 to 4.0.1.
- [Release notes](https://github.com/yargs/y18n/releases )
- [Changelog](https://github.com/yargs/y18n/blob/master/CHANGELOG.md )
- [Commits](https://github.com/yargs/y18n/commits )
Signed-off-by: dependabot[bot] <support@github.com>
2021-03-31 14:06:02 +00:00
Jakob Ackermann
5f084f8603
[misc] bump the version of the metrics module to 3.5.1
2021-02-16 15:15:52 +00:00
Jakob Ackermann
c9cb5198e1
[misc] bump the node version to 12.20.1
2021-01-05 18:41:32 +00:00
Simon Detheridge
8989735c69
pin fake-gcs to 1.21.2 to prevent acceptance-test errors
2021-01-04 13:32:16 +00:00
Jakob Ackermann
c55c0d9d25
[misc] install @overleaf/object-persistor from tar-ball
2020-12-02 12:39:01 +00:00
Eric Mc Sween
71bb9a5832
Merge pull request #137 from overleaf/em-docker-compose-healthchecks
...
Upgrade build-scripts to 3.4.0
2020-11-26 11:19:25 -05:00
Jakob Ackermann
95f3bcef21
[misc] bump metrics module to 3.4.1
...
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:23 +00:00
Eric Mc Sween
d83e1e88c6
Upgrade build-scripts to 3.4.0
...
This version fixes docker-compose health checks for dependent services. See
https://github.com/overleaf/dev-environment/pull/409 for details.
2020-11-24 08:03:29 -05:00
Simon Detheridge
7925f217b4
Upgrade object-persistor to latest version
2020-10-13 10:08:05 +01:00
Simon Detheridge
ba0958496b
Merge pull request #132 from overleaf/dependabot-npm_and_yarn-bl-2.2.1
...
Bump bl from 2.2.0 to 2.2.1
2020-09-17 12:00:06 +01:00
Simon Detheridge
05efc5dbf9
Merge pull request #133 from overleaf/dependabot-npm_and_yarn-node-fetch-2.6.1
...
Bump node-fetch from 2.6.0 to 2.6.1
2020-09-17 11:59:56 +01:00
Simon Detheridge
f6e0c3ea88
Merge pull request #134 from overleaf/dependabot-npm_and_yarn-lodash-4.17.20
...
Bump lodash from 4.17.15 to 4.17.20
2020-09-17 11:59:45 +01:00
Simon Detheridge
473a044209
Upgrade node to 12.18.4
2020-09-17 11:41:42 +01:00
dependabot[bot]
02c4d9304a
Bump lodash from 4.17.15 to 4.17.20
...
Bumps [lodash](https://github.com/lodash/lodash ) from 4.17.15 to 4.17.20.
- [Release notes](https://github.com/lodash/lodash/releases )
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.20 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-09-16 10:23:11 +00:00
dependabot[bot]
4086d38a09
Bump node-fetch from 2.6.0 to 2.6.1
...
Bumps [node-fetch](https://github.com/bitinn/node-fetch ) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases )
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md )
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-09-12 15:07:58 +00:00
dependabot[bot]
cc3ccc2713
Bump bl from 2.2.0 to 2.2.1
...
Bumps [bl](https://github.com/rvagg/bl ) from 2.2.0 to 2.2.1.
- [Release notes](https://github.com/rvagg/bl/releases )
- [Commits](https://github.com/rvagg/bl/compare/v2.2.0...v2.2.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2020-09-03 19:03:30 +00:00
Christopher Hoskin
6968d5d17b
[misc] bump logger-sharelatex to version 2.2.0
2020-08-13 09:02:46 +01:00
Jakob Ackermann
7b64820484
[misc] add back environment variables for gcs buckets
2020-08-10 18:01:52 +01:00
Jakob Ackermann
f0551307d2
[misc] bump the dev-env to 3.3.2
2020-08-10 17:01:12 +01:00
Simon Detheridge
de81ab2f70
Merge pull request #129 from overleaf/spd-remove-gcs-module
...
Move @google-cloud/storage to a dev dependency
2020-07-23 14:13:43 +01:00
Simon Detheridge
cb86ee8c10
Initialise metrics before logger
2020-07-23 13:35:52 +01:00
Simon Detheridge
4bb6509b9c
Update object-persistor and make aws a dev dependency
2020-07-23 10:45:27 +01:00
Simon Detheridge
5329cf24b0
Remove unneeded @google-cloud/storage module from main deps
2020-07-22 17:18:17 +01:00
Simon Detheridge
89fc640ec4
Use METRICS_APP_NAME env var to initialise metrics, if present
2020-07-22 16:57:41 +01:00
Simon Detheridge
a64bbc9285
Load logger module first
2020-07-21 15:58:01 +01:00
Simon Detheridge
14834abf83
Move config settings to correct place for new persistor module
2020-07-08 10:32:41 +01:00
Simon Detheridge
6c853de5d5
Migrate to new object-persistor module ( #122 )
...
* Migrate to new object-persistor module
* Support updated persistor module using ES6 classes
* Update object-persistor
* Upgrade new persistor code to OError3
* Update to latest minor release for outdated packages
* Update package hashes to sha512
* Point object-persistor at master branch
2020-07-07 13:49:54 +01:00
Ersun Warncke
046c8d916b
remove un-needed config change in unit test
2020-07-06 09:27:12 -04:00
Ersun Warncke
83f6eabaf6
upgarde logger-sharelatex
2020-07-06 09:26:59 -04:00
Ersun Warncke
e83f6b609b
pr fixes
2020-06-25 08:27:14 -04:00
Ersun Warncke
0e4be81406
upgrade to o-error v3
2020-06-24 22:40:04 -04:00
Simon Detheridge
7b6299e05a
Update GcsPersistor range unit test
2020-06-09 13:55:03 +01:00
Simon Detheridge
5d9f78322d
Don't increment range end when passing to GCS backend
2020-06-09 10:01:47 +01:00
Simon Detheridge
0027d27473
Use latest version of gcs server for tests
2020-06-09 10:01:20 +01:00
Simon Detheridge
b37f97e2e3
Pin fake-gcs to 1.18
2020-06-03 10:52:10 +01:00
Simon Detheridge
06e7c6f22a
npm audit fix
2020-06-03 10:08:45 +01:00
Simon Detheridge
37e3531cc9
Upgrade Node to 12.18.0
2020-06-03 09:59:54 +01:00
Miguel Serrano
e014aeb100
Fixed regular expression to insert/delete files not supporting templates api
2020-05-26 17:21:21 +02:00
Simon Detheridge
3637cd70ae
Add support for redirecting to signed URLs
2020-04-15 12:22:54 +01:00
Simon Detheridge
2b9b165d72
Merge pull request #114 from overleaf/spd-fastcrc
...
Add fast-crc32c library
2020-04-03 17:12:03 +01:00
Simon Detheridge
256cebf7a7
Add fast-crc32c library
2020-04-03 17:06:41 +01:00
Eric Mc Sween
003d54e8f0
Fix error handler returning two responses
...
The error handler mistakenly sent two responses on error, the first
being a 200.
2020-04-03 11:57:33 -04:00
Simon Detheridge
13ab7b5ca1
Fix unit tests for pipeline changes
2020-04-02 16:49:45 +01:00
Simon Detheridge
114883a9e9
Ensure streams are always drained on close or error
2020-04-02 15:56:23 +01:00
Simon Detheridge
ccf5f8b9e8
Add acceptance test for leaked sockets on aborted connections
2020-04-02 15:56:19 +01:00
Simon Detheridge
cce4049153
Merge pull request #112 from overleaf/spd-more-stream-destruction
...
Destroy download streams on close
2020-03-31 20:29:20 +01:00
Simon Detheridge
ec94a0692a
Merge pull request #111 from overleaf/spd-no-extra-deletes
...
Only delete the converted-cache folder if conversions are enabled
2020-03-31 20:29:02 +01:00
Simon Detheridge
383ea4e831
Merge pull request #110 from overleaf/msm-update-deps
...
Update dependencies
2020-03-31 20:28:42 +01:00
Simon Detheridge
60ede0bf46
Find more ways to destroy streams
2020-03-31 17:00:39 +01:00
Simon Detheridge
dceef85ccb
Update app/js/FileHandler.js
...
Co-Authored-By: Jakob Ackermann <das7pad@outlook.com>
2020-03-31 16:03:38 +01:00
Simon Detheridge
4489670497
Only delete the converted-cache folder if conversions are enabled
2020-03-31 15:38:42 +01:00
Simon Detheridge
f440cec8ec
Check if streams are already destroyed before destroying
2020-03-31 11:07:31 +01:00
Simon Detheridge
5fadafaf96
Destroy streams handled by getReadyPipeline on error
2020-03-30 17:14:46 +01:00
Simon Detheridge
87b8f8e194
Destroy file-download stream on error
2020-03-30 17:13:40 +01:00
mserranom
70e4dd9fde
updated sinon, mocha
2020-03-30 16:15:21 +02:00
mserranom
a067198619
updated minor and patch dependencies
2020-03-30 16:05:25 +02:00
Simon Detheridge
4cb4d450be
Call end() when handing ERR_STREAM_PREMATURE_CLOSE
2020-03-30 15:03:09 +01:00
Simon Detheridge
64562dffb0
eslint-disable => eslint-disable-next-line
2020-03-26 22:07:37 +00:00
Simon Detheridge
a1ae68f6b5
Tidy up 'getReadyPipeline'
2020-03-26 16:57:55 +00:00
Simon Detheridge
1f037ef653
Catch errors from pipeline and stream when waiting for streams to be readable
2020-03-26 16:57:55 +00:00
Simon Detheridge
238d96ed44
Fail acceptance tests on unhandled promise rejection
2020-03-26 16:57:55 +00:00
Simon Detheridge
7e45a82c35
Use autodestroy on Transform stream
2020-03-26 15:09:56 +00:00
Simon Detheridge
82599bce67
Merge pull request #105 from overleaf/jpa-logger-1-9-1
...
[misc] bump logger-sharelatex to 1.9.1
2020-03-26 10:31:33 +00:00
Simon Detheridge
d073fe75ca
Use single pipeline when calculating md5
2020-03-25 16:59:51 +00:00
Jakob Ackermann
2ce3c8f97e
[misc] bump logger-sharelatex to 1.9.1
2020-03-23 16:18:07 +01:00
Simon Detheridge
65f19346f0
Fix fallback to custom s3 buckets
2020-03-19 11:10:31 +00:00
Simon Detheridge
cb4bdd99f4
Use an ISODate for deleted file names
2020-03-18 20:19:12 +00:00
Simon Detheridge
9d32d4ec16
Don't modify 'opts' parameter
2020-03-16 15:57:37 +00:00
Simon Detheridge
b37c52fc3a
Make GCS delete concurrency configurable
2020-03-16 15:54:05 +00:00
Simon Detheridge
9b658dda18
Copy-on-delete before unlocking
2020-03-16 15:53:45 +00:00
Simon Detheridge
06c4c0f74f
Fix incorrect key when deleting projects
2020-03-16 11:35:01 +00:00
Simon Detheridge
9f74aac1a0
Add acceptance tests for directory deletion
2020-03-16 11:34:45 +00:00
Simon Detheridge
ce52f8aa60
Update FSPersistor deleteDirectory behaviour to match S3 and GCS
2020-03-16 11:33:51 +00:00
Simon Detheridge
47e96a4d94
Add endpoint to delete a project
...
Needs acceptance tests
2020-03-14 14:56:29 +00:00
Simon Detheridge
fc80aa3954
Move directory key validation into FileHandler
2020-03-14 14:31:30 +00:00
Simon Detheridge
58db14456a
Add timestamp to files in deleted bucket
2020-03-14 14:11:17 +00:00
Simon Detheridge
edf1ce1f7e
Delete files from a directory in parallel
2020-03-14 14:02:58 +00:00
Simon Detheridge
183cb0179a
Add support to GCS persistor for unlocking files and copying on delete
2020-03-13 16:18:45 +00:00
Simon Detheridge
28c3fe4a56
Validate key names when deleting directory with a configurable regex
2020-03-10 17:54:09 +00:00
Simon Detheridge
2509b51883
Add optional gcs config to override gcs settings (for fake gcs server)
2020-03-05 17:23:47 +00:00
Simon Detheridge
eb93ae4b10
Use Bucket.deleteFiles to delete directory contents, instead of iterating
2020-03-05 14:12:15 +00:00
Simon Detheridge
460dd96b17
Cosmetic clean-up of GCS Persistor & tests
2020-03-05 13:45:46 +00:00
Simon Detheridge
3bb956b38e
Use http for the fake GCS server
2020-03-04 17:01:20 +00:00
Simon Detheridge
30114cd79b
Remove unnecessary try/catch around 'createReadStream'
2020-03-04 16:38:05 +00:00
Simon Detheridge
a7198764cb
Improve/add some comments for clarity
2020-03-04 16:25:11 +00:00
Simon Detheridge
def383574e
Simplify getMeteredStream to record metric directly
2020-03-04 16:17:36 +00:00
Simon Detheridge
76243fd75a
'bucket' -> 'bucketName' in GCS Persistor
2020-03-04 16:04:26 +00:00
Simon Detheridge
6979b8638a
Add 'Buffer' global for GCS unit tests
2020-03-04 15:42:16 +00:00
Simon Detheridge
12274e1427
Add unit tests for GCS Persistor
2020-03-04 15:38:18 +00:00
Simon Detheridge
e58284aefe
Move base64/hex methods to PersistorHelper
...
Also add some null-safety checks
2020-03-04 15:38:18 +00:00
Simon Detheridge
d9c9d74994
Remove unnecessary test for S3 file deletion
...
S3 does not throw a not-found error when deleting a file that does not exist
2020-03-04 15:38:18 +00:00