Brian Gough
c20e1b13c8
Merge pull request #16536 from overleaf/bg-clsi-timeouts-add-metrics-to-filestore-readonly
...
Add metrics for tracking active signed URL calls in filestore readonly
GitOrigin-RevId: f366b56274ed665d753ff32de57b1a15b4ce9193
2024-01-17 09:03:36 +00:00
Eric Mc Sween
12e7471213
Merge pull request #12916 from overleaf/bg-move-stream-buffer-code-to-library
...
move stream-related code to separate `@overleaf/stream-utils` library
GitOrigin-RevId: a79a873109b927b4fc0ae36f47d5c67e0df58041
2023-06-02 08:05:57 +00:00
Jakob Ackermann
3428d53afe
Merge pull request #12938 from overleaf/jpa-leaks-filestore
...
[filestore] cacheWarm: destroy file stream when not piping into response
GitOrigin-RevId: a0fb14e5ececd28d8d9dbed8cd3a5622c81b8230
2023-05-09 08:04:18 +00:00
Miguel Serrano
8b723c5363
Merge pull request #11160 from overleaf/msm-replace-uuid-crypto
...
Replace `uuid`/`node-uuid` with `node:crypto`
GitOrigin-RevId: 1be4f09c4681edac7e8bc58af3b5726d0d5ee322
2023-01-18 15:07:58 +00:00
Eric Mc Sween
173d582080
Merge pull request #7985 from overleaf/em-downgrade-filestore-request-logs
...
Downgrade filestore request logs
GitOrigin-RevId: a131b3e007e35551097fa40afaf02a5c11166e4b
2022-05-17 08:05:46 +00:00
Eric Mc Sween
f0a3eeeb32
Merge pull request #7968 from overleaf/em-remove-logger-log
...
Remove logger.log in favour of logger.info
GitOrigin-RevId: e305ae8adf19ecf144cee123b6837f35d5d45bed
2022-05-17 08:05:39 +00:00
Brian Gough
25f3ca2be2
Merge pull request #6295 from overleaf/bg-fix-error-in-request-logger
...
[filestore] add missing params property to request logger
GitOrigin-RevId: 528558db5a3350c319d561dc5bae6f8ce1f6aa7a
2022-01-11 09:04:14 +00:00
Eric Mc Sween
f7275a6c4b
Merge pull request #6079 from overleaf/em-upgrade-logger
...
Upgrade logger and metrics in all services
GitOrigin-RevId: 2baf63eeeab77fb3559cf763ddacfbf4b745cd0b
2021-12-15 09:04:25 +00:00
Jakob Ackermann
2261e761f4
Merge pull request #5705 from overleaf/jpa-node-14
...
[misc] upgrade node version from 12 to 14
GitOrigin-RevId: 15c465c7bb5e42b0c71e2dedb09cf4fe9f1d8ec6
2021-11-19 09:02:56 +00:00
Brian Gough
d630d4a37c
Merge pull request #5258 from overleaf/revert-5214-bg-migrate-node-uuid-to-uuid
...
Revert "migrate node-uuid to uuid"
GitOrigin-RevId: f512eb1040e2ce6d87774de9c1fc884594480cef
2021-09-28 08:04:11 +00:00
Brian Gough
9ee1e29286
Merge pull request #5214 from overleaf/bg-migrate-node-uuid-to-uuid
...
migrate node-uuid to uuid
GitOrigin-RevId: 742fd4d3f039c6a026b3d35c3b0a7d54c00ca183
2021-09-27 08:02:54 +00:00
Jakob Ackermann
e3d7afeb96
[misc] run format_fix and lint:fix
2021-07-13 12:04:46 +01:00
Jakob Ackermann
3152bf361d
[misc] switch from settings-sharelatex to @overleaf/settings
2021-07-12 17:47:19 +01:00
Jakob Ackermann
95f3bcef21
[misc] bump metrics module to 3.4.1
...
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:23 +00:00
Jakob Ackermann
f0551307d2
[misc] bump the dev-env to 3.3.2
2020-08-10 17:01:12 +01:00
Simon Detheridge
6c853de5d5
Migrate to new object-persistor module ( #122 )
...
* Migrate to new object-persistor module
* Support updated persistor module using ES6 classes
* Update object-persistor
* Upgrade new persistor code to OError3
* Update to latest minor release for outdated packages
* Update package hashes to sha512
* Point object-persistor at master branch
2020-07-07 13:49:54 +01:00
Ersun Warncke
e83f6b609b
pr fixes
2020-06-25 08:27:14 -04:00
Ersun Warncke
0e4be81406
upgrade to o-error v3
2020-06-24 22:40:04 -04:00
Simon Detheridge
5d9f78322d
Don't increment range end when passing to GCS backend
2020-06-09 10:01:47 +01:00
Miguel Serrano
e014aeb100
Fixed regular expression to insert/delete files not supporting templates api
2020-05-26 17:21:21 +02:00
Simon Detheridge
3637cd70ae
Add support for redirecting to signed URLs
2020-04-15 12:22:54 +01:00
Eric Mc Sween
003d54e8f0
Fix error handler returning two responses
...
The error handler mistakenly sent two responses on error, the first
being a 200.
2020-04-03 11:57:33 -04:00
Simon Detheridge
114883a9e9
Ensure streams are always drained on close or error
2020-04-02 15:56:23 +01:00
Simon Detheridge
cce4049153
Merge pull request #112 from overleaf/spd-more-stream-destruction
...
Destroy download streams on close
2020-03-31 20:29:20 +01:00
Simon Detheridge
60ede0bf46
Find more ways to destroy streams
2020-03-31 17:00:39 +01:00
Simon Detheridge
dceef85ccb
Update app/js/FileHandler.js
...
Co-Authored-By: Jakob Ackermann <das7pad@outlook.com>
2020-03-31 16:03:38 +01:00
Simon Detheridge
4489670497
Only delete the converted-cache folder if conversions are enabled
2020-03-31 15:38:42 +01:00
Simon Detheridge
f440cec8ec
Check if streams are already destroyed before destroying
2020-03-31 11:07:31 +01:00
Simon Detheridge
5fadafaf96
Destroy streams handled by getReadyPipeline on error
2020-03-30 17:14:46 +01:00
Simon Detheridge
87b8f8e194
Destroy file-download stream on error
2020-03-30 17:13:40 +01:00
Simon Detheridge
4cb4d450be
Call end() when handing ERR_STREAM_PREMATURE_CLOSE
2020-03-30 15:03:09 +01:00
Simon Detheridge
a1ae68f6b5
Tidy up 'getReadyPipeline'
2020-03-26 16:57:55 +00:00
Simon Detheridge
1f037ef653
Catch errors from pipeline and stream when waiting for streams to be readable
2020-03-26 16:57:55 +00:00
Simon Detheridge
7e45a82c35
Use autodestroy on Transform stream
2020-03-26 15:09:56 +00:00
Simon Detheridge
d073fe75ca
Use single pipeline when calculating md5
2020-03-25 16:59:51 +00:00
Simon Detheridge
65f19346f0
Fix fallback to custom s3 buckets
2020-03-19 11:10:31 +00:00
Simon Detheridge
cb4bdd99f4
Use an ISODate for deleted file names
2020-03-18 20:19:12 +00:00
Simon Detheridge
9d32d4ec16
Don't modify 'opts' parameter
2020-03-16 15:57:37 +00:00
Simon Detheridge
b37c52fc3a
Make GCS delete concurrency configurable
2020-03-16 15:54:05 +00:00
Simon Detheridge
9b658dda18
Copy-on-delete before unlocking
2020-03-16 15:53:45 +00:00
Simon Detheridge
06c4c0f74f
Fix incorrect key when deleting projects
2020-03-16 11:35:01 +00:00
Simon Detheridge
ce52f8aa60
Update FSPersistor deleteDirectory behaviour to match S3 and GCS
2020-03-16 11:33:51 +00:00
Simon Detheridge
47e96a4d94
Add endpoint to delete a project
...
Needs acceptance tests
2020-03-14 14:56:29 +00:00
Simon Detheridge
fc80aa3954
Move directory key validation into FileHandler
2020-03-14 14:31:30 +00:00
Simon Detheridge
58db14456a
Add timestamp to files in deleted bucket
2020-03-14 14:11:17 +00:00
Simon Detheridge
edf1ce1f7e
Delete files from a directory in parallel
2020-03-14 14:02:58 +00:00
Simon Detheridge
183cb0179a
Add support to GCS persistor for unlocking files and copying on delete
2020-03-13 16:18:45 +00:00
Simon Detheridge
28c3fe4a56
Validate key names when deleting directory with a configurable regex
2020-03-10 17:54:09 +00:00
Simon Detheridge
eb93ae4b10
Use Bucket.deleteFiles to delete directory contents, instead of iterating
2020-03-05 14:12:15 +00:00
Simon Detheridge
460dd96b17
Cosmetic clean-up of GCS Persistor & tests
2020-03-05 13:45:46 +00:00