Commit graph

660 commits

Author SHA1 Message Date
Miguel Serrano
b6b042e050 Merge pull request #118 from overleaf/msm-fixed-object-key-templates
Fixed regular expression to insert/delete files not supporting templates API
2020-05-27 15:16:46 +02:00
Miguel Serrano
e014aeb100 Fixed regular expression to insert/delete files not supporting templates api 2020-05-26 17:21:21 +02:00
Simon Detheridge
04661221a1 Merge pull request #116 from overleaf/spd-signed-urls
Add support for redirecting to signed URLs
2020-04-21 10:43:42 +01:00
Simon Detheridge
3637cd70ae Add support for redirecting to signed URLs 2020-04-15 12:22:54 +01:00
Simon Detheridge
2b9b165d72 Merge pull request #114 from overleaf/spd-fastcrc
Add fast-crc32c library
2020-04-03 17:12:03 +01:00
Simon Detheridge
cd8d4445c0 Merge pull request #115 from overleaf/em-request-logger-hotfix
Fix error handler returning two responses
2020-04-03 17:09:41 +01:00
Simon Detheridge
256cebf7a7 Add fast-crc32c library 2020-04-03 17:06:41 +01:00
Eric Mc Sween
003d54e8f0 Fix error handler returning two responses
The error handler mistakenly sent two responses on error, the first
being a 200.
2020-04-03 11:57:33 -04:00
Simon Detheridge
63907e0170 Merge pull request #113 from overleaf/spd-stream-debugging
Ensure streams are drained when a pipeline fails
2020-04-03 14:06:55 +01:00
Simon Detheridge
13ab7b5ca1 Fix unit tests for pipeline changes 2020-04-02 16:49:45 +01:00
Simon Detheridge
114883a9e9 Ensure streams are always drained on close or error 2020-04-02 15:56:23 +01:00
Simon Detheridge
ccf5f8b9e8 Add acceptance test for leaked sockets on aborted connections 2020-04-02 15:56:19 +01:00
Simon Detheridge
cce4049153 Merge pull request #112 from overleaf/spd-more-stream-destruction
Destroy download streams on close
2020-03-31 20:29:20 +01:00
Simon Detheridge
ec94a0692a Merge pull request #111 from overleaf/spd-no-extra-deletes
Only delete the converted-cache folder if conversions are enabled
2020-03-31 20:29:02 +01:00
Simon Detheridge
383ea4e831 Merge pull request #110 from overleaf/msm-update-deps
Update dependencies
2020-03-31 20:28:42 +01:00
Simon Detheridge
60ede0bf46 Find more ways to destroy streams 2020-03-31 17:00:39 +01:00
Simon Detheridge
dceef85ccb Update app/js/FileHandler.js
Co-Authored-By: Jakob Ackermann <das7pad@outlook.com>
2020-03-31 16:03:38 +01:00
Simon Detheridge
4489670497 Only delete the converted-cache folder if conversions are enabled 2020-03-31 15:38:42 +01:00
Simon Detheridge
51a6dda660 Merge pull request #109 from overleaf/spd-end-stream-on-premature-close
Call end() when handing ERR_STREAM_PREMATURE_CLOSE
2020-03-31 11:33:17 +01:00
Simon Detheridge
f440cec8ec Check if streams are already destroyed before destroying 2020-03-31 11:07:31 +01:00
Simon Detheridge
5fadafaf96 Destroy streams handled by getReadyPipeline on error 2020-03-30 17:14:46 +01:00
Simon Detheridge
87b8f8e194 Destroy file-download stream on error 2020-03-30 17:13:40 +01:00
mserranom
70e4dd9fde updated sinon, mocha 2020-03-30 16:15:21 +02:00
mserranom
a067198619 updated minor and patch dependencies 2020-03-30 16:05:25 +02:00
Simon Detheridge
4cb4d450be Call end() when handing ERR_STREAM_PREMATURE_CLOSE 2020-03-30 15:03:09 +01:00
Simon Detheridge
ae62bb75ca Merge pull request #107 from overleaf/spd-handle-fixes-hopefully
(Hopefully) fix handle leaks
2020-03-27 11:37:48 +00:00
Simon Detheridge
64562dffb0 eslint-disable => eslint-disable-next-line 2020-03-26 22:07:37 +00:00
Simon Detheridge
a1ae68f6b5 Tidy up 'getReadyPipeline' 2020-03-26 16:57:55 +00:00
Simon Detheridge
1f037ef653 Catch errors from pipeline and stream when waiting for streams to be readable 2020-03-26 16:57:55 +00:00
Simon Detheridge
238d96ed44 Fail acceptance tests on unhandled promise rejection 2020-03-26 16:57:55 +00:00
Simon Detheridge
7e45a82c35 Use autodestroy on Transform stream 2020-03-26 15:09:56 +00:00
Simon Detheridge
82599bce67 Merge pull request #105 from overleaf/jpa-logger-1-9-1
[misc] bump logger-sharelatex to 1.9.1
2020-03-26 10:31:33 +00:00
Simon Detheridge
345696b067 Merge pull request #106 from overleaf/spd-single-pipe
Use single pipeline when calculating md5
2020-03-26 10:31:07 +00:00
Simon Detheridge
d073fe75ca Use single pipeline when calculating md5 2020-03-25 16:59:51 +00:00
Jakob Ackermann
2ce3c8f97e [misc] bump logger-sharelatex to 1.9.1 2020-03-23 16:18:07 +01:00
Simon Detheridge
63b4b3e9a2 Merge pull request #104 from overleaf/spd-custom-bucket-fallback
Fix fallback to custom s3 buckets
2020-03-19 11:39:55 +00:00
Simon Detheridge
65f19346f0 Fix fallback to custom s3 buckets 2020-03-19 11:10:31 +00:00
Simon Detheridge
9a03a3406e Merge pull request #86 from overleaf/spd-gcs-persistor
Add GCS Persistor
2020-03-19 09:16:47 +00:00
Simon Detheridge
cb4bdd99f4 Use an ISODate for deleted file names 2020-03-18 20:19:12 +00:00
Simon Detheridge
9d32d4ec16 Don't modify 'opts' parameter 2020-03-16 15:57:37 +00:00
Simon Detheridge
b37c52fc3a Make GCS delete concurrency configurable 2020-03-16 15:54:05 +00:00
Simon Detheridge
9b658dda18 Copy-on-delete before unlocking 2020-03-16 15:53:45 +00:00
Simon Detheridge
06c4c0f74f Fix incorrect key when deleting projects 2020-03-16 11:35:01 +00:00
Simon Detheridge
9f74aac1a0 Add acceptance tests for directory deletion 2020-03-16 11:34:45 +00:00
Simon Detheridge
ce52f8aa60 Update FSPersistor deleteDirectory behaviour to match S3 and GCS 2020-03-16 11:33:51 +00:00
Simon Detheridge
47e96a4d94 Add endpoint to delete a project
Needs acceptance tests
2020-03-14 14:56:29 +00:00
Simon Detheridge
fc80aa3954 Move directory key validation into FileHandler 2020-03-14 14:31:30 +00:00
Simon Detheridge
58db14456a Add timestamp to files in deleted bucket 2020-03-14 14:11:17 +00:00
Simon Detheridge
edf1ce1f7e Delete files from a directory in parallel 2020-03-14 14:02:58 +00:00
Simon Detheridge
183cb0179a Add support to GCS persistor for unlocking files and copying on delete 2020-03-13 16:18:45 +00:00