19 commits

Author	SHA1	Message	Date
Simon Detheridge	3637cd70ae	Add support for redirecting to signed URLs	2020-04-15 12:22:54 +01:00
Simon Detheridge	1f037ef653	Catch errors from pipeline and stream when waiting for streams to be readable	2020-03-26 16:57:55 +00:00
Simon Detheridge	d073fe75ca	Use single pipeline when calculating md5	2020-03-25 16:59:51 +00:00
Simon Detheridge	30114cd79b	Remove unnecessary try/catch around 'createReadStream'	2020-03-04 16:38:05 +00:00
Simon Detheridge	a7198764cb	Improve/add some comments for clarity	2020-03-04 16:25:11 +00:00
Simon Detheridge	def383574e	Simplify getMeteredStream to record metric directly	2020-03-04 16:17:36 +00:00
Simon Detheridge	e58284aefe	Move base64/hex methods to PersistorHelper ... Also add some null-safety checks	2020-03-04 15:38:18 +00:00
Simon Detheridge	8acc9ef0ae	Make S3 partSize a setting	2020-02-17 14:06:15 +00:00
Simon Detheridge	7c4bf97a7f	Avoid fetching file a second time when source md5 can't be fetched	2020-02-17 14:06:05 +00:00
Simon Detheridge	2f2a819b74	Re-fetch file to calculate md5 if etag is not in correct format	2020-02-17 14:05:43 +00:00
Simon Detheridge	5adfb3e2c0	Use large upload chunks	2020-02-17 14:05:31 +00:00
Simon Detheridge	4e507197fc	Revert "Merge pull request #91 from overleaf/revert-78-spd-migration-persistor" ... This reverts commit 0cce792604c258538cf012486e7329fa1be7da0f, reversing changes made to 08b606e22f855121b2d8a2832a5d7e2f45836c3f.	2020-02-17 14:04:42 +00:00
Simon Detheridge	df2ddbe0e1	Revert "Add Migration Persistor, to send missing file requests to a fallback persistor"	2020-02-14 14:26:33 +00:00
Simon Detheridge	49ad408b30	Remove unused imports and format correctly	2020-02-12 13:27:12 +00:00
Simon Detheridge	93cd55fb79	Refactor persistors to use a helper for common things	2020-02-12 13:27:12 +00:00
Simon Detheridge	9e0b378948	Remove minipass as dependency and refactor to make things clearer	2020-02-12 13:21:52 +00:00
Simon Detheridge	b4b7fd226e	Add mechanisms to transfer files with md5-based integrity checks ... Fix error in settings and tidy up tests Remove unused variable declaration Remove .only from tests and update eslint rules to catch it in future Use to catch errors more safely getting md5 hash Avoid unnecessary call to S3 to get md5 response	2020-02-12 13:21:52 +00:00
Simon Detheridge	2625e03a31	Add MigrationPersistor for sending 404 requests to a fallback persistor	2020-02-12 13:19:48 +00:00
Simon Detheridge	f877f51775	Rename *PersistorManager to *Persistor	2020-02-12 13:19:48 +00:00

Renamed from services/filestore/app/js/S3PersistorManager.js (Browse further)