Henrique Santos
0bb12f32fa
remove project controller / handler
...
add unit test scaffolding
2016-03-13 16:22:14 -03:00
Henrique Santos
1f20744a68
add size function for each persitor
2016-03-12 11:08:07 -03:00
Henrique Santos
5d2fc89137
scaffolding project methods
2016-03-12 04:35:49 -03:00
Henrique Santos
099d0fef2f
scaffolding project size
2016-03-11 22:31:46 -03:00
James Allen
8ddfbb99de
Only parse body when we need to for copyFile request
2015-11-25 17:01:19 +00:00
James Allen
bc6c8d6afc
Don't send multiple status codes on insertFile error
2015-11-25 16:07:51 +00:00
Xavier Trochu
81a7203315
Fix the checkIfFileExists API.
2015-11-25 15:40:35 +01:00
Xavier Trochu
3b6270236c
Replace indentation from 2 space to tabs.
2015-11-20 14:38:23 +01:00
Xavier Trochu
b6486cb825
Cleanup the dependencies
2015-11-20 14:05:54 +01:00
Xavier Trochu
0219900933
Forward the options argument to getFileStream
2015-11-20 12:07:04 +01:00
Xavier Trochu
bfd41fdaf9
Add aws-sdk unit test.
...
Fix Aws-Sdk persistor to return a correct error on file not found.
Fix FileHandler after some change were lost on a previous merge
2015-11-20 12:02:22 +01:00
Xavier Trochu
476db58c3f
Add the opts parameter to getFileStream and implement Range requests
2015-11-17 12:52:25 +01:00
Xavier Trochu
26523b011a
small fixes
2015-11-16 09:59:27 +01:00
Xavier Trochu
63aef6b832
Fix postmerge issue
2015-11-05 12:11:02 +01:00
Xavier Trochu
a367190a21
Merge remote-tracking branch 'sharelatex/master'
2015-11-04 15:20:15 +01:00
James Allen
f723b1699b
Mongo/redis no longer needed without acceptance tests
2015-10-07 18:39:47 +01:00
James Allen
9b40d34b2a
Acceptance tests no longer run on Travis
2015-10-07 18:39:24 +01:00
Henry Oswald
cf28ee4f9b
locked down packages
2015-09-17 10:34:27 +01:00
Shane Kilkelly
0d450b4e33
Tighten up error handling.
2015-09-10 11:10:30 +01:00
Shane Kilkelly
fcfc595c35
Handle potential error before calling LocalFileWriter.writeStream
.
2015-09-10 09:12:49 +01:00
Shane Kilkelly
a6fff2d4e4
Check for a large response body, rather than exact match on the first few bytes.
2015-09-08 11:50:43 +01:00
Shane Kilkelly
c6a81c94eb
Test the cacheWarm
option for preview.
2015-09-08 11:47:43 +01:00
Shane Kilkelly
b8042ae771
Add an acceptance test that uses a pdf file.
2015-09-08 11:43:19 +01:00
Shane Kilkelly
297ad78b1e
Add an acceptance test to check the preview endpoint doesn't time out.
...
This endpoint needs a lot more testing.
2015-09-08 10:32:41 +01:00
Shane Kilkelly
da5a538095
Fix calls to PersistorManager.getFileStream
which were missed in initial refactor.
...
This should fix a breakage in the template publishing workflow.
Ref: b70b837b7ba29b0631f3105ec1dd5f6cdebbd195
2015-09-08 09:23:08 +01:00
Shane Kilkelly
9b8f11f517
Fix the check for a success response from S3.
...
We need to handle both a 200 and 206 (partial content) response.
2015-09-01 12:25:10 +01:00
Shane Kilkelly
82af1be756
Improve testing of error conditions in the FSPersistorManager.
2015-09-01 12:10:30 +01:00
Shane Kilkelly
edc06c82e5
Correct usage of '==' rather than '=' when checking err.code.
2015-09-01 12:10:05 +01:00
Shane Kilkelly
8bbf81f4bc
If the S3 service produces an error, handle it.
2015-09-01 11:36:28 +01:00
Shane Kilkelly
47fdf3c5c9
Ensure that Filestore responds with 404 when a file does not exist.
2015-08-31 16:47:16 +01:00
Shane Kilkelly
4d60872782
Merge branch 'master' of github.com:sharelatex/filestore-sharelatex
2015-08-28 14:48:25 +01:00
Shane Kilkelly
959191ae50
Add an acceptance test for using range header when getting a file.
2015-08-28 14:20:14 +01:00
Shane Kilkelly
ed980a21e1
Test the FileHandler layer.
2015-08-28 13:50:40 +01:00
Shane Kilkelly
64f70eddbd
Add cluster.js to .gitignore.
2015-08-28 13:38:54 +01:00
Shane Kilkelly
8a631e70f7
Refactor, and log when we have a 'range' header.
2015-08-28 12:16:41 +01:00
Shane Kilkelly
387e96ab67
Refactor to make _get_range testable.
2015-08-28 12:02:50 +01:00
Shane Kilkelly
97cdc243d3
Parse out the range header and set start
and end
properties on options.
2015-08-28 11:45:16 +01:00
Shane Kilkelly
b905d9fba1
Add range-parser
dependency.
2015-08-28 11:44:47 +01:00
Shane Kilkelly
76506ed91e
Pass start/end options down to the S3PersistorManager.
...
Test that those options cause a 'Range' header to be attached to the
request sent to S3.
2015-08-28 10:09:41 +01:00
Shane Kilkelly
d88736e3b5
Pass the start
and end
options down to fs.createReadStream
, and test for same.
2015-08-27 16:12:11 +01:00
Shane Kilkelly
57aedefdd3
Begin work towards obeying 'Range' headers, thread the opts
down to persistence layer.
2015-08-27 15:21:33 +01:00
Brian Gough
bea9ee6b19
add gc to filestore
2015-08-18 15:36:07 +01:00
Brian Gough
2e08281b88
replace the /gc endpoint with a automatic gc every 3 minutes
2015-08-05 16:52:01 +01:00
Brian Gough
e1683b8e1c
added a /gc endpoint to debug filestore memory usage
2015-08-04 11:26:51 +01:00
Xavier Trochu
f417b9b171
Fix the AWS-SDK Persistor
2015-07-24 15:48:46 +02:00
Xavier Trochu
7ef46a79a0
Fix aws-sdk persistor.
...
Also fix some typos.
2015-07-24 09:06:52 +02:00
Xavier Trochu
41397821b1
Add a manager using the aws-sdk library
...
The knox library does not support the AWS Instance Role.
So use the official AWS SDK to connect to S3
2015-07-22 16:42:45 +02:00
Xavier Trochu
3289451ece
Revert "Make S3 Key/Secret pair optional."
...
This reverts commit 65122e603099a4f9ef5c5186b7eb8832340a993f.
knox requires the key and secret arguments.
2015-07-22 16:41:45 +02:00
Xavier Trochu
566e69c6cc
Make S3 Key/Secret pair optional.
...
When using Instance Role in AWS, the credentials are unneeded. So
make them optional to use.
2015-07-21 10:00:59 +02:00
Xavier Trochu
c9b5bb028d
Merge branch 'master' of https://github.com/sharelatex/filestore-sharelatex
2015-07-21 09:02:16 +02:00
Brian Gough
9b84422092
added event loop monitor
2015-06-23 13:41:14 +01:00
Brian Gough
8ebbacee5a
move pipe after error handler setup
2015-05-08 15:19:45 +01:00
Brian Gough
7e9f8b885b
add support for public files
2015-05-08 15:15:48 +01:00
Henry Oswald
d5f98c9800
make startup message consistent
2015-04-30 15:04:55 +01:00
Henry Oswald
33e654accf
get the logging locally to work with bunyan
2015-04-22 18:27:34 +01:00
Henry Oswald
7c2e4b00ed
no file subtype can be an issue, added a check on it in the keybuilder
2015-04-13 12:01:49 +01:00
Henry Oswald
158b640b59
Merge branch 'master' of https://github.com/sharelatex/filestore-sharelatex
2015-04-09 17:16:23 +01:00
Henry Oswald
b3432f016c
allow proxying of template images though filestore
2015-04-09 17:14:47 +01:00
Brian Gough
07e53bbb2f
handle error when listing bucket
2015-03-31 10:35:33 +01:00
Xavier Trochu
da1b7b9e82
Merge remote-tracking branch 'origin/master'
2015-03-23 16:25:18 +01:00
James Allen
801b5653e4
Fix unit test when false is not at /bin/false
2015-03-20 14:27:25 +00:00
James Allen
a370739722
Release version 0.1.4
2015-03-20 14:20:13 +00:00
Brian Gough
a5e63f7261
Merge pull request #18 from sharelatex/terminate-processes
...
Use process group to terminate processes
2015-03-13 11:32:57 +00:00
Brian Gough
143d44e54b
add tests for SafeExec module
2015-03-13 10:15:53 +00:00
Brian Gough
a7b9376919
use SIGTERM instead of SIGKILL to allow process to shut down cleanly
2015-03-13 10:15:37 +00:00
Brian Gough
9aaef729ad
cleanup and comments
2015-03-13 10:10:51 +00:00
Brian Gough
63ee4d1e7d
use close event instead of exit to capture stdout/stderr correctly
2015-03-13 10:10:21 +00:00
Brian Gough
0e5abe1ff8
update tests to use safe_exec
2015-03-13 09:31:43 +00:00
Brian Gough
33d8974d02
kill process group on timeout of convert commands
2015-03-12 17:09:27 +00:00
James Allen
eb89337ada
Release version 0.1.3
2015-02-26 11:32:21 +00:00
James Allen
45689fd2b8
Only call getFileStream callback once
2015-02-26 11:32:05 +00:00
James Allen
eb40dbbe96
Release version 0.1.2
2015-02-10 13:19:04 +00:00
Xavier Trochu
4b54372466
miscellaneous cleanup
...
_ Remove some references to scribtex
_ Fix some issue when templates are unavailable
2015-01-16 11:04:15 +01:00
Brian Gough
2c731586a8
Merge pull request #16 from sharelatex/cluster-restart
...
Graceful cluster restart on domain exception
2015-01-07 11:50:24 +00:00
Brian Gough
e03ee96216
added simple clustering master
2015-01-07 11:33:42 +00:00
Brian Gough
79292b4602
fix log message
2015-01-07 10:35:17 +00:00
Brian Gough
191d0a4986
handle SIGTERM in filestore
2015-01-07 10:35:17 +00:00
Brian Gough
02101868e1
put all shutdown logic in beginShutdown, force program to exit after 2 mins
2015-01-07 10:35:17 +00:00
Brian Gough
e8e2338c0c
move connection:close middleware ahead of other routes
2015-01-05 16:56:19 +00:00
Brian Gough
d5478a8ebb
make sure shutdown only happens once
2014-12-23 16:55:34 +00:00
Brian Gough
d3fa6b4a01
catch exceptions within the body of the domain error handler
2014-12-23 16:49:34 +00:00
Brian Gough
48f62990b4
server can exit immediately, does not need a domain
...
exit with an exception as no requests can be served
2014-12-23 16:48:11 +00:00
Brian Gough
74fc095913
close HTTP keep-alive connections when shutting down
2014-12-23 16:46:31 +00:00
Brian Gough
f4ac7d422b
run acceptance tests on travis under forever
2014-12-22 13:41:07 +00:00
Brian Gough
ad379ec103
add grunt target for test:acceptance
2014-12-22 13:13:36 +00:00
Brian Gough
d4c281e22c
add acceptance tests to travis.yml
2014-12-22 13:10:40 +00:00
Brian Gough
8b9213d09b
fix getFileStream unit test as callback no longer fires immediately
...
success callback is now called only when file is readable
2014-12-22 13:07:30 +00:00
Brian Gough
efd6035849
test against rimraf module when deleting directory recursively
2014-12-22 13:01:39 +00:00
Brian Gough
3f18f6a714
update unit tests - FileHandler now calls deleteDirectory on cache directory
2014-12-22 12:58:41 +00:00
Brian Gough
64c6341844
check delete status code in copy test
2014-12-22 11:34:13 +00:00
Brian Gough
de465aee94
change copy test to match usage in web, check http status
2014-12-22 11:27:48 +00:00
Brian Gough
dad209262f
execute success callback when filesystem copyfile completed
2014-12-22 11:27:00 +00:00
Brian Gough
72ebaea5e2
log FS delete errors only on failure
2014-12-22 11:11:31 +00:00
Brian Gough
7d96f3aadd
use 'response' to send 'NoSuchKey' when local file is not found
2014-12-22 11:11:03 +00:00
Brian Gough
8744cf94a5
delete directory with rimraf
2014-12-19 16:58:31 +00:00
Brian Gough
af4c72150f
fix path in directory deletion
2014-12-19 16:57:44 +00:00
Brian Gough
55c4e220fa
prevent double callback in getFileStream
2014-12-19 16:28:42 +00:00
Brian Gough
c74356daeb
Merge branch 'master' of github.com:sharelatex/filestore-sharelatex
...
# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.
2014-12-18 16:57:27 +00:00
Brian Gough
c2e50c619d
request restart on unhandled exceptions to avoid memory leak
2014-12-18 16:55:11 +00:00
Henry Oswald
e90eb4b3fb
bump knox
2014-11-29 13:02:06 +00:00