Simon Detheridge
edf1ce1f7e
Delete files from a directory in parallel
2020-03-14 14:02:58 +00:00
Simon Detheridge
28c3fe4a56
Validate key names when deleting directory with a configurable regex
2020-03-10 17:54:09 +00:00
Simon Detheridge
e6cf0687a9
Add gcs client library
2020-03-04 15:09:14 +00:00
Simon Detheridge
d06b74b0f8
Bump metrics to 2.5.0
2020-03-04 10:55:01 +00:00
Simon Detheridge
b5e4345855
Merge pull request #96 from overleaf/jpa-dependencies-cleanup
...
[misc] dependencies cleanup
2020-03-04 10:00:56 +00:00
Simon Detheridge
62b2aa8f02
Merge pull request #98 from overleaf/jpa-promisify-filehandler
...
[misc] promisify FileHandler and remove dependency on async
2020-03-04 09:59:15 +00:00
Jakob Ackermann
2b15729658
[misc] promisify FileHandler and remove dependency on async
...
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-03-02 18:23:17 +01:00
Simon Detheridge
0312b00150
Fix prettier task
2020-03-02 16:31:35 +00:00
Jakob Ackermann
4b7c6fafd2
[misc] drop unused dependency pngcrush
2020-03-02 17:11:56 +01:00
Jakob Ackermann
3c61e53918
[misc] move mocha to the devDependencies
2020-03-02 17:11:39 +01:00
Jakob Ackermann
6f27f7a1bf
[misc] drop the /heapdump route and related heapdump package
2020-03-02 17:09:35 +01:00
Jakob Ackermann
32557ab1d7
[SafeExec] replace _.once with lodash.once
2020-03-02 17:08:42 +01:00
Jakob Ackermann
0db4a17a14
[HealthCheckController] use fs.copyFile instead of fs-extra.copy
...
the fs-extra method has a HUGE overhead of JS code and also syscalls for
no particular benefit in this case: just copy the tiny.pdf file.
Here is an overview of the major operations: paths are relative to
https://github.com/jprichardson/node-fs-extra/blob/1.0.0
We start in /lib/copy/copy.js
- sys: check that the source file exists
- sys: check that the source file has an existing parent directory?!
Continue in /lib/copy/ncp.js
- sys: more stat calls on both source and dest to determine permissions
- read/write streams to pipe the file content through the process
- sys: chmod on the destination to match the source permissions
What we actually need is a call to the binding and let node/the os
figure out the best way to copy the contents.
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-03-02 17:02:35 +01:00
Simon Detheridge
c13d7f4197
Bump aws-sdk version in package.json
2020-03-02 11:18:06 +00:00
Simon Detheridge
4e507197fc
Revert "Merge pull request #91 from overleaf/revert-78-spd-migration-persistor"
...
This reverts commit 0cce792604c258538cf012486e7329fa1be7da0f, reversing
changes made to 08b606e22f855121b2d8a2832a5d7e2f45836c3f.
2020-02-17 14:04:42 +00:00
Simon Detheridge
df2ddbe0e1
Revert "Add Migration Persistor, to send missing file requests to a fallback persistor"
2020-02-14 14:26:33 +00:00
Simon Detheridge
42a5d168df
Remove unused packages
2020-02-12 13:21:52 +00:00
Simon Detheridge
b4b7fd226e
Add mechanisms to transfer files with md5-based integrity checks
...
Fix error in settings and tidy up tests
Remove unused variable declaration
Remove .only from tests and update eslint rules to catch it in future
Use to catch errors more safely getting md5 hash
Avoid unnecessary call to S3 to get md5 response
2020-02-12 13:21:52 +00:00
Simon Detheridge
2625e03a31
Add MigrationPersistor for sending 404 requests to a fallback persistor
2020-02-12 13:19:48 +00:00
Simon Detheridge
2ca74fdf15
Cleanup and refactor S3PersistorManager to use aws-sdk only
2020-01-07 09:30:30 +00:00
Simon Detheridge
21ba083877
Use 'glob' to determine 'directory' size.
...
Check for filtered directory paths in all tests.
2020-01-07 09:26:00 +00:00
Simon Detheridge
a8158d6c8c
Cleanup and promisify acceptance tests. Run tests for all backends.
2020-01-07 09:25:04 +00:00
Simon Detheridge
27aaff7843
Decaf cleanup for FileHandler and LocalFileWriter
...
Simplified code and tests where possible
2020-01-07 09:18:56 +00:00
Simon Detheridge
f19d82369d
Bump eslintrc up again to last-known-compatible version with eslit-prettier
2019-12-18 09:52:18 +00:00
Simon Detheridge
b94df9952b
Add OError
2019-12-18 09:34:25 +00:00
Simon Detheridge
b7e098208f
Update build files from build_scripts
2019-12-16 17:17:25 +00:00
Simon Detheridge
230baef8fa
Add linting tasks to package.json
2019-12-16 11:32:58 +00:00
Simon Detheridge
0b6e725137
Remove coffeescript compiles from package.json
2019-12-16 11:19:56 +00:00
Simon Detheridge
1798efd4be
Install eslint and prettier
2019-12-16 10:53:52 +00:00
Shane Kilkelly
f865762c29
update logger and metrics
2019-06-19 13:50:58 +01:00
Henry Oswald
ea845f4935
bulk upgrade to 1.1.12, moved to npm rather than git
2019-01-31 16:01:20 +00:00
Christopher Hoskin
c8d146b571
Bump settings to v1.1.0
2019-01-04 16:03:45 +00:00
Christopher Hoskin
6763809748
Bump logger to v1.5.9
2019-01-03 16:27:45 +00:00
Christopher Hoskin
aab5a1af6a
Merge branch 'master' into csh-ho-docker
2019-01-02 09:51:35 +00:00
Christopher Hoskin
6214256568
Bump logger to v1.5.8
2019-01-02 09:47:38 +00:00
Henry Oswald
25275212af
bump metrics to 2.0.7
2018-12-05 12:36:32 +00:00
Henry Oswald
5d927d30b6
update build scripts to 1.1.10
2018-12-05 10:53:11 +00:00
Henry Oswald
8743527452
bump metrics to 2.0.4
2018-11-29 16:42:26 +00:00
Henry Oswald
e64156cd27
clean npm-shrinkwrap and package.json
2018-11-29 16:41:30 +00:00
Henry Oswald
ee1c14a410
bump metrics
2018-11-29 12:46:14 +00:00
Brian Gough
c2bfdd095c
upgrade logger-sharelatex to v1.5.8
2018-11-08 16:29:23 +00:00
Henry Oswald
aacb54d54c
Merge branch 'master' into ho-docker
2018-09-14 17:16:18 +01:00
Brian Gough
f3adf5a653
fix shrinkwrap for upgraded logger-sharelatex module
2018-09-06 17:01:40 +01:00
Brian Gough
f4ec677296
add sentry to logging
2018-09-06 17:01:18 +01:00
Christopher Hoskin
53dacc04ef
Bump metrics from 1.3.0 to 1.8.1
2018-07-26 16:06:30 +01:00
Christopher Hoskin
f0cf8e6622
Fix typo in buildscript
2018-06-14 11:37:18 +01:00
Christopher Hoskin
46c61aa78c
Update build scripts to 1.1.7, add csh-staging GCR
2018-06-13 16:21:32 +01:00
Henry Oswald
ba8a5cf3e1
bump to 1.1.3 scripts
2018-05-22 13:45:01 +01:00
Henry Oswald
58ab4c72dc
update build scripts to 1.1.1
2018-05-21 15:14:24 +01:00
Henry Oswald
ee81a6af00
updated mocha and added --exit back in
2018-05-21 15:00:32 +01:00
Henry Oswald
3cf2e1d7c3
add null checks and new body parser
2018-05-21 10:11:47 +01:00
Henry Oswald
d9eac8dd8b
upgrade mocha
2018-05-21 09:41:14 +01:00
Henry Oswald
fda6cb0084
fix acceptence tests, add them back into jenkins, upgrade express
2018-05-21 09:37:54 +01:00
Christopher Hoskin
b32c63e16c
Remove --exit option to support older mocha
2018-05-18 14:59:34 +01:00
Christopher Hoskin
a2165d85a0
Update build script to use build-target docker
2018-05-18 13:55:33 +01:00
Henry Oswald
c23b700927
wip
2018-01-16 12:27:36 +00:00
James Allen
b834e53e13
Provide hosts as environment settings and add npm run start script
2017-12-29 08:14:23 +00:00
Henry Oswald
27139bc433
increased rlimit-nproc and added health check for converting image
2016-12-14 16:47:53 +00:00
Xavier Trochu
b6486cb825
Cleanup the dependencies
2015-11-20 14:05:54 +01:00
Xavier Trochu
a367190a21
Merge remote-tracking branch 'sharelatex/master'
2015-11-04 15:20:15 +01:00
Henry Oswald
cf28ee4f9b
locked down packages
2015-09-17 10:34:27 +01:00
Shane Kilkelly
b905d9fba1
Add range-parser
dependency.
2015-08-28 11:44:47 +01:00
Xavier Trochu
41397821b1
Add a manager using the aws-sdk library
...
The knox library does not support the AWS Instance Role.
So use the official AWS SDK to connect to S3
2015-07-22 16:42:45 +02:00
Henry Oswald
33e654accf
get the logging locally to work with bunyan
2015-04-22 18:27:34 +01:00
James Allen
a370739722
Release version 0.1.4
2015-03-20 14:20:13 +00:00
James Allen
eb89337ada
Release version 0.1.3
2015-02-26 11:32:21 +00:00
James Allen
eb40dbbe96
Release version 0.1.2
2015-02-10 13:19:04 +00:00
Brian Gough
2c731586a8
Merge pull request #16 from sharelatex/cluster-restart
...
Graceful cluster restart on domain exception
2015-01-07 11:50:24 +00:00
Brian Gough
e03ee96216
added simple clustering master
2015-01-07 11:33:42 +00:00
Brian Gough
f4ac7d422b
run acceptance tests on travis under forever
2014-12-22 13:41:07 +00:00
Brian Gough
7d96f3aadd
use 'response' to send 'NoSuchKey' when local file is not found
2014-12-22 11:11:03 +00:00
Brian Gough
8744cf94a5
delete directory with rimraf
2014-12-19 16:58:31 +00:00
Henry Oswald
e90eb4b3fb
bump knox
2014-11-29 13:02:06 +00:00
Henry Oswald
ca851589c9
Merge branch 'master' of https://github.com/sharelatex/filestore-sharelatex
...
Conflicts:
package.json
2014-11-27 13:49:16 +00:00
Henry Oswald
dee7799fd4
added heapdump and endpoint to make dump
2014-11-27 13:48:39 +00:00
James Allen
72ad81887a
Release version 0.1.0
2014-08-19 14:10:48 +01:00
James Allen
b79dfcd477
Lock down module versions
2014-08-19 14:10:37 +01:00
Henry Oswald
f83ab25b35
basic acceptence test of sending and getting file back added
2014-06-19 17:07:50 +01:00
Henry Oswald
8a052d4c71
added coffeescript to package.json
2014-06-17 12:44:10 +01:00
James Allen
76f929f415
Add in new http monitoring
2014-05-09 13:30:35 +01:00
James Allen
d0816096b6
Use default settings file
2014-04-02 17:45:41 +01:00
goodbest
aa9f8882ee
change repo URL from git+ssh:// to git+https://
2014-02-21 23:09:38 +08:00
Henry Oswald
f99a6dc39b
changed file converted to use child process with nice
2014-02-19 14:48:12 +00:00
James Allen
110e623a0d
Point npm modules at github
2014-02-17 15:09:53 +00:00
James Allen
3199aad601
Initial open source commit
2014-02-14 16:39:05 +00:00