Commit graph

174 commits

Author SHA1 Message Date
Henry Oswald
253a99e780 added try catch around word count where a file is not created 2015-11-12 15:19:22 +00:00
Henry Oswald
069220dcc8 increased cache time to 1.5 days 2015-10-21 10:02:30 +01:00
Shane Kilkelly
3217b1d58f When serving output files, intelligently determine the appropriate content-type.
cherry pick 6fa3fda3ed28239cf3ac9720629f9707663aa197 from datajoy.
2015-09-21 16:59:35 +01:00
Henry Oswald
ddcfc3ee61 lock down smoke test and metrics version 2015-09-17 10:30:12 +01:00
Henry Oswald
d7d0a6d9b0 Merge pull request #33 from sharelatex/pr/28
wordcount
2015-09-09 14:03:20 +01:00
Henry Oswald
4ee50b7239 - fixed bug with texcount returning wrong data for nauty lines
- improved acceptence test for word count to use nauty lines
2015-09-09 13:52:45 +01:00
Henry Oswald
ec338f8c10 add -inc to word count
use -inc to word count included files

also moved private function to bottom
2015-09-09 12:47:08 +01:00
Henry Oswald
d44cfb8614 added test to check compile should continue on error downloading http
resource

also improved logging
2015-09-09 09:44:38 +01:00
Henry Oswald
4b3aa933a3 don't error if a http resource can not be download
try and continue, log the error but you might still be able to
compile. prevents issue with badly uploaded images in filstore
2015-09-08 21:58:27 +01:00
Henrique Dias
d332665648 move texcount to docker 2015-09-08 10:19:46 -03:00
Henrique Dias
09032565e2 Merge remote-tracking branch 'upstream/master' into texcount 2015-09-08 09:13:04 -03:00
Brian Gough
b3c030b3ed add memory logger from metrics-sharelatex 2015-08-14 14:47:42 +01:00
Henry Oswald
d45a5e6d42 Merge branch 'master' of https://github.com/sharelatex/clsi-sharelatex 2015-06-12 17:11:11 +01:00
Henry Oswald
e5f60081c9 added some load tests in 2015-06-12 17:11:03 +01:00
Henrique Dias
32c0a89ae1 add unit test 2015-06-08 19:27:47 -03:00
Henrique Dias
59e87a8729 initial version of texcount 2015-06-08 18:35:24 -03:00
Brian Gough
3dec42be2a Merge pull request #23 from sharelatex/add-mysql-indexes
add indexes to mysql db
2015-05-21 12:21:59 +01:00
Brian Gough
5b81a9b12e Merge pull request #22 from sharelatex/upgrade-sequelize
upgrade sequelize and mysql
2015-05-21 12:21:50 +01:00
Brian Gough
6ac7161f19 Merge pull request #21 from sharelatex/fix-urlfetcher-streams
clean up error handling in UrlFetcher
2015-05-21 12:21:31 +01:00
Brian Gough
44e1dc8c0c added comments 2015-05-21 11:33:13 +01:00
Brian Gough
e379068fa3 upgrade sequelize and mysql 2015-05-15 16:58:27 +01:00
Brian Gough
6ebcd9e8fd add indexes to db 2015-05-15 16:28:35 +01:00
Brian Gough
66fc2715dc clean up error handling in UrlFetcher 2015-05-15 16:28:11 +01:00
Brian Gough
608b1dd657 replace deprecated send(code,body) calls 2015-05-15 16:27:39 +01:00
Brian Gough
aa32cbc1ee clean up stream handling for file copy 2015-05-15 16:25:49 +01:00
Brian Gough
56f1ffa067 only run qpdf for the main output.pdf file
was previously matching any pdf file, which caused it to run for
embedded pdf figures produced during the mklatex run
2015-05-15 16:23:58 +01:00
Henry Oswald
7dfdad02f5 change regex checking file request ensure other files can not be accessed 2015-05-12 15:18:09 +01:00
Brian Gough
604c31ae84 additional validation of requests 2015-05-11 12:10:13 +01:00
Brian Gough
23e3b279c1 use the latest versions of metrics and smoketest modules 2015-05-05 10:54:59 +01:00
Brian Gough
f7d6c9de31 avoid leak when calling chai.should() repeatedly in smoke test 2015-05-05 10:03:17 +01:00
Brian Gough
b08349e07c disable sequelize logging by default
prevent any leaking of objects to console during debugging
2015-05-05 10:03:17 +01:00
Henry Oswald
91d0f0f2f8 make startup message consistent 2015-04-30 15:07:48 +01:00
Brian Gough
6a347a0ebe remove debugging from tests 2015-04-29 16:05:49 +01:00
Brian Gough
76cd52af70 prevent leak of urlStream on failed downloads 2015-04-29 16:05:49 +01:00
Brian Gough
bb9944e618 log errors when downloading files and clean up failed downloads 2015-04-29 16:05:49 +01:00
Brian Gough
72918fb41b invalidate the cache if there is an error copying a file 2015-04-29 15:54:38 +01:00
Brian Gough
56b77c300c log errors when copying files from cache 2015-04-29 15:54:08 +01:00
Brian Gough
134058ccc0 add heapdump support for memory profiling 2015-04-09 14:40:02 +01:00
James Allen
79e71cdf92 Release version 0.1.4 2015-03-20 15:25:02 +00:00
Brian Gough
d7e53941b6 Merge branch 'master' of github.com:sharelatex/clsi-sharelatex 2015-03-16 16:47:56 +00:00
Brian Gough
59c25fc703 remove unnecessary call to async.series in OutputFileFinder
callback was previously async but is now synchronous, so high stack
usage.
2015-03-16 16:47:25 +00:00
Brian Gough
9ee2706410 add v8 profiler on /profile?time=MS url 2015-03-16 15:02:45 +00:00
Brian Gough
3a3eda0ccf reduce cache limit for pdfs 2015-03-02 11:31:48 +00:00
Brian Gough
c26de9554d skip cache directory error when empty 2015-03-02 09:58:20 +00:00
Brian Gough
52baf4976e Merge branch 'master' into cache-output-files 2015-03-02 09:18:44 +00:00
Brian Gough
7f38c5e5a3 fix double callback for proc.on 'error' and proc.on 'close' 2015-02-27 16:07:02 +00:00
Brian Gough
140090da47 move convert tests from middleware to restricted static server 2015-02-27 15:38:57 +00:00
Brian Gough
e024fec82d provide a static server which forbids symlinks
prevents mismatch between rootdir of server and rootdir of symlink
checking middleware
2015-02-27 13:57:57 +00:00
Brian Gough
a6fb82513f use OutputCacheManager to construct static path to files 2015-02-27 13:16:01 +00:00
Brian Gough
5fdd1d4f47 cleanup and logging 2015-02-27 13:15:35 +00:00
Brian Gough
a877dd36e7 remove debugging code 2015-02-26 15:32:01 +00:00
Brian Gough
77b4247f86 fix tests to allow for build parameter 2015-02-26 15:31:12 +00:00
James Allen
e78da9d0fd Release version 0.1.3 2015-02-26 11:20:56 +00:00
Brian Gough
5a5ef8baed accept build id parameter when serving static files 2015-02-25 17:05:19 +00:00
Brian Gough
9991c38dfc added package dependencies for caching 2015-02-24 16:09:55 +00:00
Brian Gough
49e1ce552d add an optimisation pass for the cached output files 2015-02-24 15:48:34 +00:00
Brian Gough
5c1d61c955 skip the cache directory when finding output files 2015-02-24 14:40:22 +00:00
Brian Gough
4002849e20 save output files in a .cache directory 2015-02-24 14:40:05 +00:00
Brian Gough
4532cd14b0 update sanitizePath regex
remove accidental inclusion of , and add null char \x00
2015-02-13 11:28:43 +00:00
James Allen
80382d5c15 Allow non-latin characters in the rootResourcePath 2015-02-13 11:21:35 +00:00
James Allen
561ce7dc60 Sanitize rootResourcePath 2015-02-11 16:39:43 +00:00
James Allen
1f8ddac27d Release version 0.1.2 2015-02-10 13:19:42 +00:00
James Allen
1313b06fb7 Don't return error if directory doesn't exist yet 2014-12-09 11:25:23 +00:00
James Allen
42af7c4e63 Add in some debugging logging 2014-12-09 11:16:16 +00:00
James Allen
ffa7919e46 Use find -type f to get a list of output files 2014-12-09 11:08:07 +00:00
Henry Oswald
9742aa8fb4 replaced old symlink logic with tested middlewear based on fs.realpath 2014-12-04 23:54:22 +00:00
James Allen
2647eb0ec7 Check file is not a symlink before returning it 2014-12-04 22:07:37 +00:00
James Allen
49b7cdc854 Add in missing error check 2014-12-04 21:37:09 +00:00
Brian Gough
95373d2b7e send a strong etag for the output.pdf file, needed for byte ranges in pdf.js 2014-12-02 14:30:24 +00:00
Henry Oswald
c119d2ba79 err != error 2014-11-27 16:19:01 +00:00
Henry Oswald
d498076ab3 Merge branch 'master' of https://github.com/sharelatex/clsi-sharelatex 2014-11-27 16:11:11 +00:00
Henry Oswald
b8335b6b64 respect the status code on the error if it exists 2014-11-27 16:11:00 +00:00
James Allen
a39c356014 Update acceptance tests for new knitr, and remove markdown 2014-10-29 10:59:32 +00:00
James Allen
5216526191 Force mimetype of output files to be safe 2014-10-28 12:07:26 +00:00
Henry Oswald
c37447a2d6 increase max compile to 4 mins 2014-10-17 11:03:08 +01:00
Henry Oswald
ce8c6d824d Merge branch 'master' of https://github.com/sharelatex/clsi-sharelatex 2014-10-17 10:22:27 +01:00
Henry Oswald
a698795558 up timeout to 6 mins 2014-10-17 10:14:23 +01:00
James Allen
b74e9b02f0 Bump version to 0.1.1 2014-09-29 16:05:44 +01:00
James Allen
9059f62543 Lock down sequelize version 2014-09-23 10:52:01 +01:00
James Allen
ee891cc030 Release version 0.1.0 2014-08-19 14:05:09 +01:00
James Allen
855ec6e4dd Lock down module versions 2014-08-19 14:01:01 +01:00
James Allen
995d23a326 Merge branch 'master' of github.com:sharelatex/clsi-sharelatex 2014-08-19 12:14:38 +01:00
James Allen
10413b876a Don't run smoke test by default 2014-08-19 12:11:56 +01:00
James Allen
37a8e37bda Add updated knitr example output.pdf for TexLive 2014 2014-08-13 10:35:51 +00:00
Henry Oswald
3e4cfc5ba9 added url into error message when downloading from filestore 2014-06-10 14:09:36 +01:00
Henry Oswald
8d337a26db add null checks and defaults for the cached smoke test results 2014-06-05 16:13:06 +01:00
Henry Oswald
98efa96f3e added caching of health checks so we can hit them heaviy from multiple places without potential concurency problems 2014-06-05 15:51:24 +01:00
James Allen
fe6c76e62d Don't normalize path passed to synctex 2014-05-29 16:40:58 +01:00
James Allen
bc22a371d0 Explicitly look for output.pdf file, not any pdf 2014-05-29 15:49:48 +01:00
James Allen
f8819fbbd7 Increase req and res stream timeouts to 3 minutes 2014-05-22 12:18:56 +01:00
James Allen
9261987bd8 Increase size limit (arbitrarily... *shrug*) 2014-05-19 20:03:05 +01:00
James Allen
5cd66aad58 Return more informative errors 2014-05-19 07:18:57 -04:00
James Allen
3213c562bc Add in new metrics 2014-05-09 14:55:37 +01:00
James Allen
abbcea2945 Add commented out docker config 2014-04-30 11:31:37 +01:00
James Allen
52b22a41c8 Use simpler exec command with a timeout 2014-04-09 15:34:54 +01:00
James Allen
b53fed1243 Rearrange compile flags 2014-04-09 12:44:51 +01:00
James Allen
173e0a80c6 Compile binary with install 2014-04-09 12:37:04 +01:00
James Allen
892e6bf6d1 Add in a synctex end point 2014-04-08 15:18:56 +01:00
James Allen
129cf0bf62 Add in support for markdown files 2014-04-04 09:56:20 -04:00
James Allen
0644cb316d Pick up .ist files in acceptance tests 2014-04-04 08:26:01 -04:00