Commit graph

575 commits

Author SHA1 Message Date
Henry Oswald
2aaadc6124 fix unit tests 2018-08-23 00:21:05 +01:00
Henry Oswald
b28d210357 try changing bin to be owned by node 2018-08-23 00:10:06 +01:00
Henry Oswald
a80700f3e4 improve error reporting 2018-08-23 00:00:43 +01:00
Henry Oswald
6c0665bb49 change sync to async for lockfile debugging 2018-08-22 22:17:02 +01:00
Henry Oswald
40f4357cd6 fix sql query checking last access time 2018-08-22 18:21:15 +01:00
Henry Oswald
ae84777c94 add time secomp 2018-08-21 18:56:53 +01:00
Henry Oswald
9f5fbefb8a add log on exited error code 2018-08-21 12:02:12 +01:00
Henry Oswald
f0b927e8e2 improve error reporting 2018-08-20 10:12:32 +01:00
Henry Oswald
0855b51de5 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-08-19 11:46:11 +01:00
Henry Oswald
e61907bf48 added loads of debugging 2018-08-19 11:38:27 +01:00
Christopher Hoskin
2dd1738781 Merge branch 'ho-dockerise' into csh-sentry 2018-08-15 09:44:02 +01:00
Henry Oswald
3dfc03fb0a put FILESTORE_PARALLEL_FILE_DOWNLOADS and
FILESTORE_PARALLEL_SQL_QUERY_LIMIT into env vars
2018-08-14 15:17:56 +01:00
Christopher Hoskin
1aee865532 Revert "Put a guard on sentry dsn"
This reverts commit 95e052d05910680aeeca2521b65b089122c4e249.
2018-08-13 17:36:53 +01:00
Christopher Hoskin
f878ba0f20 Put a guard on sentry dsn 2018-08-13 12:27:13 +01:00
Christopher Hoskin
2aac47256f Read sentry dsn from env 2018-08-03 15:33:53 +01:00
Henry Oswald
361eaf9217 comment out erroring log for moment 2018-08-01 14:32:17 +01:00
Henry Oswald
6f926007d2 null check host options 2018-08-01 14:10:22 +01:00
Henry Oswald
44c0922a5b reduce logging 2018-08-01 13:59:09 +01:00
Henry Oswald
ac4d07352f make Settings.parallelSqlQueryLimit a config setting 2018-07-31 14:38:24 +01:00
Henry Oswald
cd5bcdd7ca fix expired projects command 2018-07-30 17:37:30 +01:00
Henry Oswald
f9754c4b95 fix missing cb’s 2018-07-30 17:01:59 +01:00
Henry Oswald
759988401b add db queue file for global db query queues 2018-07-30 16:46:47 +01:00
Henry Oswald
1080c2c428 added a queue with 1 concurency to db queries 2018-07-30 16:22:04 +01:00
Henry Oswald
daf40fc757 added some debugging 2018-07-30 15:18:25 +01:00
Henry Oswald
f2dfb718c6 add sync= off and read_uncommited=true to improve perf 2018-07-30 15:16:06 +01:00
Henry Oswald
dc225f6aa3 remove some console.logs 2018-07-30 15:11:41 +01:00
Henry Oswald
1ef8ea328c remove password from clsi for sql
sequalise fails when it is set to null
2018-07-30 14:04:33 +01:00
Henry Oswald
3b06835499 bump retried and package versions 2018-07-30 11:25:28 +01:00
Henry Oswald
a7a6a4dde6 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-26 16:52:26 +01:00
Henry Oswald
65679af0cb dd wal logging 2018-07-26 16:12:26 +01:00
Christopher Hoskin
98108b87e7 Push images to overleaf-ops 2018-07-18 11:32:41 +01:00
Henry Oswald
e8c735e794 only set wal for sqlite 2018-07-17 12:53:07 +01:00
Henry Oswald
52a39b02ce Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-17 12:52:18 +01:00
Henry Oswald
d840246d29 add PRAGMA journal_mode=WAL; 2018-07-17 12:50:33 +01:00
Christopher Hoskin
28373d34f5 Bump build script to 1.1.8, drop csh-gcdm-test and csh-staging repos 2018-07-17 12:10:08 +01:00
Brian Gough
4c2a03cc32 Merge branch 'master' of github.com:sharelatex/clsi-sharelatex 2018-07-17 10:41:14 +01:00
Brian Gough
d85980ad9d allow prune to fail to prevent build from terminating 2018-07-17 10:41:10 +01:00
Henry Oswald
e46b6563c0 change override to leave image name so it works for wl_texlive 2018-07-16 17:25:14 +01:00
Henry Oswald
a767bfe964 remove express header 2018-07-16 15:38:23 +01:00
Henry Oswald
846c2b1e28 move texliveImageNameOveride further down request so it works for
compile tests
2018-07-13 11:52:49 +01:00
Henry Oswald
c8d3c39bea quick hack to overright image name further down stack 2018-07-13 11:46:37 +01:00
Henry Oswald
a47db60cbd Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-13 10:42:27 +01:00
Henry Oswald
4ec8a423cb added texliveImageNameOveride 2018-07-13 10:37:22 +01:00
Christopher Hoskin
68f708cf55 Depend on metrics v1.8.1 for remote StatsD host 2018-07-12 11:22:02 +01:00
Christopher Hoskin
12bfe122b9 Use our experimental metrics 2018-07-06 15:08:38 +01:00
Henry Oswald
6825285b02 added maint down endpoint 2018-07-05 15:07:07 +01:00
Henry Oswald
eb89ca1d3b added filestoreDomainOveride 2018-07-03 16:41:34 +01:00
Henry Oswald
2384eb83d9 add load balance http endpoints to shut box down 2018-06-28 16:04:34 +01:00
Henry Oswald
c33c9f8fc7 fix seccomp key 2018-06-26 15:38:30 +01:00
Henry Oswald
5c3c39c743 add error catch to settings.defaults 2018-06-26 15:04:56 +01:00
Henry Oswald
3640326a26 put seccomp_profile_path into variable and try catch 2018-06-26 14:44:03 +01:00
Henry Oswald
c4e8d76427 added seccomp 2018-06-26 12:43:47 +01:00
Brian Gough
b95317c8fe increase timeout on wordcount 2018-06-25 14:06:18 +01:00
Christopher Hoskin
ad8018ce0d Add csh-staging to repos 2018-06-13 15:47:45 +01:00
Henry Oswald
2c10ac06f2 remove the compile npm command, it isn't needed 2018-06-12 17:48:23 +01:00
Henry Oswald
62a33701e9 update build scripts so smoke tests are compiled 2018-06-12 17:44:13 +01:00
Christopher Hoskin
8ff001ad54 Specify repo correctly 2018-06-12 15:26:10 +01:00
Christopher Hoskin
cfa1b8ef64 Increase acceptance test timeout. 2018-06-12 15:04:14 +01:00
Christopher Hoskin
2155657651 Accidently left warning message commented out :( 2018-06-12 11:17:26 +01:00
Christopher Hoskin
824745dfbc Update build scripts from 1.1.3 to 1.1.6 2018-06-12 10:22:30 +01:00
Christopher Hoskin
15aae19d2d Use metadata to determine Google Cloud project dynamically. Fixes: #601 2018-06-12 10:15:17 +01:00
Henry Oswald
8a64b9c29c Merge branch 'master' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-06-08 19:21:18 +01:00
Henry Oswald
e8ec175bf1 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-05-25 15:33:08 +01:00
Henry Oswald
b2fa2e7d55 bumped timeout to 30 seconds 2018-05-25 15:30:26 +01:00
henry oswald
0e2603e4be change synctex binary and added it to mounted volumes in docker config 2018-05-25 13:45:07 +00:00
henry oswald
1101763f50 all but the sync tests should pass 2018-05-25 12:43:12 +00:00
Henry Oswald
c3ae6b5d23 log settings on startup 2018-05-25 12:01:16 +01:00
Henry Oswald
64f01a125f set user to tex for tests run on ci box 2018-05-25 11:51:34 +01:00
Henry Oswald
f769765923 added --exit to unit tests 2018-05-24 21:59:02 +01:00
Henry Oswald
91bd54cff9 update to 1.1.3 build scripts 2018-05-24 19:03:57 +01:00
Alberto Fernández Capel
3ad8e9f2f1 Make travis read the node version from the .nvmrc file
See https://docs.travis-ci.com/user/languages/javascript-with-nodejs/#Specifying-Node.js-versions-using-.nvmrc
2018-05-01 09:25:37 +01:00
Henry Oswald
35da59ac8a update package.json scripts 2018-04-09 11:06:35 +01:00
Henry Oswald
4c96abd6c5 grep works with command
updated build scripts
acceptence tests break, files are written as root when user is node
2018-03-29 17:07:22 +01:00
Henry Oswald
551e8d36b4 update build script and add load balancer agent 2018-03-29 12:12:29 +01:00
Henry Oswald
41e39458d1 add smoke test env var 2018-03-20 13:48:12 +00:00
Henry Oswald
4a5dc9d946 ammend comment 2018-03-19 14:22:18 +00:00
Henry Oswald
9731267ae5 try a build with node user 2018-03-19 14:10:45 +00:00
Henry Oswald
edf0125c2f run as app user and chmod 777 compiles dir 2018-03-19 12:56:53 +00:00
Henry Oswald
f6663f2f5f try running as root 2018-03-19 09:51:26 +00:00
Henry Oswald
f496de6d13 don't put synctex in as a volume 2018-03-16 18:11:46 +00:00
Henry Oswald
bde294b8c2 chown synctex and add the creation of directories in 2018-03-16 17:48:55 +00:00
Henry Oswald
3b2deaecf7 mkdir the /app/bin/synctex-mount 2018-03-16 17:40:10 +00:00
Henry Oswald
fc594f7d8e add logging of docker options 2018-03-16 17:37:36 +00:00
Henry Oswald
2d03cb3eb1 added debugging and new moving commands 2018-03-16 17:30:11 +00:00
Henry Oswald
6d21ab734a try copying synctex betwen directories 2018-03-16 17:10:56 +00:00
Henry Oswald
4179d19200 move synctex into a directory for simple mounting 2018-03-16 16:50:30 +00:00
Henry Oswald
48eb7129a7 add synctex back in 2018-03-16 16:22:39 +00:00
Henry Oswald
29dcef3b9e comment out synctex for moment 2018-03-16 16:04:26 +00:00
Henry Oswald
faedf16704 add log line for connecting to a db 2018-03-16 15:29:35 +00:00
Henry Oswald
6fe6924e6a make compiles dir 2018-03-16 15:25:36 +00:00
Henry Oswald
b714ea193a remove texlive docker images 2018-03-14 15:44:58 +00:00
Henry Oswald
3c2172434b have entrypoint kickoff download off texlive images
install script exits without error if auth fails.
2018-03-14 15:44:58 +00:00
Henry Oswald
c080938480 add docker ignore rather than make clean 2018-03-14 15:44:58 +00:00
Henry Oswald
c80c38b7a9 update build scripts 2018-03-14 15:44:58 +00:00
Henry Oswald
43b1fe4b68 test new scripts on ci 2018-03-14 15:44:58 +00:00
Henry Oswald
e4e30cf2e2 fixed commended tests 2018-03-14 15:44:58 +00:00
Henry Oswald
572f1ee230 update scripts from latest build scripts 1.1.0 2018-03-14 15:44:58 +00:00
Henry Oswald
17e86fbfc5 remove touch /var/run/docker.sock which doesn’t work robustly 2018-03-14 15:44:58 +00:00
Henry Oswald
f06fa2e146 add cmd back in 2018-03-14 15:44:58 +00:00
Henry Oswald
5285d393a0 set entry point for dockerfile 2018-03-14 15:44:58 +00:00
Henry Oswald
b86dc2623f removed user temporarly, created make ci task 2018-03-14 15:44:58 +00:00
Henry Oswald
bd0a7c3557 add logging in db.coffee 2018-03-14 15:44:58 +00:00
Henry Oswald
dbb5cb5e44 update jenkins task 2018-03-14 15:44:58 +00:00
Henry Oswald
cf8d5cdd41 add cache dir 2018-03-14 15:44:58 +00:00
Henry Oswald
34c52e6c98 removed unused scripts 2018-03-14 15:44:58 +00:00
Henry Oswald
8dce1e2958 wip for ci 2018-03-14 15:44:58 +00:00
Henry Oswald
9a519f0d3d added docker runner into core codebase
supports both local command runner and docker runner

added docker files for tex live

also fixed tests so they exit correctly & removed debug lines
2018-03-14 15:44:49 +00:00
Henry Oswald
729d29253d fix url fetcher tests so they exit correctly 2018-03-05 10:39:46 +00:00
Henry Oswald
3ce5229435 add SYNCTEX_BIN_HOST_PATH for ci 2018-03-03 13:40:29 +00:00
Henry Oswald
9686e182ed Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-03-03 13:37:00 +00:00
Henry Oswald
ac3b0a02da update docker compose ci to use extension file and dockerfile 2018-03-03 13:36:42 +00:00
Henry Oswald
aa58b7a75f Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-03-02 18:31:09 +00:00
Henry Oswald
d97ccc6e07 Merge branch 'master' into ho-dockerise 2018-03-02 18:18:18 +00:00
Henry Oswald
1320854da9 Merge branch 'master' into ho-dockerise 2018-03-02 18:16:16 +00:00
Henry Oswald
0589c8c544 Merge branch 'master' into ho-dockerise 2018-03-02 18:12:32 +00:00
Henry Oswald
9afb7e9417 built with 1.1.0 scripts 2018-03-02 18:08:13 +00:00
Henry Oswald
2168f20715 uncomment tests 2018-03-02 17:59:37 +00:00
Henry Oswald
f9b6b3dda8 make timeout latex more complex(slower) 2018-03-02 17:58:34 +00:00
Henry Oswald
f39d14bf1b unit tests pass, acceptence fail
uncomment tests
2018-03-02 17:34:41 +00:00
Henry Oswald
3399f55153 wip, docker container is correctly created 2018-03-02 17:14:23 +00:00
Henry Oswald
603069ea59 tests pass under app user 2018-03-02 17:14:23 +00:00
Henry Oswald
b1c0abbd4d updateded build scripts 2018-03-02 17:14:23 +00:00
Henry Oswald
c0058ac720 mount app as volume in docker container for local tests
change to overrides
2018-03-02 17:14:23 +00:00
Henry Oswald
ece0540318 updated build sripts with 1.0.3 2018-03-02 17:14:23 +00:00
Henry Oswald
fdac655cd4 acceptence tests pass inside docker container (apart from sync) 2018-03-02 17:14:23 +00:00
Henry Oswald
5cf3c904cb mvp
needs hacked pacth in docker runner

wip

most tests pass
2018-03-02 17:14:20 +00:00
James Allen
df21b9de53 Provide hosts and siblings container as environment settings and add npm run start script
wip acceptence tests run, but don't all pass

wip

removed npm-debug from git
2018-03-02 17:14:18 +00:00
James Allen
64ad02b1bf Merge pull request #83 from sharelatex/ja-dockerize-dev
Provide hosts as settings and add npm run start script
2018-01-16 17:08:09 +00:00
James Allen
d0e5fb2d34 Allow texlive image user to be configured 2018-01-16 10:46:59 +00:00
Brian Gough
78f2fdd25b Merge pull request #82 from sharelatex/bg-log-core-files-as-error
log an error if core file is found in output
2018-01-04 09:22:44 +00:00
Brian Gough
e18538bd38 log an error if core file is found in output 2018-01-03 15:41:31 +00:00
James Allen
08a0c6feb4 Provide hosts and siblings container as environment settings and add npm run start script 2017-12-29 08:08:19 +00:00
Joe Green
adaf742a7b Add a 1 second delay to the smoke tests (#81)
* Add a 1 second delay to the smoke tests

Fixes a race condition where smoke tests exit before container can be attached to.

See here for more info: https://github.com/overleaf/sharelatex/issues/274

* give the smoke tests additional work to do

* escape slashes
2017-12-05 16:51:59 +00:00
Joe Green
beaa198347 Increase smoke test interval to 30 seconds
The smoke tests can sometimes take ~20 seconds to complete, which causes the http POST to time out. This should solve that problem.
2017-11-29 11:01:51 +00:00
Brian Gough
f1c59150b7 exit if mock server fails to start 2017-10-20 15:16:35 +01:00
Joe Green
45adf904b7 Update Jenkinsfile 2017-10-16 14:13:51 +01:00
Joe Green
75836ecb0a only alert on master 2017-10-12 16:54:54 +01:00
Brian Gough
3c937ce2d4 fix typo in log message 2017-10-02 15:45:09 +01:00
Brian Gough
392e96b81d move logging from SafeReader into caller
prevent unnecessary logging when looking at headers of files where
hitting the end of the file is expected.
2017-10-02 15:44:00 +01:00
Brian Gough
e209c48bd9 simplify tikzexternalize checks 2017-09-29 17:00:53 +01:00
Brian Gough
2bdba15bd5 keep tikzexternalize files 2017-09-29 16:02:23 +01:00
Joe Green
dc0b7d5dba Update Jenkinsfile 2017-09-28 13:46:01 +01:00
Brian Gough
ce51cc673f Merge branch 'bg-lock-compiles' 2017-09-28 13:16:29 +01:00
Joe Green
273de10eb4 use npm cache in CI build 2017-09-28 11:51:41 +01:00
Joe Green
4ff6cd3006 Jg jenkinsfile cleanup (#75)
* Update Jenkinsfile

make sure we don't ship unneeded build files

* Update ExampleDocumentTests.coffee

* use node 6.11.2 in jenkins file
2017-09-28 11:50:33 +01:00
Brian Gough
860929b198 Merge pull request #73 from sharelatex/bg-handle-dot-files-in-resource-list
handle dot files in resource list
2017-09-28 09:59:27 +01:00
Joe Green
33dfe5b2a2 Update Jenkinsfile 2017-09-26 11:44:48 +01:00
Brian Gough
a7cb7e6e4c use a separate function for hidden file check 2017-09-26 11:03:20 +01:00
Brian Gough
ef0db811e1 exclude hidden files from output
express static server doesn't serve them and rejects with 404
2017-09-26 10:42:59 +01:00
Brian Gough
2a23082c4e remove stat test for missing files 2017-09-26 09:48:09 +01:00