github/overleaf
1
0
Fork 0
mirror of https://github.com/overleaf/overleaf.git synced 2024-11-29 16:33:39 -05:00
Code Issues Projects Releases Packages Wiki Activity
615 commits 3 branches 7 tags 206 MiB
Commit graph

554 commits

Author SHA1 Message Date
Henry Oswald
759988401b add db queue file for global db query queues 2018-07-30 16:46:47 +01:00
Henry Oswald
1080c2c428 added a queue with 1 concurency to db queries 2018-07-30 16:22:04 +01:00
Henry Oswald
daf40fc757 added some debugging 2018-07-30 15:18:25 +01:00
Henry Oswald
f2dfb718c6 add sync= off and read_uncommited=true to improve perf 2018-07-30 15:16:06 +01:00
Henry Oswald
dc225f6aa3 remove some console.logs 2018-07-30 15:11:41 +01:00
Henry Oswald
1ef8ea328c remove password from clsi for sql 
sequalise fails when it is set to null
 2018-07-30 14:04:33 +01:00
Henry Oswald
3b06835499 bump retried and package versions 2018-07-30 11:25:28 +01:00
Henry Oswald
a7a6a4dde6 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-26 16:52:26 +01:00
Henry Oswald
65679af0cb dd wal logging 2018-07-26 16:12:26 +01:00
Christopher Hoskin
98108b87e7 Push images to overleaf-ops 2018-07-18 11:32:41 +01:00
Henry Oswald
e8c735e794 only set wal for sqlite 2018-07-17 12:53:07 +01:00
Henry Oswald
52a39b02ce Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-17 12:52:18 +01:00
Henry Oswald
d840246d29 add PRAGMA journal_mode=WAL; 2018-07-17 12:50:33 +01:00
Christopher Hoskin
28373d34f5 Bump build script to 1.1.8, drop csh-gcdm-test and csh-staging repos 2018-07-17 12:10:08 +01:00
Brian Gough
4c2a03cc32 Merge branch 'master' of github.com:sharelatex/clsi-sharelatex 2018-07-17 10:41:14 +01:00
Brian Gough
d85980ad9d allow prune to fail to prevent build from terminating 2018-07-17 10:41:10 +01:00
Henry Oswald
e46b6563c0 change override to leave image name so it works for wl_texlive 2018-07-16 17:25:14 +01:00
Henry Oswald
a767bfe964 remove express header 2018-07-16 15:38:23 +01:00
Henry Oswald
846c2b1e28 move texliveImageNameOveride further down request so it works for 
compile tests
 2018-07-13 11:52:49 +01:00
Henry Oswald
c8d3c39bea quick hack to overright image name further down stack 2018-07-13 11:46:37 +01:00
Henry Oswald
a47db60cbd Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-07-13 10:42:27 +01:00
Henry Oswald
4ec8a423cb added texliveImageNameOveride 2018-07-13 10:37:22 +01:00
Christopher Hoskin
68f708cf55 Depend on metrics v1.8.1 for remote StatsD host 2018-07-12 11:22:02 +01:00
Christopher Hoskin
12bfe122b9 Use our experimental metrics 2018-07-06 15:08:38 +01:00
Henry Oswald
6825285b02 added maint down endpoint 2018-07-05 15:07:07 +01:00
Henry Oswald
eb89ca1d3b added filestoreDomainOveride 2018-07-03 16:41:34 +01:00
Henry Oswald
2384eb83d9 add load balance http endpoints to shut box down 2018-06-28 16:04:34 +01:00
Henry Oswald
c33c9f8fc7 fix seccomp key 2018-06-26 15:38:30 +01:00
Henry Oswald
5c3c39c743 add error catch to settings.defaults 2018-06-26 15:04:56 +01:00
Henry Oswald
3640326a26 put seccomp_profile_path into variable and try catch 2018-06-26 14:44:03 +01:00
Henry Oswald
c4e8d76427 added seccomp 2018-06-26 12:43:47 +01:00
Brian Gough
b95317c8fe increase timeout on wordcount 2018-06-25 14:06:18 +01:00
Christopher Hoskin
ad8018ce0d Add csh-staging to repos 2018-06-13 15:47:45 +01:00
Henry Oswald
2c10ac06f2 remove the compile npm command, it isn't needed 2018-06-12 17:48:23 +01:00
Henry Oswald
62a33701e9 update build scripts so smoke tests are compiled 2018-06-12 17:44:13 +01:00
Christopher Hoskin
8ff001ad54 Specify repo correctly 2018-06-12 15:26:10 +01:00
Christopher Hoskin
cfa1b8ef64 Increase acceptance test timeout. 2018-06-12 15:04:14 +01:00
Christopher Hoskin
2155657651 Accidently left warning message commented out :( 2018-06-12 11:17:26 +01:00
Christopher Hoskin
824745dfbc Update build scripts from 1.1.3 to 1.1.6 2018-06-12 10:22:30 +01:00
Christopher Hoskin
15aae19d2d Use metadata to determine Google Cloud project dynamically. Fixes: #601 2018-06-12 10:15:17 +01:00
Henry Oswald
8a64b9c29c Merge branch 'master' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-06-08 19:21:18 +01:00
Henry Oswald
e8ec175bf1 Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-05-25 15:33:08 +01:00
Henry Oswald
b2fa2e7d55 bumped timeout to 30 seconds 2018-05-25 15:30:26 +01:00
henry oswald
0e2603e4be change synctex binary and added it to mounted volumes in docker config 2018-05-25 13:45:07 +00:00
henry oswald
1101763f50 all but the sync tests should pass 2018-05-25 12:43:12 +00:00
Henry Oswald
c3ae6b5d23 log settings on startup 2018-05-25 12:01:16 +01:00
Henry Oswald
64f01a125f set user to tex for tests run on ci box 2018-05-25 11:51:34 +01:00
Henry Oswald
f769765923 added --exit to unit tests 2018-05-24 21:59:02 +01:00
Henry Oswald
91bd54cff9 update to 1.1.3 build scripts 2018-05-24 19:03:57 +01:00
Alberto Fernández Capel
3ad8e9f2f1 Make travis read the node version from the .nvmrc file 
See https://docs.travis-ci.com/user/languages/javascript-with-nodejs/#Specifying-Node.js-versions-using-.nvmrc
 2018-05-01 09:25:37 +01:00
Henry Oswald
35da59ac8a update package.json scripts 2018-04-09 11:06:35 +01:00
Henry Oswald
4c96abd6c5 grep works with command 
updated build scripts
acceptence tests break, files are written as root when user is node
 2018-03-29 17:07:22 +01:00
Henry Oswald
551e8d36b4 update build script and add load balancer agent 2018-03-29 12:12:29 +01:00
Henry Oswald
41e39458d1 add smoke test env var 2018-03-20 13:48:12 +00:00
Henry Oswald
4a5dc9d946 ammend comment 2018-03-19 14:22:18 +00:00
Henry Oswald
9731267ae5 try a build with node user 2018-03-19 14:10:45 +00:00
Henry Oswald
edf0125c2f run as app user and chmod 777 compiles dir 2018-03-19 12:56:53 +00:00
Henry Oswald
f6663f2f5f try running as root 2018-03-19 09:51:26 +00:00
Henry Oswald
f496de6d13 don't put synctex in as a volume 2018-03-16 18:11:46 +00:00
Henry Oswald
bde294b8c2 chown synctex and add the creation of directories in 2018-03-16 17:48:55 +00:00
Henry Oswald
3b2deaecf7 mkdir the /app/bin/synctex-mount 2018-03-16 17:40:10 +00:00
Henry Oswald
fc594f7d8e add logging of docker options 2018-03-16 17:37:36 +00:00
Henry Oswald
2d03cb3eb1 added debugging and new moving commands 2018-03-16 17:30:11 +00:00
Henry Oswald
6d21ab734a try copying synctex betwen directories 2018-03-16 17:10:56 +00:00
Henry Oswald
4179d19200 move synctex into a directory for simple mounting 2018-03-16 16:50:30 +00:00
Henry Oswald
48eb7129a7 add synctex back in 2018-03-16 16:22:39 +00:00
Henry Oswald
29dcef3b9e comment out synctex for moment 2018-03-16 16:04:26 +00:00
Henry Oswald
faedf16704 add log line for connecting to a db 2018-03-16 15:29:35 +00:00
Henry Oswald
6fe6924e6a make compiles dir 2018-03-16 15:25:36 +00:00
Henry Oswald
b714ea193a remove texlive docker images 2018-03-14 15:44:58 +00:00
Henry Oswald
3c2172434b have entrypoint kickoff download off texlive images 
install script exits without error if auth fails.
 2018-03-14 15:44:58 +00:00
Henry Oswald
c080938480 add docker ignore rather than make clean 2018-03-14 15:44:58 +00:00
Henry Oswald
c80c38b7a9 update build scripts 2018-03-14 15:44:58 +00:00
Henry Oswald
43b1fe4b68 test new scripts on ci 2018-03-14 15:44:58 +00:00
Henry Oswald
e4e30cf2e2 fixed commended tests 2018-03-14 15:44:58 +00:00
Henry Oswald
572f1ee230 update scripts from latest build scripts 1.1.0 2018-03-14 15:44:58 +00:00
Henry Oswald
17e86fbfc5 remove touch /var/run/docker.sock which doesn’t work robustly 2018-03-14 15:44:58 +00:00
Henry Oswald
f06fa2e146 add cmd back in 2018-03-14 15:44:58 +00:00
Henry Oswald
5285d393a0 set entry point for dockerfile 2018-03-14 15:44:58 +00:00
Henry Oswald
b86dc2623f removed user temporarly, created make ci task 2018-03-14 15:44:58 +00:00
Henry Oswald
bd0a7c3557 add logging in db.coffee 2018-03-14 15:44:58 +00:00
Henry Oswald
dbb5cb5e44 update jenkins task 2018-03-14 15:44:58 +00:00
Henry Oswald
cf8d5cdd41 add cache dir 2018-03-14 15:44:58 +00:00
Henry Oswald
34c52e6c98 removed unused scripts 2018-03-14 15:44:58 +00:00
Henry Oswald
8dce1e2958 wip for ci 2018-03-14 15:44:58 +00:00
Henry Oswald
9a519f0d3d added docker runner into core codebase 
supports both local command runner and docker runner

added docker files for tex live

also fixed tests so they exit correctly & removed debug lines
 2018-03-14 15:44:49 +00:00
Henry Oswald
729d29253d fix url fetcher tests so they exit correctly 2018-03-05 10:39:46 +00:00
Henry Oswald
3ce5229435 add SYNCTEX_BIN_HOST_PATH for ci 2018-03-03 13:40:29 +00:00
Henry Oswald
9686e182ed Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-03-03 13:37:00 +00:00
Henry Oswald
ac3b0a02da update docker compose ci to use extension file and dockerfile 2018-03-03 13:36:42 +00:00
Henry Oswald
aa58b7a75f Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise 2018-03-02 18:31:09 +00:00
Henry Oswald
d97ccc6e07 Merge branch 'master' into ho-dockerise 2018-03-02 18:18:18 +00:00
Henry Oswald
1320854da9 Merge branch 'master' into ho-dockerise 2018-03-02 18:16:16 +00:00
Henry Oswald
0589c8c544 Merge branch 'master' into ho-dockerise 2018-03-02 18:12:32 +00:00
Henry Oswald
9afb7e9417 built with 1.1.0 scripts 2018-03-02 18:08:13 +00:00
Henry Oswald
2168f20715 uncomment tests 2018-03-02 17:59:37 +00:00
Henry Oswald
f9b6b3dda8 make timeout latex more complex(slower) 2018-03-02 17:58:34 +00:00
Henry Oswald
f39d14bf1b unit tests pass, acceptence fail 
uncomment tests
 2018-03-02 17:34:41 +00:00
Henry Oswald
3399f55153 wip, docker container is correctly created 2018-03-02 17:14:23 +00:00
Henry Oswald
603069ea59 tests pass under app user 2018-03-02 17:14:23 +00:00
Henry Oswald
b1c0abbd4d updateded build scripts 2018-03-02 17:14:23 +00:00
Henry Oswald
c0058ac720 mount app as volume in docker container for local tests 
change to overrides
 2018-03-02 17:14:23 +00:00
Henry Oswald
ece0540318 updated build sripts with 1.0.3 2018-03-02 17:14:23 +00:00
Henry Oswald
fdac655cd4 acceptence tests pass inside docker container (apart from sync) 2018-03-02 17:14:23 +00:00
Henry Oswald
5cf3c904cb mvp 
needs hacked pacth in docker runner

wip

most tests pass
 2018-03-02 17:14:20 +00:00
James Allen
df21b9de53 Provide hosts and siblings container as environment settings and add npm run start script 
wip acceptence tests run, but don't all pass

wip

removed npm-debug from git
 2018-03-02 17:14:18 +00:00
James Allen
64ad02b1bf Merge pull request #83 from sharelatex/ja-dockerize-dev 
Provide hosts as settings and add npm run start script
 2018-01-16 17:08:09 +00:00
James Allen
d0e5fb2d34 Allow texlive image user to be configured 2018-01-16 10:46:59 +00:00
Brian Gough
78f2fdd25b Merge pull request #82 from sharelatex/bg-log-core-files-as-error 
log an error if core file is found in output
 2018-01-04 09:22:44 +00:00
Brian Gough
e18538bd38 log an error if core file is found in output 2018-01-03 15:41:31 +00:00
James Allen
08a0c6feb4 Provide hosts and siblings container as environment settings and add npm run start script 2017-12-29 08:08:19 +00:00
Joe Green
adaf742a7b Add a 1 second delay to the smoke tests (#81) 
* Add a 1 second delay to the smoke tests

Fixes a race condition where smoke tests exit before container can be attached to.

See here for more info: https://github.com/overleaf/sharelatex/issues/274

* give the smoke tests additional work to do

* escape slashes
 2017-12-05 16:51:59 +00:00
Joe Green
beaa198347 Increase smoke test interval to 30 seconds 
The smoke tests can sometimes take ~20 seconds to complete, which causes the http POST to time out. This should solve that problem.
 2017-11-29 11:01:51 +00:00
Brian Gough
f1c59150b7 exit if mock server fails to start 2017-10-20 15:16:35 +01:00
Joe Green
45adf904b7 Update Jenkinsfile 2017-10-16 14:13:51 +01:00
Joe Green
75836ecb0a only alert on master 2017-10-12 16:54:54 +01:00
Brian Gough
3c937ce2d4 fix typo in log message 2017-10-02 15:45:09 +01:00
Brian Gough
392e96b81d move logging from SafeReader into caller 
prevent unnecessary logging when looking at headers of files where
hitting the end of the file is expected.
 2017-10-02 15:44:00 +01:00
Brian Gough
e209c48bd9 simplify tikzexternalize checks 2017-09-29 17:00:53 +01:00
Brian Gough
2bdba15bd5 keep tikzexternalize files 2017-09-29 16:02:23 +01:00
Joe Green
dc0b7d5dba Update Jenkinsfile 2017-09-28 13:46:01 +01:00
Brian Gough
ce51cc673f Merge branch 'bg-lock-compiles' 2017-09-28 13:16:29 +01:00
Joe Green
273de10eb4 use npm cache in CI build 2017-09-28 11:51:41 +01:00
Joe Green
4ff6cd3006 Jg jenkinsfile cleanup (#75) 
* Update Jenkinsfile

make sure we don't ship unneeded build files

* Update ExampleDocumentTests.coffee

* use node 6.11.2 in jenkins file
 2017-09-28 11:50:33 +01:00
Brian Gough
860929b198 Merge pull request #73 from sharelatex/bg-handle-dot-files-in-resource-list 
handle dot files in resource list
 2017-09-28 09:59:27 +01:00
Joe Green
33dfe5b2a2 Update Jenkinsfile 2017-09-26 11:44:48 +01:00
Brian Gough
a7cb7e6e4c use a separate function for hidden file check 2017-09-26 11:03:20 +01:00
Brian Gough
ef0db811e1 exclude hidden files from output 
express static server doesn't serve them and rejects with 404
 2017-09-26 10:42:59 +01:00
Brian Gough
2a23082c4e remove stat test for missing files 2017-09-26 09:48:09 +01:00
Brian Gough
d46943a7bb only exclude clsi-specific files from output list 2017-09-26 09:47:29 +01:00
Brian Gough
d464556f74 fix comment 2017-09-25 16:06:45 +01:00
Brian Gough
8685b774ee fix unit tests for use of fs-extra 2017-09-25 15:28:31 +01:00
Brian Gough
7f0e6f3eec lock compile directory 2017-09-22 16:19:33 +01:00
Brian Gough
b03271edee unit tests for ResourceStateManager 2017-09-15 13:42:57 +01:00
Brian Gough
81e8243827 fallback check for missing files 
dot files are not examined by OutputFileFinder, so do an extra check to
make sure those exist

also check for any relative paths in the resources
 2017-09-15 13:41:56 +01:00
Brian Gough
0d613a6480 Merge pull request #71 from sharelatex/bg-merge-state-and-resource-list-files 
merge state and resource list files
 2017-09-11 08:54:30 +01:00
Joe Green
41e442d403 Add jenkinsfile (#72) 
* create Jenkinsfile

* allow textlive image to be set with env vars

* log error message in test

* use sandboxed compiles variables

* Add SANDBOXED_COMPILES_HOST_DIR var to test config

* add SIBLING_CONTAINER_USER env var
 2017-09-08 14:06:04 +01:00
Brian Gough
0a242bac3c rename saveProjectStateHash to saveProjectState 2017-09-08 13:56:40 +01:00
Brian Gough
66431fc2b8 log any missing files 2017-09-07 16:54:09 +01:00
Brian Gough
b8e8530a16 fix whitespace 2017-09-07 13:52:34 +01:00
Brian Gough
cbd3e32143 log error if state file is truncacted 2017-09-07 13:52:34 +01:00
Brian Gough
3d1c3a1d27 combine the resource state and resource list 
to prevent them getting out of sync
 2017-09-07 13:52:34 +01:00
Shane Kilkelly
5b33129138 Merge pull request #70 from sharelatex/sk-node-6 
Upgrade to node 6.11
 2017-08-31 13:35:27 +01:00
Shane Kilkelly
ae2af06f7b Upgrade to node 6.9 2017-08-29 14:30:43 +01:00
Brian Gough
ea3ee82e74 added logging 2017-08-29 12:09:31 +01:00
James Allen
30dd9655bf Merge pull request #69 from sharelatex/as-update-docker-runner-config 
Update docker-runner-sharelatex config
 2017-08-24 15:17:16 +02:00
Alasdair Smith
87935f30c5 Update docker-runner-sharelatex config 2017-08-24 13:34:24 +01:00
Brian Gough
43f424295e Merge pull request #66 from sharelatex/bg-compile-from-redis 
Write files incrementally
 2017-08-23 15:35:56 +01:00
Brian Gough
26f85ba75f read resource files safely 
put a limit on the amount of data read
 2017-08-18 11:17:01 +01:00
Brian Gough
a84c884fc9 splice state management into ResourceStateManager 2017-08-18 10:22:17 +01:00