Henry Oswald
f2dfb718c6
add sync= off and read_uncommited=true to improve perf
2018-07-30 15:16:06 +01:00
Henry Oswald
dc225f6aa3
remove some console.logs
2018-07-30 15:11:41 +01:00
Henry Oswald
1ef8ea328c
remove password from clsi for sql
...
sequalise fails when it is set to null
2018-07-30 14:04:33 +01:00
Henry Oswald
3b06835499
bump retried and package versions
2018-07-30 11:25:28 +01:00
Henry Oswald
a7a6a4dde6
Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-07-26 16:52:26 +01:00
Henry Oswald
65679af0cb
dd wal logging
2018-07-26 16:12:26 +01:00
Christopher Hoskin
98108b87e7
Push images to overleaf-ops
2018-07-18 11:32:41 +01:00
Henry Oswald
e8c735e794
only set wal for sqlite
2018-07-17 12:53:07 +01:00
Henry Oswald
52a39b02ce
Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-07-17 12:52:18 +01:00
Henry Oswald
d840246d29
add PRAGMA journal_mode=WAL;
2018-07-17 12:50:33 +01:00
Christopher Hoskin
28373d34f5
Bump build script to 1.1.8, drop csh-gcdm-test and csh-staging repos
2018-07-17 12:10:08 +01:00
Brian Gough
4c2a03cc32
Merge branch 'master' of github.com:sharelatex/clsi-sharelatex
2018-07-17 10:41:14 +01:00
Brian Gough
d85980ad9d
allow prune to fail to prevent build from terminating
2018-07-17 10:41:10 +01:00
Henry Oswald
e46b6563c0
change override to leave image name so it works for wl_texlive
2018-07-16 17:25:14 +01:00
Henry Oswald
a767bfe964
remove express header
2018-07-16 15:38:23 +01:00
Henry Oswald
846c2b1e28
move texliveImageNameOveride further down request so it works for
...
compile tests
2018-07-13 11:52:49 +01:00
Henry Oswald
c8d3c39bea
quick hack to overright image name further down stack
2018-07-13 11:46:37 +01:00
Henry Oswald
a47db60cbd
Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-07-13 10:42:27 +01:00
Henry Oswald
4ec8a423cb
added texliveImageNameOveride
2018-07-13 10:37:22 +01:00
Christopher Hoskin
68f708cf55
Depend on metrics v1.8.1 for remote StatsD host
2018-07-12 11:22:02 +01:00
Christopher Hoskin
12bfe122b9
Use our experimental metrics
2018-07-06 15:08:38 +01:00
Henry Oswald
6825285b02
added maint down endpoint
2018-07-05 15:07:07 +01:00
Henry Oswald
eb89ca1d3b
added filestoreDomainOveride
2018-07-03 16:41:34 +01:00
Henry Oswald
2384eb83d9
add load balance http endpoints to shut box down
2018-06-28 16:04:34 +01:00
Henry Oswald
c33c9f8fc7
fix seccomp key
2018-06-26 15:38:30 +01:00
Henry Oswald
5c3c39c743
add error catch to settings.defaults
2018-06-26 15:04:56 +01:00
Henry Oswald
3640326a26
put seccomp_profile_path into variable and try catch
2018-06-26 14:44:03 +01:00
Henry Oswald
c4e8d76427
added seccomp
2018-06-26 12:43:47 +01:00
Brian Gough
b95317c8fe
increase timeout on wordcount
2018-06-25 14:06:18 +01:00
Christopher Hoskin
ad8018ce0d
Add csh-staging to repos
2018-06-13 15:47:45 +01:00
Henry Oswald
2c10ac06f2
remove the compile npm command, it isn't needed
2018-06-12 17:48:23 +01:00
Henry Oswald
62a33701e9
update build scripts so smoke tests are compiled
2018-06-12 17:44:13 +01:00
Christopher Hoskin
8ff001ad54
Specify repo correctly
2018-06-12 15:26:10 +01:00
Christopher Hoskin
cfa1b8ef64
Increase acceptance test timeout.
2018-06-12 15:04:14 +01:00
Christopher Hoskin
2155657651
Accidently left warning message commented out :(
2018-06-12 11:17:26 +01:00
Christopher Hoskin
824745dfbc
Update build scripts from 1.1.3 to 1.1.6
2018-06-12 10:22:30 +01:00
Christopher Hoskin
15aae19d2d
Use metadata to determine Google Cloud project dynamically. Fixes : #601
2018-06-12 10:15:17 +01:00
Henry Oswald
8a64b9c29c
Merge branch 'master' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-06-08 19:21:18 +01:00
Henry Oswald
e8ec175bf1
Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-05-25 15:33:08 +01:00
Henry Oswald
b2fa2e7d55
bumped timeout to 30 seconds
2018-05-25 15:30:26 +01:00
henry oswald
0e2603e4be
change synctex binary and added it to mounted volumes in docker config
2018-05-25 13:45:07 +00:00
henry oswald
1101763f50
all but the sync tests should pass
2018-05-25 12:43:12 +00:00
Henry Oswald
c3ae6b5d23
log settings on startup
2018-05-25 12:01:16 +01:00
Henry Oswald
64f01a125f
set user to tex for tests run on ci box
2018-05-25 11:51:34 +01:00
Henry Oswald
f769765923
added --exit to unit tests
2018-05-24 21:59:02 +01:00
Henry Oswald
91bd54cff9
update to 1.1.3 build scripts
2018-05-24 19:03:57 +01:00
Alberto Fernández Capel
3ad8e9f2f1
Make travis read the node version from the .nvmrc file
...
See https://docs.travis-ci.com/user/languages/javascript-with-nodejs/#Specifying-Node.js-versions-using-.nvmrc
2018-05-01 09:25:37 +01:00
Henry Oswald
35da59ac8a
update package.json scripts
2018-04-09 11:06:35 +01:00
Henry Oswald
4c96abd6c5
grep works with command
...
updated build scripts
acceptence tests break, files are written as root when user is node
2018-03-29 17:07:22 +01:00
Henry Oswald
551e8d36b4
update build script and add load balancer agent
2018-03-29 12:12:29 +01:00
Henry Oswald
41e39458d1
add smoke test env var
2018-03-20 13:48:12 +00:00
Henry Oswald
4a5dc9d946
ammend comment
2018-03-19 14:22:18 +00:00
Henry Oswald
9731267ae5
try a build with node user
2018-03-19 14:10:45 +00:00
Henry Oswald
edf0125c2f
run as app user and chmod 777 compiles dir
2018-03-19 12:56:53 +00:00
Henry Oswald
f6663f2f5f
try running as root
2018-03-19 09:51:26 +00:00
Henry Oswald
f496de6d13
don't put synctex in as a volume
2018-03-16 18:11:46 +00:00
Henry Oswald
bde294b8c2
chown synctex and add the creation of directories in
2018-03-16 17:48:55 +00:00
Henry Oswald
3b2deaecf7
mkdir the /app/bin/synctex-mount
2018-03-16 17:40:10 +00:00
Henry Oswald
fc594f7d8e
add logging of docker options
2018-03-16 17:37:36 +00:00
Henry Oswald
2d03cb3eb1
added debugging and new moving commands
2018-03-16 17:30:11 +00:00
Henry Oswald
6d21ab734a
try copying synctex betwen directories
2018-03-16 17:10:56 +00:00
Henry Oswald
4179d19200
move synctex into a directory for simple mounting
2018-03-16 16:50:30 +00:00
Henry Oswald
48eb7129a7
add synctex back in
2018-03-16 16:22:39 +00:00
Henry Oswald
29dcef3b9e
comment out synctex for moment
2018-03-16 16:04:26 +00:00
Henry Oswald
faedf16704
add log line for connecting to a db
2018-03-16 15:29:35 +00:00
Henry Oswald
6fe6924e6a
make compiles dir
2018-03-16 15:25:36 +00:00
Henry Oswald
b714ea193a
remove texlive docker images
2018-03-14 15:44:58 +00:00
Henry Oswald
3c2172434b
have entrypoint kickoff download off texlive images
...
install script exits without error if auth fails.
2018-03-14 15:44:58 +00:00
Henry Oswald
c080938480
add docker ignore rather than make clean
2018-03-14 15:44:58 +00:00
Henry Oswald
c80c38b7a9
update build scripts
2018-03-14 15:44:58 +00:00
Henry Oswald
43b1fe4b68
test new scripts on ci
2018-03-14 15:44:58 +00:00
Henry Oswald
e4e30cf2e2
fixed commended tests
2018-03-14 15:44:58 +00:00
Henry Oswald
572f1ee230
update scripts from latest build scripts 1.1.0
2018-03-14 15:44:58 +00:00
Henry Oswald
17e86fbfc5
remove touch /var/run/docker.sock which doesn’t work robustly
2018-03-14 15:44:58 +00:00
Henry Oswald
f06fa2e146
add cmd back in
2018-03-14 15:44:58 +00:00
Henry Oswald
5285d393a0
set entry point for dockerfile
2018-03-14 15:44:58 +00:00
Henry Oswald
b86dc2623f
removed user temporarly, created make ci task
2018-03-14 15:44:58 +00:00
Henry Oswald
bd0a7c3557
add logging in db.coffee
2018-03-14 15:44:58 +00:00
Henry Oswald
dbb5cb5e44
update jenkins task
2018-03-14 15:44:58 +00:00
Henry Oswald
cf8d5cdd41
add cache dir
2018-03-14 15:44:58 +00:00
Henry Oswald
34c52e6c98
removed unused scripts
2018-03-14 15:44:58 +00:00
Henry Oswald
8dce1e2958
wip for ci
2018-03-14 15:44:58 +00:00
Henry Oswald
9a519f0d3d
added docker runner into core codebase
...
supports both local command runner and docker runner
added docker files for tex live
also fixed tests so they exit correctly & removed debug lines
2018-03-14 15:44:49 +00:00
Henry Oswald
729d29253d
fix url fetcher tests so they exit correctly
2018-03-05 10:39:46 +00:00
Henry Oswald
3ce5229435
add SYNCTEX_BIN_HOST_PATH for ci
2018-03-03 13:40:29 +00:00
Henry Oswald
9686e182ed
Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-03-03 13:37:00 +00:00
Henry Oswald
ac3b0a02da
update docker compose ci to use extension file and dockerfile
2018-03-03 13:36:42 +00:00
Henry Oswald
aa58b7a75f
Merge branch 'ho-dockerise' of github.com:sharelatex/clsi-sharelatex into ho-dockerise
2018-03-02 18:31:09 +00:00
Henry Oswald
d97ccc6e07
Merge branch 'master' into ho-dockerise
2018-03-02 18:18:18 +00:00
Henry Oswald
1320854da9
Merge branch 'master' into ho-dockerise
2018-03-02 18:16:16 +00:00
Henry Oswald
0589c8c544
Merge branch 'master' into ho-dockerise
2018-03-02 18:12:32 +00:00
Henry Oswald
9afb7e9417
built with 1.1.0 scripts
2018-03-02 18:08:13 +00:00
Henry Oswald
2168f20715
uncomment tests
2018-03-02 17:59:37 +00:00
Henry Oswald
f9b6b3dda8
make timeout latex more complex(slower)
2018-03-02 17:58:34 +00:00
Henry Oswald
f39d14bf1b
unit tests pass, acceptence fail
...
uncomment tests
2018-03-02 17:34:41 +00:00
Henry Oswald
3399f55153
wip, docker container is correctly created
2018-03-02 17:14:23 +00:00
Henry Oswald
603069ea59
tests pass under app user
2018-03-02 17:14:23 +00:00
Henry Oswald
b1c0abbd4d
updateded build scripts
2018-03-02 17:14:23 +00:00
Henry Oswald
c0058ac720
mount app as volume in docker container for local tests
...
change to overrides
2018-03-02 17:14:23 +00:00
Henry Oswald
ece0540318
updated build sripts with 1.0.3
2018-03-02 17:14:23 +00:00
Henry Oswald
fdac655cd4
acceptence tests pass inside docker container (apart from sync)
2018-03-02 17:14:23 +00:00
Henry Oswald
5cf3c904cb
mvp
...
needs hacked pacth in docker runner
wip
most tests pass
2018-03-02 17:14:20 +00:00
James Allen
df21b9de53
Provide hosts and siblings container as environment settings and add npm run start script
...
wip acceptence tests run, but don't all pass
wip
removed npm-debug from git
2018-03-02 17:14:18 +00:00
James Allen
64ad02b1bf
Merge pull request #83 from sharelatex/ja-dockerize-dev
...
Provide hosts as settings and add npm run start script
2018-01-16 17:08:09 +00:00
James Allen
d0e5fb2d34
Allow texlive image user to be configured
2018-01-16 10:46:59 +00:00
Brian Gough
78f2fdd25b
Merge pull request #82 from sharelatex/bg-log-core-files-as-error
...
log an error if core file is found in output
2018-01-04 09:22:44 +00:00
Brian Gough
e18538bd38
log an error if core file is found in output
2018-01-03 15:41:31 +00:00
James Allen
08a0c6feb4
Provide hosts and siblings container as environment settings and add npm run start script
2017-12-29 08:08:19 +00:00
Joe Green
adaf742a7b
Add a 1 second delay to the smoke tests ( #81 )
...
* Add a 1 second delay to the smoke tests
Fixes a race condition where smoke tests exit before container can be attached to.
See here for more info: https://github.com/overleaf/sharelatex/issues/274
* give the smoke tests additional work to do
* escape slashes
2017-12-05 16:51:59 +00:00
Joe Green
beaa198347
Increase smoke test interval to 30 seconds
...
The smoke tests can sometimes take ~20 seconds to complete, which causes the http POST to time out. This should solve that problem.
2017-11-29 11:01:51 +00:00
Brian Gough
f1c59150b7
exit if mock server fails to start
2017-10-20 15:16:35 +01:00
Joe Green
45adf904b7
Update Jenkinsfile
2017-10-16 14:13:51 +01:00
Joe Green
75836ecb0a
only alert on master
2017-10-12 16:54:54 +01:00
Brian Gough
3c937ce2d4
fix typo in log message
2017-10-02 15:45:09 +01:00
Brian Gough
392e96b81d
move logging from SafeReader into caller
...
prevent unnecessary logging when looking at headers of files where
hitting the end of the file is expected.
2017-10-02 15:44:00 +01:00
Brian Gough
e209c48bd9
simplify tikzexternalize checks
2017-09-29 17:00:53 +01:00
Brian Gough
2bdba15bd5
keep tikzexternalize files
2017-09-29 16:02:23 +01:00
Joe Green
dc0b7d5dba
Update Jenkinsfile
2017-09-28 13:46:01 +01:00
Brian Gough
ce51cc673f
Merge branch 'bg-lock-compiles'
2017-09-28 13:16:29 +01:00
Joe Green
273de10eb4
use npm cache in CI build
2017-09-28 11:51:41 +01:00
Joe Green
4ff6cd3006
Jg jenkinsfile cleanup ( #75 )
...
* Update Jenkinsfile
make sure we don't ship unneeded build files
* Update ExampleDocumentTests.coffee
* use node 6.11.2 in jenkins file
2017-09-28 11:50:33 +01:00
Brian Gough
860929b198
Merge pull request #73 from sharelatex/bg-handle-dot-files-in-resource-list
...
handle dot files in resource list
2017-09-28 09:59:27 +01:00
Joe Green
33dfe5b2a2
Update Jenkinsfile
2017-09-26 11:44:48 +01:00
Brian Gough
a7cb7e6e4c
use a separate function for hidden file check
2017-09-26 11:03:20 +01:00
Brian Gough
ef0db811e1
exclude hidden files from output
...
express static server doesn't serve them and rejects with 404
2017-09-26 10:42:59 +01:00
Brian Gough
2a23082c4e
remove stat test for missing files
2017-09-26 09:48:09 +01:00
Brian Gough
d46943a7bb
only exclude clsi-specific files from output list
2017-09-26 09:47:29 +01:00
Brian Gough
d464556f74
fix comment
2017-09-25 16:06:45 +01:00
Brian Gough
8685b774ee
fix unit tests for use of fs-extra
2017-09-25 15:28:31 +01:00
Brian Gough
7f0e6f3eec
lock compile directory
2017-09-22 16:19:33 +01:00
Brian Gough
b03271edee
unit tests for ResourceStateManager
2017-09-15 13:42:57 +01:00
Brian Gough
81e8243827
fallback check for missing files
...
dot files are not examined by OutputFileFinder, so do an extra check to
make sure those exist
also check for any relative paths in the resources
2017-09-15 13:41:56 +01:00
Brian Gough
0d613a6480
Merge pull request #71 from sharelatex/bg-merge-state-and-resource-list-files
...
merge state and resource list files
2017-09-11 08:54:30 +01:00
Joe Green
41e442d403
Add jenkinsfile ( #72 )
...
* create Jenkinsfile
* allow textlive image to be set with env vars
* log error message in test
* use sandboxed compiles variables
* Add SANDBOXED_COMPILES_HOST_DIR var to test config
* add SIBLING_CONTAINER_USER env var
2017-09-08 14:06:04 +01:00
Brian Gough
0a242bac3c
rename saveProjectStateHash to saveProjectState
2017-09-08 13:56:40 +01:00
Brian Gough
66431fc2b8
log any missing files
2017-09-07 16:54:09 +01:00
Brian Gough
b8e8530a16
fix whitespace
2017-09-07 13:52:34 +01:00
Brian Gough
cbd3e32143
log error if state file is truncacted
2017-09-07 13:52:34 +01:00
Brian Gough
3d1c3a1d27
combine the resource state and resource list
...
to prevent them getting out of sync
2017-09-07 13:52:34 +01:00
Shane Kilkelly
5b33129138
Merge pull request #70 from sharelatex/sk-node-6
...
Upgrade to node 6.11
2017-08-31 13:35:27 +01:00
Shane Kilkelly
ae2af06f7b
Upgrade to node 6.9
2017-08-29 14:30:43 +01:00
Brian Gough
ea3ee82e74
added logging
2017-08-29 12:09:31 +01:00
James Allen
30dd9655bf
Merge pull request #69 from sharelatex/as-update-docker-runner-config
...
Update docker-runner-sharelatex config
2017-08-24 15:17:16 +02:00
Alasdair Smith
87935f30c5
Update docker-runner-sharelatex config
2017-08-24 13:34:24 +01:00
Brian Gough
43f424295e
Merge pull request #66 from sharelatex/bg-compile-from-redis
...
Write files incrementally
2017-08-23 15:35:56 +01:00
Brian Gough
26f85ba75f
read resource files safely
...
put a limit on the amount of data read
2017-08-18 11:17:01 +01:00
Brian Gough
a84c884fc9
splice state management into ResourceStateManager
2017-08-18 10:22:17 +01:00
Brian Gough
96b801b093
fix whitespace
2017-08-18 09:41:59 +01:00
Brian Gough
d614af2860
finish unit test for incremental update
2017-08-18 09:41:43 +01:00
Brian Gough
d3da4e1d3f
ResourceWriter unit tests (wip)
2017-08-17 16:59:37 +01:00