Jakob Ackermann
56a3b0dcde
Merge pull request #4819 from overleaf/jpa-pdf-caching-new-event-loop
...
[clsi] pdf-caching: move cpu intensive work onto a new event loop
GitOrigin-RevId: 4cb5cd4528fa1c5df6a8e91f9caa38cb64d94463
2021-08-25 08:03:38 +00:00
Brian Gough
262793c04f
add option for apparmor profile
2021-07-21 14:53:35 +01:00
Jakob Ackermann
f285e503b4
[misc] run format_fix and lint:fix
2021-07-13 12:04:48 +01:00
Jakob Ackermann
516525126b
[UrlFetcher] do not override domain for clsi-perf requests
2021-07-02 09:17:29 +01:00
Jakob Ackermann
b09e52510f
[misc] bail out from pdf caching processing after 10s or earlier
...
...for fast compiles.
2021-06-23 14:20:04 +01:00
Jakob Ackermann
b456ea726d
[misc] merge pdf caching into main ( #226 )
...
* wip generate directory for hash content
* cleanup, remove console logging
* add content caching module
* Return PDF stream ranges with compile response
* Return the PDF file size in the compile response
* PDF range endpoint
* [misc] WIP: pdf caching: preserve the m-time on static content files
* [misc] WIP: pdf caching: improve browser caching, emit caching headers
* [misc] WIP: pdf caching: do not emit very small chunks <1kB
* [misc] keep up with moving output files into a separate directory
* [OutputCacheManager] add global feature flag for enabling pdf caching
* [misc] add contentId into the URL for protecting PDF stream contents
* [misc] support PDF stream caching for anonymous users
* [misc] add per-request feature flag for enabling PDF stream caching
* [misc] enable pdf caching in CI and emit metrics at the end of run
* [misc] expose compile stats and timings to the frontend
* [misc] log an error in case saving output files fails
* [misc] add metrics for pdf bandwidth and pdf caching performance
* [misc] add a dark mode to the pdf caching for computing ranges only
* [misc] move pdf caching metrics into ContentCacheMetrics
* [misc] add a config option for the min chunk size of pdf ranges
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
2021-05-13 14:07:54 +01:00
Brian Gough
fc11574698
add uncaughtException handler
2021-01-26 14:08:29 +00:00
Brian Gough
692dbc8d6b
add output directory
2021-01-22 11:05:52 +00:00
Jakob Ackermann
aa02df7b81
[misc] apply review feedback
...
- move setting into clsi.docker namespace
- rename the variable for images to allowedImages / ALLOWED_IMAGES
- add an additional check for the image name into the DockerRunner
Co-Authored-By: Brian Gough <brian.gough@overleaf.com>
2020-06-30 12:01:21 +01:00
Jakob Ackermann
8846efe7ce
[misc] RequestParser: restrict imageName to an allow list and add tests
2020-06-26 13:28:09 +01:00
Brian Gough
85f4f348dd
add default settings to remove wordcount and synctex containers
2020-06-15 15:49:38 +01:00
Brian Gough
2ce03f0554
add initial compileGroup support
2020-06-15 15:28:53 +01:00
Brian Gough
69b7ecfd2e
Merge pull request #177 from overleaf/bg-add-docker-setting
...
add missing setting for optimiseInDocker
2020-06-12 09:28:31 +01:00
Brian Gough
6c98c7af4a
error on missing profile
2020-06-10 11:42:07 +01:00
Brian Gough
54d1cf7eeb
add missing setting for optimiseInDocker
2020-06-09 11:22:28 +01:00
Brian Gough
3d6b911295
add setting TEXLIVE_OPENOUT_ANY
2020-06-04 11:47:22 +01:00
Brian Gough
aa44bae222
fix eslint errors
2020-06-02 09:51:34 +01:00
Henry Oswald
e1c90ec234
Merge branch 'master' into bg-support-other-runtimes
...
port coffee changes to js
2020-04-23 13:59:05 +01:00
Henry Oswald
a5887fad50
Merge pull request #158 from overleaf/jpa-entry-point-cleanup
...
[misc] entry point cleanup
2020-04-23 13:52:04 +01:00
Henry Oswald
adc73df53d
cleanup the shutdown code a bit
2020-04-23 11:32:33 +01:00
Jakob Ackermann
3309adf2ad
[misc] move the sqlite database into a db/ directory
2020-04-03 12:36:31 +02:00
Henry Oswald
3e07af3f1b
limit clsi lifespan via health checks and PROCESS_LIFE_SPAN_LIMIT_MS
2020-03-20 13:37:58 +00:00
mserranom
a5c7051fc9
prettier: convert individual decaffeinated files to Prettier format
2020-02-19 12:16:18 +01:00
mserranom
d23250a4bb
decaffeinate: convert individual files to js
2020-02-19 12:16:17 +01:00
mserranom
66ce5847a3
decaffeinate: rename individual coffee files to js files
2020-02-19 12:16:15 +01:00
Brian Gough
659cd44377
support other runtimes
2020-02-10 16:10:18 +00:00
Henry Oswald
00cc5f05e5
pull clsi compile size limit into setting and bump to 7mb
2019-01-08 12:56:16 +00:00
Christopher Hoskin
2dd1738781
Merge branch 'ho-dockerise' into csh-sentry
2018-08-15 09:44:02 +01:00
Henry Oswald
3dfc03fb0a
put FILESTORE_PARALLEL_FILE_DOWNLOADS and
...
FILESTORE_PARALLEL_SQL_QUERY_LIMIT into env vars
2018-08-14 15:17:56 +01:00
Christopher Hoskin
1aee865532
Revert "Put a guard on sentry dsn"
...
This reverts commit 95e052d05910680aeeca2521b65b089122c4e249.
2018-08-13 17:36:53 +01:00
Christopher Hoskin
f878ba0f20
Put a guard on sentry dsn
2018-08-13 12:27:13 +01:00
Christopher Hoskin
2aac47256f
Read sentry dsn from env
2018-08-03 15:33:53 +01:00
Henry Oswald
ac4d07352f
make Settings.parallelSqlQueryLimit a config setting
2018-07-31 14:38:24 +01:00
Henry Oswald
1ef8ea328c
remove password from clsi for sql
...
sequalise fails when it is set to null
2018-07-30 14:04:33 +01:00
Henry Oswald
3b06835499
bump retried and package versions
2018-07-30 11:25:28 +01:00
Henry Oswald
4ec8a423cb
added texliveImageNameOveride
2018-07-13 10:37:22 +01:00
Henry Oswald
eb89ca1d3b
added filestoreDomainOveride
2018-07-03 16:41:34 +01:00
Henry Oswald
2384eb83d9
add load balance http endpoints to shut box down
2018-06-28 16:04:34 +01:00
Henry Oswald
c33c9f8fc7
fix seccomp key
2018-06-26 15:38:30 +01:00
Henry Oswald
5c3c39c743
add error catch to settings.defaults
2018-06-26 15:04:56 +01:00
Henry Oswald
3640326a26
put seccomp_profile_path into variable and try catch
2018-06-26 14:44:03 +01:00
Henry Oswald
c4e8d76427
added seccomp
2018-06-26 12:43:47 +01:00
henry oswald
1101763f50
all but the sync tests should pass
2018-05-25 12:43:12 +00:00
Henry Oswald
c3ae6b5d23
log settings on startup
2018-05-25 12:01:16 +01:00
Henry Oswald
41e39458d1
add smoke test env var
2018-03-20 13:48:12 +00:00
Henry Oswald
8dce1e2958
wip for ci
2018-03-14 15:44:58 +00:00
Henry Oswald
9a519f0d3d
added docker runner into core codebase
...
supports both local command runner and docker runner
added docker files for tex live
also fixed tests so they exit correctly & removed debug lines
2018-03-14 15:44:49 +00:00
Henry Oswald
d97ccc6e07
Merge branch 'master' into ho-dockerise
2018-03-02 18:18:18 +00:00
Henry Oswald
f39d14bf1b
unit tests pass, acceptence fail
...
uncomment tests
2018-03-02 17:34:41 +00:00
Henry Oswald
3399f55153
wip, docker container is correctly created
2018-03-02 17:14:23 +00:00
