Eric Mc Sween
adfe7abaaf
Merge pull request #13255 from overleaf/em-socket-leak-detection
...
Reintroduce socket leak detection in all services
GitOrigin-RevId: 0a9a1ced0b886dbb267cb46beb5da7d0133d39aa
2023-05-31 08:05:24 +00:00
Eric Mc Sween
6077e73dd6
Merge pull request #13253 from overleaf/em-revert-leaked-socket-detection
...
Revert leaked socket detection
GitOrigin-RevId: 0f17864122a17fc69d0dac1ad5e2775805639871
2023-05-30 08:04:09 +00:00
Eric Mc Sween
c625fef364
Merge pull request #13214 from overleaf/bg-add-socket-leak-detection-to-all-services
...
add socket leak detection to all services
GitOrigin-RevId: 9481222258b796ca8c3b50cdd7ce60c05f0f9f61
2023-05-30 08:03:58 +00:00
Jakob Ackermann
5638f06b3a
Merge pull request #13055 from overleaf/jpa-monitor-sockets-everywhere
...
[metrics] collect HTTP socket stats for all the services
GitOrigin-RevId: 52872f4ca46d8cf351f7f4b4df90f9d6b05010b3
2023-05-23 08:05:03 +00:00
Jakob Ackermann
199ced5eef
Merge pull request #9231 from overleaf/jpa-clsi-lifespan-fix
...
[clsi] cycle VMs before their 24h limit with some jitter
GitOrigin-RevId: c08bea6765dc8b03db9f0792a8bb20084f595f59
2022-08-30 08:03:30 +00:00
Eric Mc Sween
bda307fbb5
Merge pull request #8267 from overleaf/em-decaf-clsi
...
Decaf cleanup some CLSI files
GitOrigin-RevId: afb4cd6e9eb9e95703efa955b93d4fedada10e3c
2022-06-07 08:02:18 +00:00
Eric Mc Sween
e0d91eaa26
Merge pull request #7906 from overleaf/em-downgrade-logs
...
Downgrade all INFO logs to DEBUG
GitOrigin-RevId: 05ed582ef0721fcada059f0ad158565f50feca27
2022-05-17 08:05:26 +00:00
Jakob Ackermann
b25ff076b8
Merge pull request #6962 from overleaf/jpa-clsi-tweak-health-check
...
[clsi] tweak health check
GitOrigin-RevId: 2caad90d55bb441c7008e3084b34d683b072dfbd
2022-03-03 09:03:19 +00:00
Jakob Ackermann
958216d578
Merge pull request #6926 from overleaf/jpa-clsi-bump-logger-metrics
...
[clsi] upgrade logger and metrics module
GitOrigin-RevId: 85c346b5eed683672a77d86d6a434dc313b7824b
2022-03-02 09:02:50 +00:00
Jakob Ackermann
9c9beef305
Merge pull request #5737 from overleaf/jpa-clsi-cleanup-in-memory
...
[clsi] separate clearing cache and clearing output cache
GitOrigin-RevId: 9cd903eaf8d291d4821ba8c9ac6c1a9f8d3d9632
2021-11-16 09:02:36 +00:00
Jakob Ackermann
94c208311c
Merge pull request #5351 from overleaf/jpa-clsi-drop-sqlite
...
[clsi] goodbye sqlite db
GitOrigin-RevId: e7f16920c44e74a425b92884b48a60272dfb015b
2021-10-07 08:03:50 +00:00
Jakob Ackermann
44d0a8d162
Merge pull request #4650 from overleaf/jpa-in-memory-last-access-time
...
[perf] store the last access time of a project in memory
GitOrigin-RevId: 16e2bee28f58eced18f4c3ec5571ea9d10805cbb
2021-10-07 08:03:21 +00:00
Jakob Ackermann
1dc9f428fa
Merge pull request #4890 from overleaf/jpa-clsi-maint
...
[clsi] put server into maintenance mode when reaching zero capacity
GitOrigin-RevId: d1af260a3bfba7852519b3bc369a6747e79f3b18
2021-08-27 08:03:39 +00:00
Jakob Ackermann
b5e1ceef17
Merge pull request #4865 from overleaf/jpa-ho-load-shed-mvp
...
[clsi] very basic mvp for shedding load
GitOrigin-RevId: 4b82934b395f8b9358e463c03cadda6a16c20b4f
2021-08-27 08:03:21 +00:00
Jakob Ackermann
f285e503b4
[misc] run format_fix and lint:fix
2021-07-13 12:04:48 +01:00
Jakob Ackermann
64551f0198
[misc] switch from settings-sharelatex to @overleaf/settings
2021-07-12 17:47:21 +01:00
Jakob Ackermann
b62b96cb1c
Revert "very basic mvp for shedding load"
2021-07-01 11:57:03 +01:00
Henry Oswald
8e2cd57cb9
very basic mvp for shedding load
...
When the box is over 100% capacity start to shed load.
Use 5 min load average to make the system less likely to start moving
projects off after a temporary cpu spike
2021-06-22 09:46:24 +01:00
Jakob Ackermann
1127bf640e
[misc] wait for refreshing of expiry timeout before triggering cleanup
2021-06-01 15:51:09 +01:00
Brian Gough
ff2175e727
add validation for express :content_id parameter
2021-05-13 15:48:17 +01:00
Jakob Ackermann
b456ea726d
[misc] merge pdf caching into main ( #226 )
...
* wip generate directory for hash content
* cleanup, remove console logging
* add content caching module
* Return PDF stream ranges with compile response
* Return the PDF file size in the compile response
* PDF range endpoint
* [misc] WIP: pdf caching: preserve the m-time on static content files
* [misc] WIP: pdf caching: improve browser caching, emit caching headers
* [misc] WIP: pdf caching: do not emit very small chunks <1kB
* [misc] keep up with moving output files into a separate directory
* [OutputCacheManager] add global feature flag for enabling pdf caching
* [misc] add contentId into the URL for protecting PDF stream contents
* [misc] support PDF stream caching for anonymous users
* [misc] add per-request feature flag for enabling PDF stream caching
* [misc] enable pdf caching in CI and emit metrics at the end of run
* [misc] expose compile stats and timings to the frontend
* [misc] log an error in case saving output files fails
* [misc] add metrics for pdf bandwidth and pdf caching performance
* [misc] add a dark mode to the pdf caching for computing ranges only
* [misc] move pdf caching metrics into ContentCacheMetrics
* [misc] add a config option for the min chunk size of pdf ranges
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
2021-05-13 14:07:54 +01:00
Henry Oswald
7cd36e139a
support post and get for getting status of clsi project
2021-03-16 10:24:59 +00:00
Brian Gough
f0b4f1238b
provide a /oops-internal endpoint for testing uncaughtExceptions
2021-01-26 16:35:39 +00:00
Brian Gough
fc11574698
add uncaughtException handler
2021-01-26 14:08:29 +00:00
Brian Gough
6fa081522d
add a warning for requests without build id
2021-01-22 11:05:52 +00:00
Brian Gough
692dbc8d6b
add output directory
2021-01-22 11:05:52 +00:00
Brian Gough
bdbfe70086
rename staticServer to staticCompileServer
2021-01-22 11:05:52 +00:00
Jakob Ackermann
7b7cd8cc8c
[misc] bump metrics module to 3.4.1
...
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:25 +00:00
Jakob Ackermann
1d1b9ebebc
[misc] bump the dev-env to 3.3.2
2020-08-10 17:01:11 +01:00
Brian Gough
0914908676
downgrade NotFoundError log-level
2020-06-15 11:06:54 +01:00
Brian Gough
f239fc3b5d
send 503 unavailable response on EPIPE
2020-06-11 11:12:02 +01:00
Brian Gough
aa44bae222
fix eslint errors
2020-06-02 09:51:34 +01:00
Jakob Ackermann
36e81cbe15
[misc] apply review feedback
2020-05-19 10:30:59 +01:00
Jakob Ackermann
2a3c2dd3d5
[misc] simplify the smoke test and process shutdown
2020-05-19 10:30:59 +01:00
Henry Oswald
3925839c7f
add refreshExpiryTimeout function
...
on clsi all data lives inside of / dir
dynamically reduce size of EXPIRY_TIMEOUT if disk starts to get full
2020-05-18 15:17:19 +01:00
Henry Oswald
adc73df53d
cleanup the shutdown code a bit
2020-04-23 11:32:33 +01:00
Henry Oswald
acbfc465dc
add variance into shutdown time to avoid stampeed
2020-04-14 13:36:11 +01:00
Henry Oswald
3e07af3f1b
limit clsi lifespan via health checks and PROCESS_LIFE_SPAN_LIMIT_MS
2020-03-20 13:37:58 +00:00
mserranom
a5c7051fc9
prettier: convert individual decaffeinated files to Prettier format
2020-02-19 12:16:18 +01:00
mserranom
d23250a4bb
decaffeinate: convert individual files to js
2020-02-19 12:16:17 +01:00
mserranom
66ce5847a3
decaffeinate: rename individual coffee files to js files
2020-02-19 12:16:15 +01:00