nate stemen
7f4bce262d
Merge pull request #88 from overleaf/dependabot-npm_and_yarn-lodash-4.17.21
...
Bump lodash from 4.17.20 to 4.17.21
2021-05-18 07:31:19 -04:00
nate stemen
29477a7f12
Merge pull request #87 from overleaf/dependabot-npm_and_yarn-underscore-1.13.1
...
Bump underscore from 1.9.2 to 1.13.1
2021-05-18 07:31:13 -04:00
Jakob Ackermann
31a29403a1
Merge pull request #237 from overleaf/jpa-fix-unit-tests
...
[misc] fix unit tests following the merge of atomic writes
2021-05-18 12:17:56 +02:00
Jakob Ackermann
567d02881d
[misc] fix unit tests following the merge of atomic writes
2021-05-18 11:09:30 +01:00
Jakob Ackermann
23dd93ae50
Merge pull request #236 from overleaf/jpa-skip-duplicate-writes
...
[ContentCacheManager] skip writing of duplicate streams
2021-05-18 11:44:23 +02:00
Jakob Ackermann
e787106eed
Merge pull request #235 from overleaf/jpa-atomic-writes
...
[ContentCacheManager] write streams to disk atomically
2021-05-18 11:44:16 +02:00
Jakob Ackermann
9b8763aed4
Merge pull request #234 from overleaf/jpa-stream-detection-across-chunks
...
[ContentCacheManager] add support for stream detection across chunks
2021-05-18 11:44:09 +02:00
Jakob Ackermann
74e45c60f4
Merge pull request #233 from overleaf/jpa-drop-sync-syscall
...
[perf] drop useless synchronous syscall on hot path for writing docs
2021-05-18 11:44:00 +02:00
Jakob Ackermann
8a3ec2bfda
Merge pull request #232 from overleaf/bg-upgrade-fs-extra
...
upgrade fs-extra
2021-05-18 11:43:50 +02:00
Jakob Ackermann
7cf019ab78
Merge pull request #231 from overleaf/bg-use-fse-copy
...
use fs.copyFile for performance
2021-05-18 11:43:43 +02:00
Jakob Ackermann
b254e4285b
Merge pull request #229 from overleaf/bg-log-expiry-timeout
...
log the expiry timeout value when disk space is low
2021-05-18 11:43:15 +02:00
Jakob Ackermann
59f18b667c
Merge pull request #228 from overleaf/bg-add-content-id-validation
...
add validation for express content routes
2021-05-18 11:43:08 +02:00
Jakob Ackermann
a93c2c3942
Merge pull request #224 from overleaf/bg-add-hash-benchmark-script
...
add hash benchmark script
2021-05-18 11:42:59 +02:00
Jakob Ackermann
bc1ed82c6c
[ContentCacheManager] skip writing of duplicate streams
2021-05-18 10:22:05 +01:00
nate stemen
0592a6be74
Merge pull request #65 from overleaf/dependabot-npm_and_yarn-hosted-git-info-2.8.9
...
build(deps): bump hosted-git-info from 2.8.5 to 2.8.9
2021-05-17 17:07:51 -04:00
nate stemen
ee62d864e5
Merge pull request #64 from overleaf/dependabot-npm_and_yarn-lodash-4.17.21
...
build(deps): bump lodash from 4.17.19 to 4.17.21
2021-05-17 17:07:44 -04:00
nate stemen
fcaaef09b8
Merge pull request #63 from overleaf/dependabot-npm_and_yarn-underscore-1.13.1
...
build(deps): bump underscore from 1.9.2 to 1.13.1
2021-05-17 17:07:37 -04:00
nate stemen
bc99218596
Merge pull request #61 from overleaf/jpa-explicit-dependencies
...
[misc] add linting for missing explicit dependencies and fix any errors
2021-05-17 17:07:30 -04:00
nate stemen
a019a3776d
Merge pull request #60 from overleaf/dependabot-npm_and_yarn-y18n-4.0.1
...
build(deps): bump y18n from 4.0.0 to 4.0.1
2021-05-17 17:07:22 -04:00
Jakob Ackermann
224ae0c254
[ContentCacheManager] add support for stream detection across chunks
...
Retain a small part (6 or 9 bytes) of each chunk in memory for providing
the next iteration with enough context for finding the start/end marker
of a range.
2021-05-17 17:36:05 +01:00
nate stemen
290c0d90c8
Merge pull request #44 from overleaf/dependabot-npm_and_yarn-hosted-git-info-2.8.9
...
Bump hosted-git-info from 2.8.8 to 2.8.9
2021-05-17 11:02:06 -04:00
nate stemen
1de6c67910
Merge pull request #43 from overleaf/dependabot-npm_and_yarn-lodash-4.17.21
...
Bump lodash from 4.17.20 to 4.17.21
2021-05-17 11:01:50 -04:00
nate stemen
b076823e7a
Merge pull request #42 from overleaf/dependabot-npm_and_yarn-underscore-1.13.1
...
Bump underscore from 1.9.2 to 1.13.1
2021-05-17 11:01:41 -04:00
nate stemen
c33d6e4188
Merge pull request #40 from overleaf/jpa-explicit-dependencies
...
[misc] add linting for missing explicit dependencies and fix any errors
2021-05-17 11:01:30 -04:00
nate stemen
8d76717ec1
Merge pull request #39 from overleaf/dependabot-npm_and_yarn-y18n-4.0.1
...
Bump y18n from 4.0.0 to 4.0.1
2021-05-17 11:01:04 -04:00
Jakob Ackermann
6b9c8bced6
[ContentCacheManager] write streams to disk atomically
...
Use an intermediate file for writing to disk, then rename to the target.
2021-05-17 14:22:37 +01:00
Brian Gough
8c80ddd27a
remove unnecessary console.log from hash benchmark
2021-05-17 14:14:00 +01:00
Brian Gough
939ad3af31
include UV_THREADPOOL_SIZE in benchmark logs
2021-05-17 14:14:00 +01:00
Brian Gough
cbeba4af00
run the hash benchmark 10 times
2021-05-17 14:14:00 +01:00
Brian Gough
7b6434ef81
add benchmark script for hashing
2021-05-17 14:14:00 +01:00
nate stemen
0b5b8f56cb
Merge pull request #73 from overleaf/dependabot-npm_and_yarn-hosted-git-info-2.8.9
...
Bump hosted-git-info from 2.8.8 to 2.8.9
2021-05-17 08:10:57 -04:00
nate stemen
a7c31132fe
Merge pull request #72 from overleaf/dependabot-npm_and_yarn-lodash-4.17.21
...
Bump lodash from 4.17.20 to 4.17.21
2021-05-17 08:10:50 -04:00
nate stemen
007141f545
Merge pull request #71 from overleaf/jpa-explicit-dependencies
...
[misc] add linting for missing explicit dependencies and fix any errors
2021-05-17 08:10:43 -04:00
nate stemen
d1c2dd6cf1
Merge pull request #70 from overleaf/dependabot-npm_and_yarn-y18n-4.0.1
...
Bump y18n from 4.0.0 to 4.0.1
2021-05-17 08:10:32 -04:00
nate stemen
227b9e9ed8
Merge pull request #66 from overleaf/dependabot-npm_and_yarn-ini-1.3.8
...
Bump ini from 1.3.5 to 1.3.8
2021-05-17 08:10:17 -04:00
nate stemen
9b234e5946
Merge pull request #65 from overleaf/dependabot-npm_and_yarn-dot-prop-4.2.1
...
Bump dot-prop from 4.2.0 to 4.2.1
2021-05-17 08:10:08 -04:00
Brian Gough
371de76a4a
use fs.copyFile instead of fse.copy in UrlCache module
2021-05-17 10:54:11 +01:00
Jakob Ackermann
dde645e770
Merge pull request #176 from overleaf/dependabot-npm_and_yarn-hosted-git-info-2.8.9
...
Bump hosted-git-info from 2.8.8 to 2.8.9
2021-05-17 10:57:18 +02:00
Jakob Ackermann
e92b9fc754
Merge pull request #174 from overleaf/jpa-explicit-dependencies
...
[misc] add linting for missing explicit dependencies and fix any errors
2021-05-17 10:57:12 +02:00
Jakob Ackermann
f97117a6ba
Merge pull request #175 from overleaf/jpa-double-down-doc-size-limit
...
[misc] double down on enforcing doc size limits
2021-05-17 10:56:55 +02:00
Jakob Ackermann
18e943742e
[perf] drop useless synchronous syscall on hot path for writing docs
2021-05-17 09:25:29 +01:00
Brian Gough
24ef5786a0
upgrade fs-extra
2021-05-14 15:58:11 +01:00
Brian Gough
44e0742aa3
use fse.copy for performance
...
it uses the native fs.copyFile method
2021-05-14 15:49:20 +01:00
Brian Gough
ff2175e727
add validation for express :content_id parameter
2021-05-13 15:48:17 +01:00
Brian Gough
013d38552a
log the expiry timeout value when disk is low
2021-05-13 15:13:29 +01:00
Brian Gough
3044bc4cf5
add transport to get-connected-users metric
2021-05-13 14:51:26 +01:00
Jakob Ackermann
b456ea726d
[misc] merge pdf caching into main ( #226 )
...
* wip generate directory for hash content
* cleanup, remove console logging
* add content caching module
* Return PDF stream ranges with compile response
* Return the PDF file size in the compile response
* PDF range endpoint
* [misc] WIP: pdf caching: preserve the m-time on static content files
* [misc] WIP: pdf caching: improve browser caching, emit caching headers
* [misc] WIP: pdf caching: do not emit very small chunks <1kB
* [misc] keep up with moving output files into a separate directory
* [OutputCacheManager] add global feature flag for enabling pdf caching
* [misc] add contentId into the URL for protecting PDF stream contents
* [misc] support PDF stream caching for anonymous users
* [misc] add per-request feature flag for enabling PDF stream caching
* [misc] enable pdf caching in CI and emit metrics at the end of run
* [misc] expose compile stats and timings to the frontend
* [misc] log an error in case saving output files fails
* [misc] add metrics for pdf bandwidth and pdf caching performance
* [misc] add a dark mode to the pdf caching for computing ranges only
* [misc] move pdf caching metrics into ContentCacheMetrics
* [misc] add a config option for the min chunk size of pdf ranges
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
2021-05-13 14:07:54 +01:00
Christopher Hoskin
753155db97
Merge pull request #94 from overleaf/csh-issue-3680-template-config
...
Generate a config file from env vars and template
2021-05-12 12:38:43 +01:00
Christopher Hoskin
725a9e0669
Use CMD as in other apps
2021-05-12 12:32:14 +01:00
Christopher Hoskin
0827795fc7
Consistently use GIT_BRIDGE
2021-05-12 08:42:45 +01:00