github/overleaf
1
0
Fork 0
mirror of https://github.com/overleaf/overleaf.git synced 2024-11-21 20:47:08 -05:00
Code Issues Projects Releases Packages Wiki Activity
23637 commits 3 branches 7 tags 206 MiB
Commit graph

725 commits

Author SHA1 Message Date
Jakob Ackermann
9cf1373777 Merge pull request #11769 from overleaf/jpa-s3-config 
[server-ce] add support for s3 backend in filestore

GitOrigin-RevId: 20998547326e75acf22562d2964db78ae261b6bf
 2023-02-10 09:12:23 +00:00
Eric Mc Sween
74eeec2ba3 Merge pull request #11680 from overleaf/em-mongo-pool-monitoring 
Mongo connection pool monitoring

GitOrigin-RevId: 050e50e7e67061ccbf39a710ca4532eafd423365
 2023-02-09 14:34:35 +00:00
Eric Mc Sween
5683cebf71 Merge pull request #11679 from overleaf/em-upgrade-prom-client 
Upgrade prom-client library in metrics

GitOrigin-RevId: 4ff60d94b17e7f236d4b40103365ed6fe1515148
 2023-02-09 14:34:28 +00:00
Eric Mc Sween
283ce29847 Merge pull request #11651 from overleaf/em-remove-metrics-mongodb 
Remove the metrics.mongodb module

GitOrigin-RevId: 1c4a4dcd510f3f74677830f9c0b1ed1ba6e7a63c
 2023-02-07 09:04:25 +00:00
Jakob Ackermann
01aebbf69d Merge pull request #11559 from overleaf/jpa-access-token-encryptor-remove-v1 
[access-token-encryptor] drop support for legacy v1 token scheme

GitOrigin-RevId: 2d32453ad38119fa45cfd77463091f2c91dfe647
 2023-02-02 18:22:42 +00:00
Jakob Ackermann
246d62b578 Merge pull request #11582 from overleaf/jpa-count-tokens-empty-result 
[access-token-encryptor] nicer log message for zero access token found

GitOrigin-RevId: 2a28fdc71a1e063f091f55bc247d9dd26bbd0ee3
 2023-02-02 09:03:02 +00:00
Jessica Lawshe
af818e9859 Merge pull request #11546 from overleaf/em-fix-github-deps 
Use GitHub style deps in package.json

GitOrigin-RevId: 9b8ef56d7b2684a5a3c7af29090215deeee4d441
 2023-02-01 09:05:19 +00:00
Jakob Ackermann
9e6a767c96 Merge pull request #11544 from overleaf/jpa-re-encrypt-access-tokens 
[misc] add scripts for rotating all the encrypted access-tokens

GitOrigin-RevId: ce3374bb5d318a7f16a416ac1719a819c1160fb4
 2023-02-01 09:03:56 +00:00
Eric Mc Sween
4325f1d947 Merge pull request #11179 from overleaf/em-upgrade-gcs-lib 
Upgrade @google-cloud/storage library to 6.9.0

GitOrigin-RevId: 0e80dcccca4679ffe28d5b16512a691e58694e2b
 2023-01-18 09:05:00 +00:00
Eric Mc Sween
d01e83b453 Merge pull request #11170 from overleaf/em-upgrade-mocha 
Upgrade mocha to 10.2.0

GitOrigin-RevId: e49606c73e813904d9b794792a838a951a814585
 2023-01-17 09:06:28 +00:00
Alf Eaton
ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 
GitOrigin-RevId: ef2ef77e26df59d1af3df6dc664e284d3c70102d
 2023-01-16 08:41:42 +00:00
Alf Eaton
aa548b3889 Ensure packages from libraries are processed with babel-loader (#10703) 
* Allow webpack to resolve symlinks
* Rename library files to .cjs

GitOrigin-RevId: 0eab18604132104b1c5c92a5e6ed21713006a5a8
 2023-01-06 09:03:41 +00:00
Eric Mc Sween
0a12c47b35 Merge pull request #10815 from overleaf/em-esm-chat 
Move chat service to ES modules

GitOrigin-RevId: c08ae8328b8f3b539e6cfe052834b84bb3756330
 2022-12-14 09:03:03 +00:00
Eric Mc Sween
be081856a8 Merge pull request #10261 from overleaf/em-object-persistor-md5 
Compute the md5 hash as we receive the stream

GitOrigin-RevId: 6c0c0a31165c5e1320e7f7a6dbf59a0d3576d3c4
 2022-11-11 09:03:42 +00:00
Eric Mc Sween
3ee794da47 Merge pull request #10259 from overleaf/em-object-persistor-tempfile 
Atomic update of files in FS backend of object-persistor

GitOrigin-RevId: b57c0c1a7d6299affd00e174cb7ae75ae711c5d3
 2022-11-11 09:03:35 +00:00
Eric Mc Sween
a98f752b99 Merge pull request #10249 from overleaf/em-object-persistor-subdirs 
Add useSubdirectories option to object-persistor FS backend

GitOrigin-RevId: dc4f0a57e892ffa5be0c88b8baf7efce683ddfc1
 2022-11-11 09:03:27 +00:00
Eric Mc Sween
8fb3edbecd Merge pull request #10245 from overleaf/em-object-persistor-promises-api 
Use Node 16 promises APIs in object-persistor

GitOrigin-RevId: 8520da0c0678c17b22a9164d15d61c2b57af8f4e
 2022-11-11 09:03:19 +00:00
Mathias Jakobsen
50b346b4ed Merge pull request #10279 from overleaf/jpa-tracing-optimizations 
[misc] do not load the tracing module unless enabled

GitOrigin-RevId: 8a3b9da3e9451e3060b852dd44e078c99cf43cfa
 2022-11-04 09:05:00 +00:00
Simon Detheridge
3d9c8f80f4 Merge pull request #10227 from overleaf/spd-td-opentelementry 
Add opentelemetry to dev environment

GitOrigin-RevId: 31a8234197337a264412b411429692525793c8b0
 2022-11-01 09:04:53 +00:00
Brian Gough
e0955c26a5 Merge pull request #10194 from overleaf/bg-clean-up-library-versions 
replace monorepo library versions by "*"

GitOrigin-RevId: 4e28d0079803025db01ae58c1f0f3a9c99c9cafc
 2022-10-28 08:04:58 +00:00
ilkin-overleaf
c94043e2fe Merge pull request #10144 from overleaf/ii-metrics-api-patch-opts-arg 
Handle opts value in Metrics API

GitOrigin-RevId: dae0de02f513bf65beb7b665259424a07490dc41
 2022-10-28 08:04:43 +00:00
Miguel Serrano
4e393bbe8c Merge pull request #9841 from overleaf/em-track-changes-timestamps 
Do not update timestamp when deleting part of tracked insertions

GitOrigin-RevId: 5833ed973b6be128cfd2a3b03c44e1d88eccad42
 2022-10-06 08:04:35 +00:00
Miguel Serrano
ddb907187e Merge pull request #9868 from overleaf/msm-copybara-ranges-tracker 
Add `libraries/ranges-tracker` to copybara sync

GitOrigin-RevId: 0734887c02e27c4c51f4b3ebe11e0a177b5fd0af
 2022-10-05 14:07:44 +00:00
Brian Gough
51806703b7 Merge pull request #9819 from overleaf/bg-node-upgrade 
upgrade from node 16.16.0 to 16.17.1

GitOrigin-RevId: e1db74d950ce452303212c66ce3fe06fbd1dfe59
 2022-10-04 08:02:41 +00:00
Jakob Ackermann
ee70dc4a19 Merge pull request #9625 from overleaf/jpa-logging-no-stack 
[o-error] fallback from err.stack to err.message then '(no stack)'

GitOrigin-RevId: 2b5e8af5791d92e618336a201f8c66ba23c8d46d
 2022-09-16 08:03:56 +00:00
Jakob Ackermann
010476a60f Merge pull request #9611 from overleaf/jpa-step-up-logging 
[misc] step up logging (for github-sync)

GitOrigin-RevId: 9e7481d92e51f4f986f50a018a602c53aca78500
 2022-09-15 08:04:34 +00:00
Brian Gough
e7531eb047 Merge pull request #8871 from overleaf/briangough-issue8868 
Upgrade node to v16.16.0

GitOrigin-RevId: 6bc6d63aa4af1940649f1eb5966f182250ecac22
 2022-07-18 08:04:37 +00:00
June Kelly
a450a74351 Upgrade async package to 3.2.2 (#8447) 
* Revert "Revert "Bump async to 3.2.2 (#7618)""

This reverts commit 75153a555211d654744c2e61e27fe21085826c22.

* [web] fix usage of async.queue.drain in script

* [clsi] fix usage of async.queue.drain

* [spelling] fix usage of async.queue.drain

* [redis-wrapper] fix usage of async.queue.drain

* [web] Test that LockManager queue is cleared

This protects against a regression found when upgrading the
async package. Here we test that the `queue.drain` callback
is really getting called, and the lock is being removed from
the LOCK_QUEUES map.

* [redis-wrapper] Upgrade async to 3.2.2

GitOrigin-RevId: df921e6d7f1d505bd467f22e58600ba1aff48869
 2022-06-22 08:03:35 +00:00
Brian Gough
b6ab0792a9 Merge pull request #8401 from overleaf/bg-use-redis-locker-in-web 
extract web LockManager implementation into redis-wrapper

GitOrigin-RevId: 60144d1b1136bab90475cb4b4a6597e1b3f6af22
 2022-06-17 08:03:00 +00:00
Jakob Ackermann
cd11db456d Merge pull request #7835 from overleaf/jpa-redis-locker-package 
[misc] extract document-updaters LockManager into redis-wrapper package

GitOrigin-RevId: 5775ab9df7afb614dfc5f502df526c8735f84a91
 2022-05-19 08:02:57 +00:00
Jakob Ackermann
f0bd6dda23 Merge pull request #7986 from overleaf/jpa-eslint-8 
[misc] upgrade eslint packages to the latest version everywhere

GitOrigin-RevId: f1480d4a171acef82fb26c4aa54be3a6088b0ab3
 2022-05-17 08:05:59 +00:00
Jakob Ackermann
81b935e317 Merge pull request #7977 from overleaf/jpa-use-local-libraries 
[misc] use local libraries

GitOrigin-RevId: ec16907c0ce4f9a79689c522f37d52502559e7b2
 2022-05-17 08:05:52 +00:00
Eric Mc Sween
f0a3eeeb32 Merge pull request #7968 from overleaf/em-remove-logger-log 
Remove logger.log in favour of logger.info

GitOrigin-RevId: e305ae8adf19ecf144cee123b6837f35d5d45bed
 2022-05-17 08:05:39 +00:00
Eric Mc Sween
86dabdd73c Merge pull request #7907 from overleaf/em-lower-log-level 
Lower the default log level in production to INFO

GitOrigin-RevId: 0b7af54809674704535ffff65ebc366c2fa41214
 2022-05-17 08:05:33 +00:00
Eric Mc Sween
e0d91eaa26 Merge pull request #7906 from overleaf/em-downgrade-logs 
Downgrade all INFO logs to DEBUG

GitOrigin-RevId: 05ed582ef0721fcada059f0ad158565f50feca27
 2022-05-17 08:05:26 +00:00
Eric Mc Sween
efcb06f0df Merge pull request #7905 from overleaf/em-request-logging 
Make request logging configurable

GitOrigin-RevId: 15281664bc32f5cdafa1b99d9a755d2bf8671a08
 2022-05-17 08:05:19 +00:00
Eric Mc Sween
b4e6b7215b Merge pull request #7339 from overleaf/em-sentry-info 
Send OError info to Sentry

GitOrigin-RevId: b89f2d86cf8b14d65cc38266b042bc72a4bb1922
 2022-04-08 08:04:04 +00:00
Eric Mc Sween
3235119302 Merge pull request #7228 from overleaf/em-node-16 
Upgrade to Node 16

GitOrigin-RevId: 3db1ae57ffb02f8a2b9012ffbb3efecfc01d2b04
 2022-04-05 12:20:52 +00:00
Miguel Serrano
7e41fbf81b Merge pull request #7102 from overleaf/msm-check-entry-point-dir-settings 
[settings] add check for `process.argv[1]`

GitOrigin-RevId: 24e9e02dc840e9c4206d36b814150b092247d5d9
 2022-03-24 14:59:01 +00:00
Miguel Serrano
092ad3c599 [object-persistor] use forked fast-crc32c dependency (#6945) 
* [object-persistor] use forked fast-crc32c dependency
* removed amd64 compatibility from history_v1, filestore and docstore

GitOrigin-RevId: 7f1d9242c247f75cbdfde30a87ca25778e825cc1
 2022-03-11 09:03:16 +00:00
Miguel Serrano
e9a4ae027d Merge pull request #6928 from overleaf/msm-fix-config-lookup-ce 
[settings] use entry point file to locate config

GitOrigin-RevId: 7e860233619a8c51929ca9d363e0a82454cd0c2a
 2022-03-03 09:03:12 +00:00
Jakob Ackermann
264b107e39 Merge pull request #6927 from overleaf/jpa-split-clsi-metrics 
[misc] split clsi metrics into multiple categories

GitOrigin-RevId: 964ab57b344b92383a2937beff50139bae273a0e
 2022-03-02 09:02:52 +00:00
Jakob Ackermann
958216d578 Merge pull request #6926 from overleaf/jpa-clsi-bump-logger-metrics 
[clsi] upgrade logger and metrics module

GitOrigin-RevId: 85c346b5eed683672a77d86d6a434dc313b7824b
 2022-03-02 09:02:50 +00:00
Eric Mc Sween
9fa6b5e28b Merge pull request #6533 from overleaf/jpa-fix-debug-restore 
[logger] fix restoring to non-debug log level

GitOrigin-RevId: 3e38eae00f7245c4dbd8ce996ade7071f92e7c14
 2022-02-17 09:03:41 +00:00
Eric Mc Sween
3864b5831e Merge pull request #6215 from overleaf/ae-logger-req-params 
[logger] Handle undefined req.params

GitOrigin-RevId: cd435d906517034f78fdccc051625cbb537617d4
 2022-02-17 09:03:29 +00:00
Jakob Ackermann
ae0c347f27 Merge pull request #6542 from overleaf/jpa-em-code-sharing-workspaces 
[misc] npm workspaces

GitOrigin-RevId: 87aa72db6637fb238d7cd35b0a48ac3ed58ab3eb
 2022-02-16 11:31:07 +00:00
Jakob Ackermann
2ed696b3e0 Merge pull request #6517 from overleaf/jpa-node-fetch-2-6-7 
[misc] upgrade node-fetch from 2.6.x to 2.6.7

GitOrigin-RevId: 5a43e82e23d78fd6e68a38655dab4665a401a9db
 2022-02-01 09:03:24 +00:00
Jakob Ackermann
8789296f5a Merge pull request #6481 from overleaf/jpa-node-14-18-3 
[misc] upgrade node version from 14.18.1 to 14.18.3

GitOrigin-RevId: 976542fcc0271e323695c59a987dcf1614ee633e
 2022-01-28 09:03:53 +00:00
Jakob Ackermann
409d8cd1a8 Merge pull request #6470 from overleaf/jpa-o-error-3-4 
[misc] upgrade o-error to v3.4.0 in all the places

GitOrigin-RevId: 7b7ce1211cbe5e41754ca2ae112d237befdcf40e
 2022-01-28 09:03:45 +00:00
Jakob Ackermann
b3d4bd397f Merge pull request #6250 from overleaf/jpa-o-error-drop-poly-filling 
[o-error] drop poly filling

GitOrigin-RevId: 81bad387b374ce94597d9a34f1dcb0af21c98ad6
 2022-01-25 09:03:46 +00:00
Eric Mc Sween
f3f0be5c56 Merge pull request #6211 from overleaf/em-code-sharing 
Change directory layout in service containers

GitOrigin-RevId: 09ff19db2a123cbf7691d51e9ce9be6eee264287
 2022-01-07 09:03:22 +00:00
Jakob Ackermann
729cbf3fce Merge pull request #6224 from overleaf/jpa-cache-install-deps 
[misc] add docker image caching for install_deps, pre-fetch node image

GitOrigin-RevId: b52e52351c62b780538e0668b99fc1c28723addc
 2022-01-06 09:03:07 +00:00
Jakob Ackermann
4de9c98d2f Merge pull request #6132 from overleaf/jpa-settings-linting 
[settings] setup linting and fix all the violations

GitOrigin-RevId: 321ecf0e8749a0481d61ad720baffe06089dc5cf
 2021-12-17 09:03:15 +00:00
Jakob Ackermann
4b308553be Merge pull request #6120 from overleaf/jpa-same-linting-packages 
[misc] move the linting setup to the root of the monorepo

GitOrigin-RevId: 1633e2a58598add0b727738cd3bfba0ab7bae781
 2021-12-17 09:03:06 +00:00
Jakob Ackermann
2261e761f4 Merge pull request #5705 from overleaf/jpa-node-14 
[misc] upgrade node version from 12 to 14

GitOrigin-RevId: 15c465c7bb5e42b0c71e2dedb09cf4fe9f1d8ec6
 2021-11-19 09:02:56 +00:00
Eric Mc Sween
7d8c1397be Merge pull request #5691 from overleaf/em-logger 
More GCP logging improvements

GitOrigin-RevId: 6049567c5d713582551b58169c019596fc68493e
 2021-11-10 09:02:46 +00:00
Jakob Ackermann
8945373715 Merge pull request #5724 from overleaf/jpa-lean-docker-build 
[build_scripts] library: add a dockerignore file

GitOrigin-RevId: 229029f74024a9ca77c11fac53740d2d6ebd02ca
 2021-11-09 09:04:02 +00:00
Brian Gough
81af3e53e8 Merge pull request #5607 from overleaf/bg-increase-redis-wrapper-version-for-pr5246 
[redis-wrapper] publish redis-wrapper v2.1.0

GitOrigin-RevId: fe6c6f73b35c0a09f6bdb94d5bf32b3f2f9d968b
 2021-10-29 08:04:28 +00:00
Brian Gough
d9d65ac31c Merge pull request #5246 from overleaf/bg-upgrade-logger-in-all-libraries 
upgrade logger in libraries

GitOrigin-RevId: 5968f5abc5f77061cd90b5ebbccf86349619c4a7
 2021-10-29 08:03:14 +00:00
Eric Mc Sween
c5778fdd05 Merge pull request #5488 from overleaf/em-refactor-logger 
Refactor logger module to separate concerns

GitOrigin-RevId: cf9b1e367d881fb9036b2cb0f5c0529763a44695
 2021-10-28 08:04:00 +00:00
Jakob Ackermann
4b996c53d3 Merge pull request #5574 from overleaf/jpa-bulk-lint-format 
[misc] set up bulk lint/format in dev-env

GitOrigin-RevId: 6f7939c4c732bca72c9b658491e2c4c851c82b44
 2021-10-28 08:03:47 +00:00
Brian Gough
43c381e4d5 Merge pull request #5552 from overleaf/bg-node-upgrade-other 
upgrade node to v12.22.7 (other services)

GitOrigin-RevId: 889cf9a77173119fec8f200eeef9ddeefca0720b
 2021-10-26 08:03:13 +00:00
Alf Eaton
7f7e5ed749 Mock requests for invalid PDF URLs (#5429) 
GitOrigin-RevId: 35a492abb3c8ee1232672efb0d3f0fb4c643a63a
 2021-10-13 08:02:57 +00:00
Brian Gough
d630d4a37c Merge pull request #5258 from overleaf/revert-5214-bg-migrate-node-uuid-to-uuid 
Revert "migrate node-uuid to uuid"

GitOrigin-RevId: f512eb1040e2ce6d87774de9c1fc884594480cef
 2021-09-28 08:04:11 +00:00
Brian Gough
e0cb3c1107 Merge pull request #5228 from overleaf/bg-add-missing-test-file 
[latex-log-parser] add missing test file

GitOrigin-RevId: a3b5acc92182da1826ba20be1c8d52c7e54b676f
 2021-09-27 08:03:17 +00:00
Brian Gough
4c04448d1c Merge pull request #5226 from overleaf/bg-migrate-node-uuid-to-uuid 
[object-persistor] fix formatting

GitOrigin-RevId: 3ce374b6ec7291658de347d82b98a3678ba57dd2
 2021-09-27 08:03:01 +00:00
Brian Gough
9ee1e29286 Merge pull request #5214 from overleaf/bg-migrate-node-uuid-to-uuid 
migrate node-uuid to uuid

GitOrigin-RevId: 742fd4d3f039c6a026b3d35c3b0a7d54c00ca183
 2021-09-27 08:02:54 +00:00
Brian Gough
926106074d Merge pull request #5212 from overleaf/bg-republish-logger 
[logger] republish logger-sharelatex as @overleaf/logger

GitOrigin-RevId: 98b57dcac1a90bd79a15e6807cc47239e52a75e1
 2021-09-27 08:02:50 +00:00
Brian Gough
f8d65a2004 Merge pull request #4937 from overleaf/bg-accept-spaces-in-log-filenames 
handle filenames with spaces in latex error log

GitOrigin-RevId: 7ab548eed3c84e7760715512770c0b7782494200
 2021-09-24 08:02:51 +00:00
Brian Gough
08e0dcb85f Merge pull request #5181 from overleaf/bg-upgrade-sentry-package-version 
Migrate from raven to @sentry/node

GitOrigin-RevId: 1a82225b5204a9c507b566efff3c090b124e2392
 2021-09-23 08:03:19 +00:00
Brian Gough
cc1b73336a Merge pull request #4944 from overleaf/bg-use-file-line-errors 
use file line errors in log output

GitOrigin-RevId: 6732b19552fe15431a70fbefbc572253c389c64e
 2021-09-22 08:03:25 +00:00
Brian Gough
7ef6864204 Merge pull request #5066 from overleaf/bg-upgrade-access-token-encryptor 
[access-token-encryptor] update package-lock.json

GitOrigin-RevId: 343061cfe70d9815a92928296c07934f4944a383
 2021-09-13 08:03:21 +00:00
Brian Gough
fa2567aa61 Merge pull request #4980 from overleaf/bg-upgrade-metrics-dependencies 
upgrade metrics dependencies

GitOrigin-RevId: 3fda4017ac4d5e1ab1e196051d557c10253924b7
 2021-09-07 16:26:06 +00:00
Brian Gough
e8b37b2e7d Merge pull request #4946 from overleaf/bg-update-logger 
[logger] update logger with security fixes

GitOrigin-RevId: b111393f9a1b0bf8b8241503e2aed841bb672e1b
 2021-09-07 08:03:02 +00:00
Brian Gough
88a69257dc Merge pull request #4940 from overleaf/bg-add-prettier-and-eslint-to-latex-log-parser 
add prettier and eslint to latex log parser

GitOrigin-RevId: 6985fb253c0e4935fae0bbae34823ab058dfb34c
 2021-09-07 08:02:51 +00:00
Brian Gough
bea00ba3f0 Merge pull request #4723 from overleaf/dependabot-npm_and_yarn-libraries-logger-y18n-4.0.3 
Bump y18n from 4.0.0 to 4.0.3 in /libraries/logger

GitOrigin-RevId: a153883f570fb1d50c84dd4668a0740c8bc47f84
 2021-09-03 08:03:13 +00:00
Brian Gough
1d9badb92a Merge pull request #4724 from overleaf/dependabot-npm_and_yarn-libraries-logger-hosted-git-info-2.8.9 
Bump hosted-git-info from 2.8.8 to 2.8.9 in /libraries/logger

GitOrigin-RevId: 3243e2e469911cb7545f9630d226f1ddb4f1aa81
 2021-09-03 08:03:09 +00:00
Brian Gough
864fdb9ed8 Merge pull request #4722 from overleaf/dependabot-npm_and_yarn-libraries-logger-glob-parent-5.1.2 
Bump glob-parent from 5.1.1 to 5.1.2 in /libraries/logger

GitOrigin-RevId: 8d94d68409faeefba56001f17016c4d376c4c275
 2021-09-03 08:03:06 +00:00
Brian Gough
f1aa7243ce Merge pull request #4721 from overleaf/dependabot-npm_and_yarn-libraries-logger-path-parse-1.0.7 
Bump path-parse from 1.0.6 to 1.0.7 in /libraries/logger

GitOrigin-RevId: 4b9a6f08ebbed697ff927a9104bcbbae322c983c
 2021-09-03 08:03:02 +00:00
Brian Gough
fdaa0744dd Merge pull request #4725 from overleaf/dependabot-npm_and_yarn-libraries-logger-lodash-4.17.21 
Bump lodash from 4.17.19 to 4.17.21 in /libraries/logger

GitOrigin-RevId: abab39757185c894857a4b79cf751360ebd238ef
 2021-09-03 08:02:59 +00:00
Brian Gough
d4563c8786 Merge pull request #4866 from overleaf/bg-gcs-delete-directory-batch 
make object-persistor delete gcs files in batches

GitOrigin-RevId: 8ebc892c5f6eb30507ec41d5d3a108e650af5cac
 2021-08-27 08:03:25 +00:00
Hugh O'Brien
19bb96bb20 Merge pull request #4854 from overleaf/hb-decaf-log-parsers 
Decaf log parsers

GitOrigin-RevId: 71c44b8ac86f7fd980b0547a4c5d49651a31d977
 2021-08-25 08:04:06 +00:00
Jakob Ackermann
5679ba894b Merge pull request #4800 from overleaf/jpa-object-persistor-fix-404-handling 
[object-persistor] handle 404s of the entire delete operation in gcs

GitOrigin-RevId: 41c5e70af069361a21adb53a6166081741666887
 2021-08-19 08:02:43 +00:00
Jakob Ackermann
1bf89f7dd1 Merge pull request #4766 from overleaf/dependabot-npm_and_yarn-libraries-access-token-encryptor-lodash-4.17.21 
Bump lodash from 4.17.15 to 4.17.21 in /libraries/access-token-encryptor

GitOrigin-RevId: 8c97a49c660629d5ec8335c145240cc2418fc218
 2021-08-17 08:03:20 +00:00
Jakob Ackermann
0ecd6f34ff Merge pull request #4742 from overleaf/jpa-modernize-access-token-encryptor 
[misc] modernize access token encryptor

GitOrigin-RevId: 178fe2ee2f97f2b3816e480b6283fdb127eb72d6
 2021-08-17 08:03:17 +00:00
Jakob Ackermann
3ace29999b Merge pull request #4703 from overleaf/jpa-import-latex-log-parser 
[misc] import latex log parser

GitOrigin-RevId: 2f02af8a58c130f97de51b952456b7a9615d4ed6
 2021-08-13 12:58:28 +00:00
Jakob Ackermann
6a0388ff9b Merge pull request #4689 from overleaf/jpa-libraries-ci 
[misc] setup cloud build trigger for libraries

GitOrigin-RevId: a66dd3e96cb1c06d4803a2162278959357694048
 2021-08-13 12:56:39 +00:00
Eric Mc Sween
94117ea836 Merge pull request #4644 from overleaf/em-gitignore 
Add node_modules to libraries/settings gitignore

GitOrigin-RevId: a6e5bc50ecb6dece03319e16c6c7c3d2318a7d74
 2021-08-05 13:48:20 +00:00
Jakob Ackermann
dea32cc656
merge multiple repositories into an existing monorepo 
- merged using: 'monorepo_add.sh libraries-settings:libraries/settings'
- see https://github.com/shopsys/monorepo-tools
 2021-08-05 08:34:51 +01:00
Jakob Ackermann
e7fc1ffeb8
merge multiple repositories into an existing monorepo 
- merged using: 'monorepo_add.sh libraries-redis-wrapper:libraries/redis-wrapper'
- see https://github.com/shopsys/monorepo-tools
 2021-08-05 08:34:48 +01:00
Jakob Ackermann
30b7bceb60
merge multiple repositories into an existing monorepo 
- merged using: 'monorepo_add.sh libraries-object-persistor:libraries/object-persistor'
- see https://github.com/shopsys/monorepo-tools
 2021-08-05 08:34:44 +01:00
Jakob Ackermann
e2f74274c0
merge multiple repositories into an existing monorepo 
- merged using: 'monorepo_add.sh libraries-o-error:libraries/o-error'
- see https://github.com/shopsys/monorepo-tools
 2021-08-05 08:34:41 +01:00
Jakob Ackermann
02010d9f6e
merge multiple repositories into an existing monorepo 
- merged using: 'monorepo_add.sh libraries-metrics:libraries/metrics'
- see https://github.com/shopsys/monorepo-tools
 2021-08-05 08:34:37 +01:00
Jakob Ackermann
c72c6f5747
merge multiple repositories into an existing monorepo 
- merged using: 'monorepo_add.sh libraries-logger:libraries/logger'
- see https://github.com/shopsys/monorepo-tools
 2021-08-05 08:34:31 +01:00
Jakob Ackermann
cd9877d7d7 [misc] prepare for monorepo 
- add git ignore entries
- create package-lock.json
 2021-07-29 10:52:53 +01:00
dependabot[bot]
1be89b071b Bump y18n from 4.0.0 to 4.0.3 
Bumps [y18n](https://github.com/yargs/y18n) from 4.0.0 to 4.0.3.
- [Release notes](https://github.com/yargs/y18n/releases)
- [Changelog](https://github.com/yargs/y18n/blob/y18n-v4.0.3/CHANGELOG.md)
- [Commits](https://github.com/yargs/y18n/compare/v4.0.0...y18n-v4.0.3)

---
updated-dependencies:
- dependency-name: y18n
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-07-28 08:38:11 +00:00
Jakob Ackermann
a383dc316c [misc] run format:fix 2021-07-27 16:53:06 +01:00
Jakob Ackermann
d2589823b0 [misc] prepare for monorepo 
- add git ignore entries
- sync/create package-lock.json
- delete .nvmrc
 2021-07-27 16:52:55 +01:00
Jakob Ackermann
1f3587114f [misc] prepare for monorepo 
- add git ignore entries
- sync/create package-lock.json
- delete .nvmrc
 2021-07-27 16:41:40 +01:00
Jakob Ackermann
688a1092ce [misc] prepare for monorepo 
- add git ignore entries
- sync/create package-lock.json
- delete .nvmrc
 2021-07-27 16:41:13 +01:00
Jakob Ackermann
eaebef2298 [misc] prepare for monorepo 
- add git ignore entries
- sync/create package-lock.json
- delete .nvmrc
 2021-07-27 16:35:41 +01:00
Jakob Ackermann
25205ab967 [misc] prepare for monorepo 
- add git ignore entries
- sync/create package-lock.json
- delete .nvmrc
 2021-07-27 16:35:23 +01:00
Jakob Ackermann
23efa1d977 [misc] prepare for monorepo 
- add git ignore entries
- sync/create package-lock.json
- delete .nvmrc
 2021-07-27 16:33:33 +01:00
Jakob Ackermann
acc65b2518 [misc] fix path to app config/ dir following the renaming of the package 
The Settings.js file is now located in node_modules/@overleaf/settings,
 which is one level deeper than node_modules/settings-sharelatex.
 2021-07-06 15:19:30 +01:00
Jakob Ackermann
03f6e8af64 [misc] expose merge function in a separate module 2021-07-06 13:52:59 +01:00
Alf Eaton
955c9162c0 Rename to @overleaf/settings 2021-05-28 09:15:24 +01:00
Alf Eaton
9c0dbbc5c8 Remove CoffeeScript 2021-05-26 15:06:24 +01:00
decaffeinate
93f618a980 decaffeinate: Run post-processing cleanups on Settings.coffee 2021-05-26 14:24:24 +01:00
decaffeinate
2787cd6152 decaffeinate: Convert Settings.coffee to JS 2021-05-26 14:24:24 +01:00
decaffeinate
551eef00fb decaffeinate: Rename Settings.coffee from .coffee to .js 2021-05-26 14:24:23 +01:00
dependabot[bot]
3d38d900c3 Bump hosted-git-info from 2.8.8 to 2.8.9 
Bumps [hosted-git-info](https://github.com/npm/hosted-git-info) from 2.8.8 to 2.8.9.
- [Release notes](https://github.com/npm/hosted-git-info/releases)
- [Changelog](https://github.com/npm/hosted-git-info/blob/v2.8.9/CHANGELOG.md)
- [Commits](https://github.com/npm/hosted-git-info/compare/v2.8.8...v2.8.9)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-05-13 10:27:11 +01:00
dependabot[bot]
67f8d430aa Bump lodash from 4.17.19 to 4.17.21 (#21) 
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.19 to 4.17.21.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.19...4.17.21)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-05-10 12:21:40 +01:00
dependabot[bot]
e1b06cbfa3 Bump handlebars from 4.7.6 to 4.7.7 (#20) 
Bumps [handlebars](https://github.com/wycats/handlebars.js) from 4.7.6 to 4.7.7.
- [Release notes](https://github.com/wycats/handlebars.js/releases)
- [Changelog](https://github.com/handlebars-lang/handlebars.js/blob/master/release-notes.md)
- [Commits](https://github.com/wycats/handlebars.js/compare/v4.7.6...v4.7.7)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-05-10 12:21:28 +01:00
dependabot[bot]
cee9c8cc36 Bump y18n from 4.0.0 to 4.0.3 
Bumps [y18n](https://github.com/yargs/y18n) from 4.0.0 to 4.0.3.
- [Release notes](https://github.com/yargs/y18n/releases)
- [Changelog](https://github.com/yargs/y18n/blob/y18n-v4.0.3/CHANGELOG.md)
- [Commits](https://github.com/yargs/y18n/compare/v4.0.0...y18n-v4.0.3)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-04-29 09:22:54 +00:00
Brian Gough
2b088dc870 increase package version number 2021-04-29 10:21:33 +01:00
Brian Gough
46da33a67e fix unit tests 2021-04-29 09:27:25 +01:00
Brian Gough
bf26b7d596 upgrade ioredis and dev dependencies 2021-04-29 09:20:58 +01:00
Alf Eaton
c7511970b0 v1.3.0 2021-04-28 09:33:59 +01:00
Alf Eaton
be098ee993 Update Settings.coffee 
Co-authored-by: nate stemen <nate.stemen@overleaf.com>
 2021-04-26 09:09:00 +01:00
Alf Eaton
cf1a5bf0f7 Add deprecation warning for .coffee settings files 2021-04-20 09:35:56 +01:00
dependabot[bot]
9203e26d99 Bump y18n from 4.0.0 to 4.0.1 
Bumps [y18n](https://github.com/yargs/y18n) from 4.0.0 to 4.0.1.
- [Release notes](https://github.com/yargs/y18n/releases)
- [Changelog](https://github.com/yargs/y18n/blob/master/CHANGELOG.md)
- [Commits](https://github.com/yargs/y18n/commits)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-04-02 04:45:14 +01:00
Christopher Hoskin
acef9e7d8d Add basic README 2021-03-16 12:03:53 +00:00
Alf Eaton
c4be8bca60 1.2.0 2021-03-16 09:20:34 +00:00
Alf Eaton
c16fb06ecd Log the settings files that are used 2021-03-11 11:07:32 +00:00
Jakob Ackermann
e1650616b8 [misc] version bump to 3.5.1 2021-02-16 14:21:36 +00:00
John Lees-Miller
354fd3c3a6 Bump version to 3.3.1 2021-01-26 12:10:25 +00:00
Alasdair Smith
5f1297548f Install core-js to fix issue with compiled module (#18) 
Since Babel is configured to inject core-js built-ins where needed, we
must also install the core-js package.
 2021-01-26 12:06:28 +00:00
John Lees-Miller
3a392fd8c1 Bump version to 3.3.0 2021-01-25 19:45:24 +00:00
Alasdair Smith
1e1d493556 Add corejs config to allow polyfilling of Symbol for IE11 (#17) 2021-01-22 12:12:07 +00:00
Alasdair Smith
f1ed04cc58 Transpile with Babel to ES5 (#16) 2021-01-22 10:29:31 +00:00
Jakob Ackermann
20223d865f [misc] do not register a noop sweeping interval 2021-01-12 14:20:51 +00:00
Jakob Ackermann
29742d6a87 [misc] register the metrics sweeping interval handle for later cleanup 2021-01-12 14:20:31 +00:00
Eric Mc Sween
3581d0ce87 3.5.0 2021-01-11 08:03:49 -05:00
Eric Mc Sween
8dcbd5aec0 Add support for the swagger-tools router 
The swagger-tools router puts the request path in the
req.swagger.apiPath property.
 2021-01-08 14:53:29 -05:00
Eric Mc Sween
7274217d79 Decaf cleanup 2021-01-08 14:48:13 -05:00
Jakob Ackermann
96b585544a [misc] version bump to 3.2.0 
- [OError] getFullInfo returns the error context of nested causes (#14)
 2020-12-02 12:32:41 +00:00
Jakob Ackermann
a5e5d9b1cd [OError] getFullInfo returns the error context of nested causes (#14) 
* [OError] add getFullInfoIncludeCause for retrieving nested cause info

* Revert "[OError] add getFullInfoIncludeCause for retrieving nested cause info"

This reverts commit 4c7517255a0f37ba94223e559a3926f19bab618d

* [OError] getFullInfo returns the error context of nested causes

* [OError] getFullInfo flip sequence of merging, add test case for it
 2020-12-02 11:44:17 +00:00
Jakob Ackermann
8e76e79a83 [misc] version bump to 3.4.1 2020-11-25 11:25:27 +00:00
Jakob Ackermann
6452959482 [misc] do not access potentially undefined opts 2020-11-11 11:35:33 +00:00
Jakob Ackermann
e34f17a352 [misc] creating a redis client with redis-sentinel opts throws an error 2020-11-11 11:31:44 +00:00
Jakob Ackermann
bcd5abadce [misc] version bump to 2.0.0 2020-11-10 10:46:42 +00:00
Jakob Ackermann
41aa5ec876 [misc] rename package to @overleaf/redis-wrapper 2020-11-10 10:46:41 +00:00
Jakob Ackermann
d7eb8c7ecf [misc] refresh package.json 
- trim down the files for publishing
- drop sentinel from description
- Overleaf is the new author
- add repository reference
 2020-11-10 10:46:41 +00:00
Jakob Ackermann
aabe2d18b9 [misc] rewrite: squash history 
- promisify
- merge health check for single node and cluster
- replace the first multi with simple SET in health check
- reworked health check with o-error context/stack-traces for failures
- drop console.error on health check timeout, consumer logs the error
- cleanup unwrapping of ioredis multi result
- Promise support for multi.exec

This has been squashed from das7pad s fork.
REF: b3dd8c5cf4cc6482fd450e6bb67013508844f93f
 2020-11-10 10:34:06 +00:00
Jakob Ackermann
ccf4bb1e0e [misc] test/scripts: use logger-sharelatex for logging as in production 2020-11-10 10:15:03 +00:00
Jakob Ackermann
d827b521c6 [misc] test/unit: loosely match the passed redis options 
The rewrite will pass a cloned object through.
 2020-11-10 10:10:22 +00:00
Jakob Ackermann
4aebc1b0b6 [misc] rewrite: free functions 2020-11-10 10:10:22 +00:00
Jakob Ackermann
da8bef821b [misc] decaffeinate: decaffeinate module 2020-11-10 10:10:21 +00:00
Jakob Ackermann
c973c5b188 [misc] decaffeinate: rename 2/2 2020-11-10 10:10:21 +00:00
Jakob Ackermann
45bf2abb14 [misc] decaffeinate: rename 1/2 2020-11-10 10:10:20 +00:00
Jakob Ackermann
830d6275b3 [misc] add scripts for testing redis cluster 2020-11-10 10:10:06 +00:00
Jakob Ackermann
7b69cc42c9 [misc] decaffeinate tests: decaffeinate unit tests 2020-11-09 17:52:29 +00:00
Jakob Ackermann
7210b3dfed [misc] decaffeinate tests: decaffeinate standalone script 2020-11-09 17:52:20 +00:00
Jakob Ackermann
0a2171e9f0 [misc] decaffeinate tests: rename 2020-11-09 16:57:08 +00:00
Jakob Ackermann
1a090b7b46 [misc] add editor config, eslint, prettier boiler plate 
versions taken from o-error (prettier-eslint-cli from real-time)
 2020-11-09 16:56:56 +00:00
Jakob Ackermann
7eccce2ed0 [misc] reference module via js/loose file extension 2020-11-09 16:16:11 +00:00
Jakob Ackermann
69df7f5bb3 [misc] move test scripts into test/ tree 2020-11-09 16:11:11 +00:00
Jakob Ackermann
39809562fd [misc] use plain mocha for testing and bump devDependencies 2020-11-09 16:03:33 +00:00
Jakob Ackermann
dddb431034 [misc] drop unused async 
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
 2020-11-09 16:02:30 +00:00
Jakob Ackermann
a53eef5e3d [healthCheck] bring back support for redis cluster 
Assume `cluster-require-full-coverage=yes` is set for the redis cluster,
 which is the default value.

We are writing into a single hash slot, resulting in a partial health
 check only.
The 'cluster-require-full-coverage=yes' blocks writes as soon as any
 hash slot is not covered by an active primary.
We are leveraging the health check build into the redis cluster topology
 to bring the scope of the single read/write/delete to the full cluster.

REF: 1b3566d6c830289dc826da1d13b75d68205d8dec
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
 2020-11-09 16:02:29 +00:00
Jakob Ackermann
18fa184230 [misc] drop references for 'redis' package from unit tests 2020-11-09 16:02:25 +00:00
Jakob Ackermann
90ad28c51c [misc] drop support for redis-sentinel 2020-11-09 15:59:28 +00:00
Jakob Ackermann
2d1c84ea2e [misc] fix collection of open sockets 
```
> require('http').globalAgent.sockets
{ 'HOST:PORT:': [{ ... }, { ... }] }
```

- `new URL('http://HOST:PORT:')` throws
  -> test suite `open_sockets`
- gauges were not cleaned up after no agents were present for a given
   key. This lead to continuous emission of the previous connection
   count for a given hostname, following the completion of all requests.
  -> test suite `when all requests complete`
 2020-11-06 15:16:14 +00:00
Eric Mc Sween
142d9a5716 3.4.0 2020-10-30 07:39:47 -04:00
Eric Mc Sween
20b3d5070c Export a configured prom-client 
Metrics.initialize() and Metrics.configure() will configure the default
Prometheus registry with default "app" and "host" labels. The configured
prom-client module is available as Metrics.prom.
 2020-10-29 09:49:55 -04:00
Christopher Hoskin
725478d95f Release 3.3.0 2020-10-27 14:02:21 +00:00
Christopher Hoskin
f874291998 Bump google-cloud trace-agent, debug-agent and profiler to latest 2020-10-26 17:40:18 +00:00
Christopher Hoskin
d4a649353f Commit package-lock.json 2020-10-26 17:33:43 +00:00
Christopher Hoskin
fedc3191b8 Bump node to 10.19 2020-10-26 17:33:24 +00:00
Eric Mc Sween
0fdfa706f7 Make 404 error handling on deletes more specific 
The GCS persistor error handler ignores 404 errors on deletes. However,
the net is too wide cast, and 404 errors coming from the dual-bucket
lifecycle mechanism are also ignored.
 2020-10-15 10:35:52 -04:00
Simon Detheridge
60931b86c3 Don't try to delete files if none are found in a directory 2020-10-13 09:53:19 +01:00
John Lees-Miller
9b739f1c7d Bump version to 3.1.0 2020-09-25 16:10:12 +01:00
Eric Mc Sween
9089d332ab Add a "unsignedUrls" option to the GCS persistor 
This boolean option disables URL signing. Instead, getRedirectUrl()
returns the plain GCS download URL.
 2020-09-22 15:59:13 -04:00
Eric Mc Sween
0fdbb2dcc0 Add .npmignore to avoid publishing config files 2020-09-17 10:44:24 -04:00
Eric Mc Sween
bd1a1dbabf 3.2.1 2020-09-17 10:40:34 -04:00
Eric Mc Sween
2f35db4087 Fix startup crash 
Version 3.2.0 crashes on startup because it calls buildPromKey() without
arguments. To avoid this kind of obvious bug to happen again, I added
some basic acceptance tests.
 2020-09-17 10:30:25 -04:00
John Lees-Miller
258cc08717 Add a limit on the number of tags, OError.maxTags (#13) 
* Add OError.maxTags

* Tidy up package scripts and add a build script

Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>
Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
 2020-09-17 15:17:44 +01:00
Eric Mc Sween
c413f4d8a4 Fixed some function names in the docs 2020-09-15 16:13:58 -04:00
Eric Mc Sween
ec0441bc89 3.2.0 2020-09-15 08:37:05 -04:00
Eric Mc Sween
c05bd83e24 Add a separate configure() method 
configure() sets options in the metrics module, but does not start the
default metrics collectors and the profiling agents.
 2020-09-15 08:36:03 -04:00
Eric Mc Sween
3c9c17c22f Remove "using prometheus" log 
We now always use prometheus
 2020-09-11 15:59:38 -04:00
Eric Mc Sween
6f69fb4869 Decaf cleanup: move functions to top level 2020-09-11 15:59:38 -04:00
Eric Mc Sween
afecfd5212 Decaf cleanup: use default parameters 2020-09-11 15:59:38 -04:00
Eric Mc Sween
d7e4b3fe33 Decaf cleanup: unnecessary returns 2020-09-11 15:59:38 -04:00
Eric Mc Sween
6c020f6e54 Decaf cleanup: remove Array.from() 2020-09-11 15:59:38 -04:00
Eric Mc Sween
971a768c4e Install prettier and eslint 2020-09-11 15:59:33 -04:00
John Lees-Miller
ea2d76de51 Improve tagging for a (maybe) null error (#12) 
* Document a way of handling an error that might be null

* Make typecheck strict

* Test some edge cases

Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>
 2020-09-11 10:05:54 +01:00
Brian Gough
c530422f1e update package version to 3.1.0 2020-09-04 15:52:05 +01:00
Jakob Ackermann
71ba4150fe [misc] enable compression for the /metrics route 2020-09-04 15:32:48 +01:00
Brian Gough
b6b65b9638 Merge pull request #39 from overleaf/jpa-res-headers-public-api 
[http] use public node api for getting the response content-length
 2020-09-04 14:52:20 +01:00
Eric Mc Sween
967dde280e Disable auto-decompression in GCS persistor 
The GCS library automatically decompresses files with Content-encoding:
gzip. This is very useful, but the S3 library doesn't do that, so we
need to disable the feature in GCS so that it behaves the same way other
persistors behave.
 2020-08-18 16:04:54 -04:00
Jakob Ackermann
6f4829e817 [misc] fix module importing 2020-08-17 14:43:08 +01:00
Jakob Ackermann
37fda043d4 [http] use public node api for getting the response content-length 2020-08-17 11:59:18 +01:00
Christopher Hoskin
a66708a319 Ignore error 2020-08-11 10:56:51 +01:00
Christopher Hoskin
8649277c9f Format:fix 2020-08-11 10:55:03 +01:00
Christopher Hoskin
ea502a0623 Put LoggingManager.initialize back as it was in tests 2020-08-11 10:52:53 +01:00
Christopher Hoskin
20f2e1eb1d Don't catch checkLogLevel 2020-08-11 10:48:44 +01:00
Christopher Hoskin
9b21292b44 Ensure fetchResponse.text is a string in sinon stub 2020-08-11 10:47:31 +01:00
Christopher Hoskin
46b22b30c7 Fix test description 2020-08-11 09:46:52 +01:00
Christopher Hoskin
3a2ff4e7b5 Merge branch 'master' into csh-metadata-fallback-node-fetch 2020-08-11 09:44:28 +01:00