Commit graph

17723 commits

Author SHA1 Message Date
Jakob Ackermann
b1a39e3c0f Merge pull request #73 from overleaf/bg-remove-travis-yml
Remove unused .travis.yml file
2020-02-14 10:54:57 +01:00
Simon Detheridge
2f67ade3ec Merge pull request #88 from overleaf/dependabot-lodash-4.17.15
Bump lodash from 4.17.11 to 4.17.15
2020-02-14 09:45:12 +00:00
dependabot[bot]
31f2572e57 Bump lodash from 4.17.11 to 4.17.15
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.11 to 4.17.15.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.11...4.17.15)

Signed-off-by: dependabot[bot] <support@github.com>
2020-02-14 09:39:06 +00:00
Simon Detheridge
485cfce6d3 Merge pull request #85 from overleaf/jpa-dependencies-cleanup
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
2020-02-14 09:24:43 +00:00
Simon Detheridge
16d1674eab Merge pull request #84 from overleaf/bg-remove-travis-yml
Remove unused .travis.yml file
2020-02-14 09:21:03 +00:00
Jakob Ackermann
84a80930eb [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i 2020-02-14 09:19:29 +00:00
Simon Detheridge
44fbc6a733 Merge pull request #82 from overleaf/spd-error-handler-error
Fix log info assignment in error handler
2020-02-14 09:18:16 +00:00
Simon Detheridge
aae277e16e Merge pull request #78 from overleaf/spd-migration-persistor
Add Migration Persistor, to send missing file requests to a fallback persistor
2020-02-14 09:17:31 +00:00
Brian Gough
69a98355ce Merge pull request #2599 from overleaf/bg-fix-safepath-check
fix safepath check

GitOrigin-RevId: b5bb636d2bd958ab142fa94683ad9cf58369a77d
2020-02-14 04:16:44 +00:00
Simon Detheridge
9cf473ba7b Merge pull request #79 from overleaf/spd-helper-refactor
Refactor persistors to use a helper for common things
2020-02-13 16:59:35 +00:00
Jakob Ackermann
b715f16a3b [misc] minimize the main stage (#122)
- cleanup git history
- do not install not needed npm packages
  - The Gruntfile was removed in
    REF: 27dd97ecc5

  - The simple-git package is not used since
    REF: df2d46df82
- cleanup npm cache
- cleanup node-gyp build cache
- cleanup /tmp
- move copying of the settings defaults after the installation

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-02-13 16:38:58 +01:00
Jakob Ackermann
3170a27fb5 [init] bail out in case the db access fails (#123)
* [init] bail out in case the db access fails

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [misc] bail out in case any command in an init_script failed

NOTE: sh does not support `-o pipefail`.

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-02-13 13:33:55 +01:00
Jakob Ackermann
ac82600b74 [misc] minimize base image (#120)
* [docker] drop sudo

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] install qpdf in a single stage

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] install texlive and additional tlmgr packages in a single stage

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] drop the apt package lists

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] pull the package lists only once

move the installation of nodejs into the dependencies install section

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] delete the default nginx configuration files immediately

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] skip the downloading and storage of unused texlive artifacts

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] drop the npm download cache

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>

* [docker] apply review feedback

- install qpdf as ubuntu package
- add a comment on the nginx config removal
- add back and update a note on changing the texlive mirror
2020-02-13 12:00:03 +01:00
Jakob Ackermann
991cb29d0b [nginx] simplify the root specification for sendfile (#121)
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-02-13 11:59:20 +01:00
Jakob Ackermann
6f46b2c145 [settings] produce a consistent redis config for every service (#124)
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-02-13 11:56:03 +01:00
Simon Detheridge
1c6ad2b7db Merge pull request #2569 from overleaf/as-build-changes
Build changes required for passing secrets into docker build

GitOrigin-RevId: 46c221bd0f0e3ec4ec02384afb252c532d688516
2020-02-13 04:20:58 +00:00
Simon Detheridge
de40289b38 Merge pull request #2588 from overleaf/ns-add-text-extensions
add more extensions to editable files

GitOrigin-RevId: f2a52eee148a78c8cb3623f27e25f2e0801ef835
2020-02-13 04:20:53 +00:00
Simon Detheridge
9e6323caeb Merge pull request #2584 from overleaf/spd-duplicate-deleted-things
Prevent creation of (and clean up) duplicate deletedUsers and deletedProjects

GitOrigin-RevId: 5e52578b514f05779290c61cf7d4e630cc3ba6f7
2020-02-13 04:20:49 +00:00
Simon Detheridge
73defe82d9 Merge pull request #2561 from overleaf/pr-reduce-spellcheck-initial-req
Reduce spellcheck initial (and subsequent) requests

GitOrigin-RevId: 81eee359ea1bc740991ba84b0fe121c37cb4c6a2
2020-02-13 04:20:44 +00:00
Simon Detheridge
72c5286622 Merge pull request #2587 from overleaf/msm-ns-disable-comment-button
disable "add comment" button if feature is not available

GitOrigin-RevId: e054f138a84ec634cc777d76e8a288ba2c1b2ee3
2020-02-13 04:20:40 +00:00
Simon Detheridge
96cd1c869e Merge pull request #2583 from overleaf/spd-no-mongoredis-in-unittests
Clean up attempts to connect to Mongo and Redis in unit tests

GitOrigin-RevId: 396813a04fc2aaf39a07e28613f8f1e0a7a2db8f
2020-02-13 04:20:35 +00:00
Jakob Ackermann
5c7251afce Merge pull request #2596 from overleaf/jpa-build-scripts-1-3-5
[misc] align the Dockerfile to the build scripts version 1.3.5

GitOrigin-RevId: cdda059b68068b9b4de87520cff91ce179426836
2020-02-13 04:20:31 +00:00
Chrystal Maria Griffiths
4131e5ce7b Merge pull request #2585 from overleaf/cmg-remove-legacy-archive
Remove legacy project archiving

GitOrigin-RevId: a402cde154cdc2ef5e93661318c5ca86201471b5
2020-02-13 04:20:26 +00:00
Chrystal Maria Griffiths
3785be1fec Merge pull request #2566 from overleaf/cmg-invalid-filename
Suppress error for empty filename when still editing

GitOrigin-RevId: 42d7fa9af9b183603577effb5d1daaafa21ce065
2020-02-13 04:20:22 +00:00
Brian Gough
80e9afe42c Merge pull request #2586 from overleaf/bg-simplify-rate-limit-metrics
simplify metric for rate limits

GitOrigin-RevId: bba98c7e38846aedcfcf0781003f755e302f7759
2020-02-13 04:20:17 +00:00
Jakob Ackermann
79a336dd55 [misc] cleanup unused dependency on redis 2020-02-12 14:49:02 +01:00
Jakob Ackermann
f9cefa6f06 [misc] specify dependency versions to counter unrelated lockfile changes
Also delete unused redis dependency.
2020-02-12 14:49:00 +01:00
Jakob Ackermann
16f2dbb58c [misc] delete unused redis dependency 2020-02-12 14:47:30 +01:00
Jakob Ackermann
43013e0820 [misc] cleanup unused dependency on mongo 2020-02-12 14:44:01 +01:00
Jakob Ackermann
f2577a16cc [misc] cleanup unused dependency on redis 2020-02-12 14:43:19 +01:00
Jakob Ackermann
d0f861020a [misc] cleanup unused dependency on redis 2020-02-12 14:43:18 +01:00
Jakob Ackermann
a248d6b0a2 [misc] cleanup unused dependency on redis 2020-02-12 14:43:18 +01:00
Jakob Ackermann
2555dbdd36 [misc] cleanup unused dependency on redis 2020-02-12 14:43:17 +01:00
Jakob Ackermann
fc17d6adf1 [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
Also delete unused redis dependency.
2020-02-12 14:41:14 +01:00
Jakob Ackermann
902b4fca46 [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i 2020-02-12 14:39:53 +01:00
Jakob Ackermann
660c9145ad [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i 2020-02-12 14:39:52 +01:00
Jakob Ackermann
af4211d167 [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i 2020-02-12 14:39:51 +01:00
Timothée Alby
0c22a7c50f Merge pull request #692 from overleaf/msm-fixed-mailing-list-link
Fixed mailing list link in README
2020-02-12 08:39:05 -05:00
Simon Detheridge
3b011258d2 Tidy up md5 hash generation 2020-02-12 13:27:12 +00:00
Simon Detheridge
49ad408b30 Remove unused imports and format correctly 2020-02-12 13:27:12 +00:00
Simon Detheridge
93cd55fb79 Refactor persistors to use a helper for common things 2020-02-12 13:27:12 +00:00
Simon Detheridge
304fdfd35c Explicitly resume stream after adding listener 2020-02-12 13:21:53 +00:00
Simon Detheridge
6dcf351377 Remove unnecessary 'async' 2020-02-12 13:21:53 +00:00
Simon Detheridge
f4a16cd972 Update tests to properly check for copied files 2020-02-12 13:21:53 +00:00
Simon Detheridge
42a5d168df Remove unused packages 2020-02-12 13:21:52 +00:00
Simon Detheridge
9e0b378948 Remove minipass as dependency and refactor to make things clearer 2020-02-12 13:21:52 +00:00
Simon Detheridge
5d5d325691 Preserve all error information when cleanup of copied file fails 2020-02-12 13:21:52 +00:00
Simon Detheridge
b4b7fd226e Add mechanisms to transfer files with md5-based integrity checks
Fix error in settings and tidy up tests

Remove unused variable declaration

Remove .only from tests and update eslint rules to catch it in future

Use  to catch errors more safely getting md5 hash

Avoid unnecessary call to S3 to get md5 response
2020-02-12 13:21:52 +00:00
Simon Detheridge
2625e03a31 Add MigrationPersistor for sending 404 requests to a fallback persistor 2020-02-12 13:19:48 +00:00
Simon Detheridge
f877f51775 Rename *PersistorManager to *Persistor 2020-02-12 13:19:48 +00:00