Commit graph

17856 commits

Author SHA1 Message Date
Eric Mc Sween
82ec8d21a4 Merge pull request #5 from overleaf/em-s3-signed-url
Implement getRedirectUrl() for the S3 backend
2020-07-09 11:04:31 -04:00
Eric Mc Sween
3e7e4369af Implement getRedirectUrl() for the S3 backend 2020-07-08 17:13:20 -04:00
Jakob Ackermann
ca4168ce90 [misc] use overleaf/socket.io and overleaf/socket.io-client forks 2020-07-08 15:07:19 +01:00
Eric Mc Sween
7abea41166 Merge pull request #4 from overleaf/em-metadata
Support metadata when uploading objects
2020-07-08 09:27:25 -04:00
Eric Mc Sween
523ff9c4cd Support metadata when uploading objects
Add contentType and contentEncoding options to sendStream(). These
options will set the corresponding metadata on the object.

This changes the API. The fourth argument to sendStream() used to be the
source md5. Now, it's an options object and the source md5 is a property
of that object.
2020-07-08 08:13:53 -04:00
Jakob Ackermann
f4b9f2d2ca Merge pull request #760 from overleaf/jpa-post-decaff
[bin/compile-services] all services are decaffeinated now
2020-07-08 13:17:03 +02:00
Jakob Ackermann
2766993c65 [bin/compile-services] all services are decaffeinated now 2020-07-08 11:18:47 +01:00
Simon Detheridge
dc0967b01b Merge pull request #124 from overleaf/spd-persistor-config
Move config settings to correct place for new persistor module
2020-07-08 11:16:15 +01:00
Simon Detheridge
14834abf83 Move config settings to correct place for new persistor module 2020-07-08 10:32:41 +01:00
Jakob Ackermann
398d2deb07 Merge pull request #2977 from overleaf/jpa-import-697
[ProjectController] fix the sorting of project entities for node v11+

GitOrigin-RevId: d4458aeaf83f610e36669050e664c902dbcce36e
2020-07-08 02:04:28 +00:00
Jakob Ackermann
ae068781ca Merge pull request #2978 from overleaf/jpa-expose-hostname
[misc] optionally expose the hostname in the X-Served-By response header

GitOrigin-RevId: f3ac14aeb75cef8c9ed1d8cb1d649dd7f909b99b
2020-07-08 02:04:24 +00:00
Jakob Ackermann
f0f29e2f17 Merge pull request #2976 from overleaf/jpa-import-671
[misc] Add a copy the the GNU Affero General Public License v3.0

GitOrigin-RevId: e3e0f207275b1740b0edc3684822201bf9be51bc
2020-07-08 02:04:19 +00:00
Jakob Ackermann
7bb02d87bc Merge pull request #2973 from overleaf/jel-emails-cleanup
Remove unused email bodies/layout

GitOrigin-RevId: c7fb12ce70560f32fabd6e4dfd1890e709090673
2020-07-08 02:04:14 +00:00
Jakob Ackermann
6050de114e Merge pull request #2966 from overleaf/cmg-jpa-tags-update-propagation
Remove tag in place instead of replacing array

GitOrigin-RevId: 779577e8981e37508d20364903a843795c36dffe
2020-07-08 02:04:09 +00:00
Simon Detheridge
6c853de5d5 Migrate to new object-persistor module (#122)
* Migrate to new object-persistor module

* Support updated persistor module using ES6 classes

* Update object-persistor

* Upgrade new persistor code to OError3

* Update to latest minor release for outdated packages

* Update package hashes to sha512

* Point object-persistor at master branch
2020-07-07 13:49:54 +01:00
Simon Detheridge
cd8c8b2b7f Merge pull request #3 from overleaf/spd-oerror3
Update to OError3
2020-07-07 13:24:52 +01:00
Jakob Ackermann
383f7a1e2e Merge pull request #167 from overleaf/jpa-expose-hostname
[misc] reland optionally expose the hostname in the 'debug.getHostname' rpc
2020-07-07 12:10:58 +02:00
Jakob Ackermann
9fff03bca5 [misc] optionally expose the hostname in the 'debug.getHostname' rpc 2020-07-07 11:07:28 +01:00
Jakob Ackermann
aa9d6c8dc9 [misc] reland decaff cleanup (#166)
* [misc] decaff cleanup: RoomManager

* [misc] decaff cleanup: RedisClientManager

* [misc] decaff cleanup: SafeJsonParse

* [misc] decaff cleanup: WebApiManager

* [misc] decaff cleanup: WebsocketController

* [misc] decaff cleanup: WebsocketLoadBalancer

* [misc] decaff cleanup: SessionSockets

* [misc] decaff cleanup: HttpController

* [misc] decaff cleanup: HttpApiController

* [misc] decaff cleanup: HealthCheckManager

* [misc] decaff cleanup: EventLogger

* [misc] decaff cleanup: Errors

o-error will eliminate most of it -- when we migrate over.

* [misc] decaff cleanup: DrainManager

* [misc] decaff cleanup: DocumentUpdaterManager

* [misc] decaff cleanup: DocumentUpdaterController: no-unused-vars

* [misc] decaff cleanup: DocumentUpdaterController: Array.from

* [misc] decaff cleanup: DocumentUpdaterController: implicit return

* [misc] decaff cleanup: DocumentUpdaterController: IIFE

* [misc] decaff cleanup: DocumentUpdaterController: null checks

* [misc] decaff cleanup: DocumentUpdaterController: simpler loops

* [misc] decaff cleanup: DocumentUpdaterController: move module name def

* [misc] decaff cleanup: ConnectedUsersManager: handle-callback-err

* [misc] decaff cleanup: ConnectedUsersManager: implicit returns

* [misc] decaff cleanup: ConnectedUsersManager: null checks

* [misc] decaff cleanup: ChannelManager: no-unused-vars

* [misc] decaff cleanup: ChannelManager: implicit returns

* [misc] decaff cleanup: ChannelManager: other cleanup

- var -> const
- drop variable assignment before return

* [misc] decaff cleanup: AuthorizationManager: handle-callback-err

Note: This requires a change in WebsocketController to provide a dummy
 callback.

* [misc] decaff cleanup: AuthorizationManager: Array.from

* [misc] decaff cleanup: AuthorizationManager: implicit returns

* [misc] decaff cleanup: AuthorizationManager: null checks

* [misc] decaff cleanup: Router: handle-callback-err

* [misc] decaff cleanup: Router: standard/no-callback-literal

* [misc] decaff cleanup: Router: Array.from

* [misc] decaff cleanup: Router: implicit returns

* [misc] decaff cleanup: Router: refactor __guard__ wrapper

* [misc] decaff cleanup: Router: null checks

And a minor bug fix: user.id -> user._id

* [misc] decaff cleanup: Router: move variable declarations to assignments

* [misc] decaff cleanup: app: implicit returns

* [misc] decaff cleanup: app: __guard__

* [misc] decaff cleanup: app: null checks

* [misc] decaff cleanup: app: function definitions

* [misc] decaff cleanup: app: drop unused next argument

* [misc] decaff cleanup: app: var -> const
2020-07-07 11:06:02 +01:00
Jakob Ackermann
e913c57aab Merge pull request #162 from overleaf/jpa-fix-unit-tests
[misc] fix unit tests
2020-07-07 11:54:05 +02:00
Simon Detheridge
990bacf3c2 Update to OError3 2020-07-07 10:40:37 +01:00
Ersun Warncke
1a3f1f1200 Merge pull request #117 from overleaf/as-ew-jlm-upgrade-to-o-error-v3
upgrade to o-error v3
2020-07-06 07:58:04 -07:00
Ersun Warncke
046c8d916b remove un-needed config change in unit test 2020-07-06 09:27:12 -04:00
Ersun Warncke
83f6eabaf6 upgarde logger-sharelatex 2020-07-06 09:26:59 -04:00
Eric Mc Sween
bf636047a3 Merge pull request #33 from overleaf/em-swagger-fix
Log requests that don't have a route property
2020-07-06 08:37:26 -04:00
Eric Mc Sween
e197e4dc11 2.7.0 2020-07-06 08:20:02 -04:00
Jakob Ackermann
bf5eaff056 Merge pull request #161 from overleaf/jpa-msm-decaf
[misc] decaffeinate real-time
2020-07-06 12:48:46 +02:00
Eric Mc Sween
d69195eaa9 Log requests that don't have a route property
The v1 history service has its routes set up via swagger-tools, which
doesn't write a route property on the request. This prevents us to send
request metrics based on the route, but we can still log the request.
2020-07-03 16:38:29 -04:00
Simon Detheridge
588979bbff Merge pull request #2 from overleaf/circleci-project-setup
Add .circleci/config.yml and fix errors
2020-07-03 13:16:29 +01:00
Simon Detheridge
7369e2f339 Add .circleci/config.yml and fix errors 2020-07-03 11:59:34 +01:00
Jakob Ackermann
c3a3ed341b Merge pull request #132 from das7pad/hotfix-double-call
[LocalCommandRunner] run: block a double call of the callback
2020-07-03 12:58:25 +02:00
Jakob Ackermann
cd87d3018e [misc] fix formatting 2020-07-03 11:47:53 +01:00
Jakob Ackermann
fe7218fefb Merge pull request #123 from das7pad/hotfix/test-error-handling
[ExampleDocumentTests] drop out in case of an error during compilation
2020-07-03 12:40:15 +02:00
Jakob Ackermann
a5c3bad7f1 [ExampleDocumentTests] drop out in case of an error during compilation
Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-07-03 11:38:12 +01:00
Jakob Ackermann
fbca4eb191 Merge pull request #37 from das7pad/hotfix-error-handling-cache-dump
[ASpell] error handling of cache dump: fix an async fs function call
2020-07-03 12:23:46 +02:00
Jakob Ackermann
5cfd92cf85 [ASpell] error handling of cache dump: fix an async fs function call
fs.unlink requires a callback as second parameter.

Signed-off-by: Jakob Ackermann <das7pad@outlook.com>
2020-07-03 11:13:01 +01:00
Jakob Ackermann
48b138f227 Merge pull request #2929 from overleaf/jpa-ci-3m30s-with-custom-cloudbuild
[misc] another batch of CI improvements

GitOrigin-RevId: 470fd762ba541d5dce92f0e99830fb2fd8fc4747
2020-07-03 02:04:13 +00:00
Jakob Ackermann
acd8ff6aeb Merge pull request #2970 from overleaf/jel-remove-unused-variables
Remove unused variables in AdminController

GitOrigin-RevId: fc8c3bc451c50d1e33a5c4a9173066784064a692
2020-07-03 02:04:08 +00:00
Jakob Ackermann
48369025c5 Merge pull request #2969 from overleaf/jpa-bump-translations
[misc] bump translations

GitOrigin-RevId: f979e50d69a182f1b8379e85617589a39379d4f8
2020-07-03 02:04:03 +00:00
Jakob Ackermann
32bef75ba7 Merge pull request #60 from overleaf/csh-issue-1123-bump-logger-210
Update logger to 2.1.0
2020-07-02 15:52:58 +02:00
Jakob Ackermann
0f9ad44e78 Merge pull request #56 from overleaf/ew-jpa-fix-express-deprecations
[misc] fix express deprecations
2020-07-02 15:52:17 +02:00
Ersun Warncke
06ec5556b0 [misc] fix express deprecations
Co-Authored-By: Jakob Ackermann <jakob.ackermann@overleaf.com>
2020-07-02 14:48:11 +01:00
Simon Detheridge
e92b75a2f8 Create new module from overleaf/filestore persistors (#1)
* Create new module from overleaf/filestore persistors

* Convert persistors to ES6 classes with local settings

* Update README.md

Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>

* Update README.md

Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>

* Update .gitignore

Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>

* Switch to AGPL license

* Paginate S3 list-object results

* Remove S3 client caching

* Clean up S3 md5-verification mechanism

* Update README for recent changes

* Update README.md

Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>

* Remove package-lock

* Remove comment about FileHandler

* Add directory marker to FSPersistor.deleteDirectory

* Don't copy opts in GcsPersistor.getObjectStream

* Use Date.now instead of getTime

* Catch errors in migration persistor

* Check that settings.buckets exists

* Don't mutate options in ObserverStream constructor

* Update src/PersistorHelper.js

Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>

* Lint and format fixes

Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
2020-07-02 14:19:45 +01:00
Brian Gough
d7f9aa14ef Merge pull request #20 from overleaf/csh-update-deps-sha1
Update logger dependencies
2020-07-02 14:00:19 +01:00
Jakob Ackermann
c330448499 Merge pull request #21 from overleaf/jpa-eslint-basepath-fix
Jpa eslint basepath fix
2020-07-02 13:52:07 +02:00
Jakob Ackermann
21176b028f Merge pull request #39 from overleaf/csh-issue-1123-bump-logger-210
Update logger to 2.1.0
2020-07-02 13:45:04 +02:00
Jakob Ackermann
b8bf4b7ebc Merge pull request #21 from overleaf/ew-jpa-fix-express-deprecations
[misc] fix express deprecations
2020-07-02 13:44:26 +02:00
Ersun Warncke
89c46ea5fa [misc] fix express deprecations
Co-Authored-By: Jakob Ackermann <jakob.ackermann@overleaf.com>
2020-07-02 12:30:17 +01:00
Jakob Ackermann
e61b1124bb [misc] bump eslint to 7.3.1 2020-07-02 12:15:22 +01:00
Jakob Ackermann
97407980db [misc] monkey patch prettier-eslint basepath 2020-07-02 12:12:07 +01:00