Jakob Ackermann
8bc44141be
Merge pull request #16590 from overleaf/jpa-redis-lock-60s
...
[server-ce] increase the doc lock TTL from 30s to 60s
GitOrigin-RevId: 468f7483cc6a80e8034e3cc8071b674123985deb
2024-01-19 09:06:06 +00:00
Mathias Jakobsen
4763cfd59e
Merge pull request #16058 from overleaf/jpa-faster-restart
...
[misc] faster service shutdown in dev-env
GitOrigin-RevId: c5589844aefe3ca097756b188e02354ab518b94d
2023-12-08 09:04:01 +00:00
Eric Mc Sween
1aff1b64ab
Merge pull request #14662 from overleaf/em-revert-docupdater-history-ranges-support
...
Revert document-updater changes from #14567
GitOrigin-RevId: 72af1d24c94f7c46f2557700e6425f278356cffd
2023-09-06 08:06:46 +00:00
Eric Mc Sween
3fa1245860
Merge pull request #14567 from overleaf/em-history-ranges-flag
...
Add historyRangesSupport flag to projects
GitOrigin-RevId: 1e3f24a7c6f209bbd34eaaf4caee56dc7061b3da
2023-09-06 08:06:19 +00:00
Miguel Serrano
2ccc1aeea5
Merge pull request #13264 from overleaf/msm-docupdater-cleanup
...
[docupdater] Cleanup track-changes code
GitOrigin-RevId: 906a4f57a9e7348f47af67cff44a32ae1bb2debb
2023-07-17 10:24:47 +00:00
Eric Mc Sween
f76ab26822
Merge pull request #10998 from overleaf/em-upgrade-mongo-document-updater
...
Upgrade Mongo driver in document updater
GitOrigin-RevId: e3c4d86bbcf86dcf16fdfdbfab2aaf0d8eb1037c
2023-01-11 09:05:28 +00:00
Brian Gough
678148d1b9
Merge pull request #8839 from overleaf/bg-disable-track-changes
...
[document-updater] disable track-changes
GitOrigin-RevId: f97be24d959ec8fd21e39c46a13b124ed9e5b406
2022-08-08 08:03:31 +00:00
Eric Mc Sween
6ddbf23da0
Merge pull request #6171 from overleaf/em-retire-project-history-importer
...
Stop sending history migration updates to a separate project-history
GitOrigin-RevId: 0fdcc84935797a205a05bb32399c19eb1ca7f044
2022-01-07 09:03:14 +00:00
Jakob Ackermann
c532376e21
[misc] run format_fix and lint:fix
2021-07-13 12:04:42 +01:00
Brian Gough
b1a1446054
remove the limit of 300 maxSockets
2021-04-29 10:29:34 +01:00
Henry Oswald
bcfc7e66fc
add missing comma in settings file
2021-02-09 10:32:16 +00:00
Henry Oswald
40de999766
Update config/settings.defaults.js
...
parseint on dispatcher count
Co-authored-by: John Lees-Miller <jdleesmiller@gmail.com>
2021-02-04 09:30:35 +00:00
Henry Oswald
11c8cfc939
shard the pending-updates-list queue
2021-02-02 16:38:25 +00:00
Jakob Ackermann
16ef0d9610
[misc] mongodb: use the new db connector by default
...
mongojs was enabling it by default as well.
2020-09-10 10:40:05 +01:00
Eric Mc Sween
e8f935d046
Make max JSON request size configurable and default to 8 MB
...
This is to allow multi-document updates, for example when creating a new
project from a zip file.
2020-05-08 15:01:34 -04:00
Tim Alby
e089cfc93c
format config/settings.defaults.js & lib/diff_match_patch.js
2020-05-06 12:16:48 +02:00
Tim Alby
4184976099
fix lint errors in config/settings.defaults.js
2020-05-06 12:16:10 +02:00
Tim Alby
29d5e8f8b9
prettier: convert individual decaffeinated files to Prettier format
2020-05-06 12:13:11 +02:00
Tim Alby
877bae34b3
decaffeinate: convert individual files to js
2020-05-06 12:13:10 +02:00
Tim Alby
86c6c38a6e
decaffeinate: rename individual coffee files to js files
2020-05-06 12:13:07 +02:00
Brian Gough
79c934759c
add default redis settings for project history
2020-04-22 14:04:28 +01:00
Brian Gough
2e24d1670c
remove old unused ioredis keepalive option
2020-04-22 13:51:14 +01:00
Brian Gough
61da130cf4
keep maxRetriesPerRequest for project_history redis config
2020-04-22 13:50:39 +01:00
Brian Gough
af93193d6e
remove new_project_history and use project_history instead
2020-04-21 14:43:48 +01:00
Brian Gough
412eabc306
Revert "add tls settings"
...
This reverts commit 72a4994cebab2731f99f0ada7a094c8a0acb3293.
2020-02-19 09:26:42 +00:00
Brian Gough
31324fb65a
add environment variable for migration_phase setting
2020-01-22 15:36:06 +00:00
Brian Gough
ad58fe76b2
add tls settings
2020-01-21 15:36:33 +00:00
Brian Gough
d0c5eb5698
support migration of project history keys to separate redis instance
2019-12-13 16:38:41 +00:00
Brian Gough
ad19fee667
add setting so that double flush is the default
...
can be disabled to stop flushing to track-changes
2019-11-25 13:36:25 +00:00
Brian Gough
dcd7649bad
filter track-changes updates for projects using project-history
2019-11-19 10:02:56 +00:00
Brian Gough
21a9126847
set maxRetriesPerRequest from environment variable
2019-10-16 08:44:08 +01:00
Brian Gough
5a62632cfd
add ioredis option maxRetriesPerRequest: 0
...
see https://github.com/luin/ioredis/issues/965
2019-10-04 11:53:14 +01:00
Brian Gough
51a821c03c
remove old unused ioredis keepalive option
2019-10-04 11:51:37 +01:00
Brian Gough
2845b23b70
add smoothing of delete spikes
2019-10-01 15:01:53 +01:00
Brian Gough
73b4262186
add continuous background flush
2019-09-30 16:05:53 +01:00
Brian Gough
89a90399fe
Merge pull request #89 from overleaf/bg-queue-deletes
...
queue deletes for deferred processing
2019-09-30 11:14:08 +01:00
John Lees-Miller
c5a9105c33
Update config
2019-09-28 11:07:33 +01:00
Brian Gough
f6b2ac7360
queue deletes for deferred processing
2019-09-25 16:42:49 +01:00
Henry Oswald
aa1c74a979
use MONGO_CONNECTION_STRING in settings.defaults.coffee if set
2019-08-07 15:44:57 +01:00
Brian Gough
c9ccf62d71
support per-doc pubsub channels
2019-07-22 12:20:06 +01:00
Henry Oswald
3b3b2da0f5
add pubsub redis connection and remove real time redis connection
2019-07-04 13:34:31 +01:00
Tim Alby
c1c23e4bee
record last author id on document flush
...
This is a multi-steps process:
* get a update's `user_id` from the metadata
* store the `user_id` (`lastUpdatedBy`) and current date (`lastUpdatedAt`) for
the document in Redis on every updates
* fetch `lastUpdatedAt` and `lastUpdatedBy` from Redis on document flush
* send the data to web to be persisted in Mongo
2019-05-02 11:10:02 +01:00
Henry Oswald
4d7f9f3c1a
add sentry into settings.defaults
2019-03-05 17:34:27 +00:00
Henry Oswald
937e8fe071
use redis cluster key in defaults for pendingupdates
2019-02-15 13:58:29 +00:00
Henry Oswald
ecaef6485b
revert the removal of realtime keyspace
2019-02-07 15:27:51 +00:00
Henry Oswald
73bd264401
remove realtime keys in settings, no longer used
2019-02-07 14:55:24 +00:00
Henry Oswald
8d3fb729c5
point to web_api
2019-02-01 20:10:47 +00:00
Henry Oswald
98de529e42
make config look like chef config
2019-02-01 19:52:00 +00:00
Henry Oswald
d279a9149c
add dispatcherCount to config file
2019-01-25 17:24:19 +00:00
Henry Oswald
25e1ad7491
remove redis.realtime
...
real time pushes data into the document updater redis instance
2018-12-05 16:17:41 +00:00