Hayden Faulds
|
81f998afe9
|
return pathname from DocumentManager.getDoc
|
2017-10-23 14:23:21 +01:00 |
|
Hayden Faulds
|
748315aadc
|
handle pathname in DocumentManager.getDoc
|
2017-10-23 14:23:21 +01:00 |
|
Hayden Faulds
|
cbdace7386
|
store pathname in Redis cache
|
2017-10-23 14:23:21 +01:00 |
|
Hayden Faulds
|
05b93a629a
|
return pathname from PersistenceManager
|
2017-10-23 14:17:14 +01:00 |
|
Brian Gough
|
02d3d1bd17
|
fix unit tests
timekeeper must be called before SandboxedModule.require
|
2017-10-23 14:02:53 +01:00 |
|
Brian Gough
|
7c2a28c161
|
fix use of timekeeper in unit tests
|
2017-10-23 13:33:14 +01:00 |
|
Brian Gough
|
7cbb3e7af8
|
change getProjectDocs endpoint from GET to POST
also note that it flushes docs if they are considered old (i.e. not
recently flushed)
|
2017-10-11 15:30:29 +01:00 |
|
Brian Gough
|
8d3f82360c
|
update DocumentManager.getDoc signature
keep alreadyLoaded flag at the end for consistency
|
2017-10-11 14:25:33 +01:00 |
|
Brian Gough
|
2bbbf3c005
|
add unflushed time to doc in redis
|
2017-10-06 12:34:28 +01:00 |
|
Brian Gough
|
ad745f133d
|
Merge pull request #59 from sharelatex/bg-reset-project-state
add endpoint to clear project state
|
2017-09-13 10:39:47 +01:00 |
|
Brian Gough
|
2047bd5516
|
fix broken unit test
|
2017-09-11 09:44:05 +01:00 |
|
Brian Gough
|
f34c12fdc7
|
add endpoint to clear project state
|
2017-09-08 15:50:26 +01:00 |
|
Brian Gough
|
9d931a3fa7
|
fix broken unit tests
|
2017-08-18 12:08:39 +01:00 |
|
Brian Gough
|
230c93766d
|
fix broken RedisManager unit test
|
2017-08-18 11:59:31 +01:00 |
|
Brian Gough
|
f6be68eb08
|
added missing unit tests file
|
2017-08-11 16:49:16 +01:00 |
|
Brian Gough
|
f696ccb0d9
|
add unit tests for getProjectDocs
|
2017-08-10 16:41:28 +01:00 |
|
Brian Gough
|
ca7d9dce85
|
fix unit tests
|
2017-08-08 09:40:39 +01:00 |
|
Shane Kilkelly
|
c3465cf3d4
|
Reduce retry delay to 10ms, and refactor
|
2017-07-18 15:28:18 +01:00 |
|
Shane Kilkelly
|
0d46c3e2b3
|
WIP: auto-retry web requests
|
2017-07-17 10:08:21 +01:00 |
|
Brian Gough
|
d2730c8d6b
|
unit tests for locking timeouts
|
2017-07-12 10:48:32 +01:00 |
|
Brian Gough
|
963e513057
|
add a timeout for getPreviousDocOps
it uses several redis operations and this makes it prone to subsequent
timeouts if getDoc succeeds but is slow
|
2017-06-23 15:50:21 +01:00 |
|
James Allen
|
7d22e4422c
|
Merge pull request #49 from sharelatex/bg-add-redis-timeout
add redis timeout
|
2017-06-13 14:46:32 +01:00 |
|
James Allen
|
770b53f6af
|
Add missing mocks to speed up tests and clean up output
|
2017-06-08 16:43:27 +01:00 |
|
Brian Gough
|
1ef258c878
|
add a timeout on the redis getDoc request
|
2017-06-07 11:34:42 +01:00 |
|
Brian Gough
|
729216c9b1
|
add unit tests for DocsIn check
|
2017-05-31 16:08:45 +01:00 |
|
Brian Gough
|
bed64d26c8
|
check if doc is missing from DocsIn set
|
2017-05-31 15:33:59 +01:00 |
|
Brian Gough
|
891ffda3bf
|
put a rate limit on worker calls
|
2017-05-26 15:08:35 +01:00 |
|
Brian Gough
|
b15d2ef796
|
Revert "fail safely if doc cannot be loaded"
|
2017-05-15 16:18:40 +01:00 |
|
Paulo Jorge Reis
|
2c3f0aa6b4
|
Merge pull request #34 from sharelatex/pr-bulk-actions
Add methods to bulk accept changes.
|
2017-05-15 15:14:33 +01:00 |
|
Paulo Reis
|
05d7d1b8c6
|
Merge branch 'master' into pr-bulk-actions
|
2017-05-15 10:35:16 +01:00 |
|
Paulo Reis
|
36d16a76e0
|
Unit test accept changes in the ranges manager.
|
2017-05-12 14:42:40 +01:00 |
|
Brian Gough
|
2ee40d0748
|
ensure document is in redis before consuming ops
|
2017-05-12 14:22:18 +01:00 |
|
Brian Gough
|
d4a8d88750
|
put a limit on the number of ops per iteration
|
2017-05-12 13:15:59 +01:00 |
|
Paulo Reis
|
f690ef078a
|
Update tests; add new ones for multiple changes.
|
2017-05-09 16:16:25 +01:00 |
|
Brian Gough
|
36407ac726
|
rename HistoryManager pushUncompressedHistoryOps
|
2017-05-09 12:02:27 +01:00 |
|
Brian Gough
|
fdf5e8e0b8
|
get history ops length directly from redis update
|
2017-05-09 10:34:31 +01:00 |
|
Brian Gough
|
2d158b03d7
|
rename pushUncompressedHistoryOps
|
2017-05-09 09:32:56 +01:00 |
|
Paulo Reis
|
144804e516
|
Update tests with new methods.
|
2017-05-08 16:34:17 +01:00 |
|
Brian Gough
|
e2f70aca1a
|
fix tests for redis cluster
|
2017-05-08 16:02:49 +01:00 |
|
Brian Gough
|
79d8fced49
|
make history update more atomic
|
2017-05-08 15:58:29 +01:00 |
|
James Allen
|
4104ca4889
|
Add in separate redis config for the lock and fix a few web -> realtime
|
2017-05-03 16:27:32 +01:00 |
|
James Allen
|
ed493d8ad3
|
Rename web -> realtime for consistency with realtime
|
2017-05-02 15:38:33 +01:00 |
|
James Allen
|
c5449ae282
|
Split out redis config for real-time and track-changes into separate cluster-compatible configs
|
2017-04-13 17:00:42 +01:00 |
|
James Allen
|
f21208e841
|
Use new redis-sharelatex instead of RedisBackend for cluster abstraction
|
2017-04-12 14:53:03 +01:00 |
|
Brian Gough
|
c11618b475
|
improve unlock error handling
|
2017-03-30 15:31:34 +01:00 |
|
James Allen
|
0245bfd031
|
Support an incoming undo flag for history restores
|
2017-03-21 11:20:38 +00:00 |
|
James Allen
|
a3a5524778
|
Fix broken unit test from merge
|
2017-03-20 10:37:02 +00:00 |
|
James Allen
|
5499a67d78
|
Add in a consistency check after applying updates that ranges still match
|
2017-03-15 14:12:06 +00:00 |
|
James Allen
|
a3a9a726d8
|
Update unit tests
|
2017-03-06 12:01:18 +00:00 |
|
James Allen
|
f544814dda
|
Add in an absolute size limit on the ranges JSON object
|
2017-02-27 14:34:20 +01:00 |
|
James Allen
|
dd45a8dd7d
|
Improve logging around hashes and null byte errors
|
2017-02-27 10:06:24 +01:00 |
|
James Allen
|
60f3393c44
|
Do a naive check for null bytes after JSON.stringify on doc lines
|
2017-02-27 09:55:04 +01:00 |
|
Brian Gough
|
168bab6960
|
make hash error logging fine grained
|
2017-02-22 14:32:51 +00:00 |
|
Brian Gough
|
19e7522d3f
|
make logging of hash errors optional
|
2017-02-22 13:46:34 +00:00 |
|
Brian Gough
|
5eb339e525
|
fix utf8 encoding in sha1 hash
|
2017-02-21 16:03:06 +00:00 |
|
Brian Gough
|
62165ddeab
|
add unit tests
|
2017-02-20 15:33:19 +00:00 |
|
Brian Gough
|
c57d3ce31c
|
compute hash on write in redis server
|
2017-02-20 14:09:09 +00:00 |
|
Brian Gough
|
a3c127e469
|
added unit tests
|
2017-02-20 13:53:25 +00:00 |
|
Brian Gough
|
bd70aaa76c
|
add sha1 hash support on writes
|
2017-02-14 16:11:43 +00:00 |
|
James Allen
|
8725aeab03
|
Allow deleting of comment ranges
|
2017-01-24 15:57:11 +01:00 |
|
James Allen
|
0706feb26b
|
Add max limit on number of comments and changes per doc
|
2017-01-10 16:58:11 +01:00 |
|
James Allen
|
be19532a1d
|
Add HTTP end point for accepting changes
|
2017-01-09 14:41:18 +01:00 |
|
James Allen
|
65f4360738
|
Consolidate HttpController tests into one file
|
2017-01-09 14:34:10 +01:00 |
|
James Allen
|
2c7029cc50
|
Revert "Support a {dr:...} op for deleting ranges"
This reverts commit 24c58e5ad430e0240533cc1e5c21122859fe8dc9.
|
2017-01-09 09:24:19 +01:00 |
|
James Allen
|
0f13cb3aa7
|
Support a {dr:...} op for deleting ranges
|
2017-01-06 16:58:51 +01:00 |
|
James Allen
|
59a06cd798
|
Accept comments with thread id as an op type
|
2016-12-13 15:51:47 +00:00 |
|
James Allen
|
47b19818ff
|
Add in new comment op type
|
2016-12-12 17:53:43 +00:00 |
|
James Allen
|
e3fee1a1d1
|
Rename 'track changes entries' -> 'ranges'
|
2016-12-08 12:31:43 +00:00 |
|
James Allen
|
418405e8b9
|
Return track changes entries in HTTP request
|
2016-12-02 11:37:27 +00:00 |
|
James Allen
|
4fadd75ef3
|
Track changes based on flag on op, not global setting
|
2016-12-02 11:04:21 +00:00 |
|
James Allen
|
f43355b74d
|
Fix UpdateManager tests
|
2016-12-01 18:19:47 +00:00 |
|
James Allen
|
ce93a76e7f
|
Fix ShareJsUpdateManager tests
|
2016-12-01 18:11:03 +00:00 |
|
James Allen
|
e7ff05e792
|
Fix UpdateManager tests
|
2016-12-01 18:06:33 +00:00 |
|
James Allen
|
889f5fdf9f
|
Fix ShareJsDB tests
|
2016-12-01 17:14:40 +00:00 |
|
James Allen
|
b6c93c718d
|
Update TrackChangesManagerTests -> HistoryManagerTests
|
2016-12-01 16:50:55 +00:00 |
|
James Allen
|
d878dd5758
|
Fix RedisManagerTests
|
2016-12-01 16:49:53 +00:00 |
|
James Allen
|
9ee913be39
|
Update PersistenceManagerTests
|
2016-12-01 16:40:15 +00:00 |
|
James Allen
|
fb39e37fe0
|
Update DocumentManager tests
|
2016-12-01 16:27:40 +00:00 |
|
James Allen
|
efab68e6b2
|
Add in guards on bad data from web API
|
2016-11-29 17:13:16 +00:00 |
|
James Allen
|
546d9e9cee
|
Remove left over test
|
2016-11-29 17:13:07 +00:00 |
|
James Allen
|
2852043a6d
|
Don't store doc version in Mongo directly, instead use docstore
|
2016-11-29 17:06:23 +00:00 |
|
James Allen
|
5ce15c4d60
|
Move check of zero length op array up a level
|
2016-09-12 10:37:41 +01:00 |
|
James Allen
|
993aab7a78
|
Don't try to redis rpush with no arguments
|
2016-09-12 10:37:32 +01:00 |
|
James Allen
|
2d82d56f93
|
Process updates one at a time and write into redis after each one
|
2016-09-09 11:01:14 +01:00 |
|
James Allen
|
c85fd7ef41
|
Merge branch 'master' into ja-consistency-refactor
|
2016-09-07 11:08:04 +01:00 |
|
Brian Gough
|
9bc7594226
|
clean up redis query
|
2016-09-05 10:31:54 +01:00 |
|
James Allen
|
8779f3f686
|
Only write DocOps atomically with version and lines, after all docs are applied
|
2016-08-23 16:00:46 +01:00 |
|
James Allen
|
87f3e5e809
|
Remove old migration code
|
2016-08-23 11:03:37 +01:00 |
|
James Allen
|
1c62a1c5a1
|
Don't propagate error on secondary timeout
|
2016-07-07 09:46:15 +01:00 |
|
James Allen
|
59883023ca
|
Ignore different order of results from smembers
|
2016-07-06 14:24:27 +01:00 |
|
James Allen
|
89f90c1b04
|
Timeout secondary requests if they take longer than 200ms
|
2016-07-06 12:25:36 +01:00 |
|
James Allen
|
508a95c19b
|
Use the main redis instance for locks
|
2016-07-06 11:50:02 +01:00 |
|
James Allen
|
dfd45bd23c
|
Add timers to time how long each redis request takes
|
2016-07-04 11:14:23 +01:00 |
|
James Allen
|
fde334acc4
|
Create script that will ensure data is migrate between redis backends
|
2016-06-29 12:57:56 +01:00 |
|
James Allen
|
dbe03e2757
|
Track metrics of when backends match or disagree
|
2016-06-28 16:49:15 +01:00 |
|
James Allen
|
e04c946ecd
|
Fix unit tests
|
2016-06-23 18:04:26 +01:00 |
|
James Allen
|
da89ff7172
|
Add in external health check rather than internal
|
2016-06-23 18:00:03 +01:00 |
|
James Allen
|
414ab5d6a9
|
Refactor TCP redis monitoring to be more explicit
|
2016-06-23 15:59:25 +01:00 |
|
James Allen
|
8ef03c3d2f
|
Add in application layer monitoring of the health of each cluster node
|
2016-06-23 15:38:51 +01:00 |
|
James Allen
|
bc00aab7b1
|
Explicitly separate calls to web and docupdater redis instances
|
2016-06-17 12:17:22 +01:00 |
|