534 commits

Author	SHA1	Message	Date
Brian Gough	03564b2138	fix variable zip.minsize to match config name zip.minSize	2015-03-27 17:00:30 +00:00
Brian Gough	66fa170ac8	disable compression by default	2015-03-27 15:32:13 +00:00
Brian Gough	6bffa4d9e0	don't log docLines when document removed from redis ... they can now be binary gzipped data which messes up the logs	2015-03-25 16:54:36 +00:00
Brian Gough	e3d73d4456	add gzip support for large documents to reduce load on redis	2015-03-25 16:53:20 +00:00
James Allen	c822bb6ea4	Add in missed error catching	2014-11-19 12:51:19 +00:00
Henry Oswald	5ff8983528	implemeneted redis-sharelatex	2014-10-07 12:08:36 +01:00
Henry Oswald	9c85e9b848	moved back to not include sentinal while we upgrade to 0.10.x node	2014-09-29 12:07:32 +01:00
Henry Oswald	672dd3de1b	works with sentinal v1	2014-09-26 17:38:59 +01:00
James Allen	9da118c809	Process updates in the background so that workers only act as dispatchers	2014-08-11 14:16:05 +01:00
James Allen	773e17df66	Send worker idle waiting times to statsd	2014-08-07 13:16:11 +01:00
James Allen	cab5509076	Listen on queue via BLPOP rather than pub/sub	2014-08-07 11:45:53 +01:00
James Allen	ffd10a8439	Don't send or get versioning info to/from web ... The version number is only used by the doc updater and so can be cleanly encapsulated in a collection that only the doc updater knows about. The version is already stored under docOps, so continue to tore it there.	2014-05-15 11:13:16 +01:00
James Allen	e25fb7e435	Keeping writing and reading updates from Mongo to cover the deploy period	2014-05-14 16:04:25 +01:00
James Allen	bdfe018cad	Log out warning when using Mongo for version still	2014-05-14 14:16:27 +01:00
James Allen	0199f2e129	Use version from web, with fallback to old mongo collection	2014-05-14 13:28:17 +01:00
James Allen	8973969224	Merge branch 'master' into remove_mongo_doc_ops ... Conflicts: app/coffee/DocOpsManager.coffee test/acceptance/coffee/ApplyingUpdatesToADocTests.coffee test/acceptance/coffee/FlushingDocsTests.coffee test/unit/coffee/DocOpsManager/DocOpsManagerTests.coffee test/unit/coffee/RedisManager/prependDocOpsTests.coffee test/unit/coffee/RedisManager/pushDocOpTests.coffee	2014-05-14 12:39:40 +01:00
James Allen	6011ce4783	Use new metrics module	2014-05-08 09:28:13 +01:00
James Allen	d1434f7646	Increase redis lock expiry time to 30 seconds	2014-05-07 09:48:29 +01:00
James Allen	c2ebaaa338	Split lines on Windows line endings too	2014-04-10 12:44:46 +01:00
James Allen	375427bf5e	Remove extraneous logging	2014-03-21 13:15:42 +00:00
James Allen	c0be3ef37b	Put doc_ids with history changes into project level set	2014-03-21 12:41:05 +00:00
James Allen	2d28f1903f	Flush to the track changes api using the project id as well	2014-03-19 15:56:44 +00:00
James Allen	4f878e000b	Allow source and user_id to be included when setting a document	2014-03-11 12:47:26 +00:00
James Allen	5d45e191f3	Don't crash when logging out error	2014-03-04 12:39:02 +00:00
James Allen	86195ce7c3	Add in load throttling based on a redis key	2014-02-28 19:09:29 +00:00
James Allen	3d70f9126e	Flush track changes api every 50 updates	2014-02-28 18:29:05 +00:00
James Allen	f3192da87f	Tell track changes api to flush doc when flushing doc to mongo	2014-02-26 15:56:52 +00:00
James Allen	dfd3ec993b	Ensure version is still returned from redis	2014-02-26 14:49:52 +00:00
James Allen	b13f70eadb	Push ops into uncompressedHistoryOps list	2014-02-24 16:52:12 +00:00
James Allen	6f19f46d96	Create method for pushing uncompressed ops into redis	2014-02-24 16:40:29 +00:00
James Allen	7a977ca597	Don't store ops in Mongo, just keep them in redis with a timeout	2014-02-24 16:13:36 +00:00
James Allen	414b669a2c	Point every redis connection to the new config	2014-02-13 10:36:26 +00:00
James Allen	a5d816272e	Remove unused DocumentUpdater.js file	2014-02-12 10:52:53 +00:00
James Allen	e1a7d4f24a	Initial open sourcing	2014-02-12 10:40:42 +00:00