625 commits

Author	SHA1	Message	Date
James Allen	953081c39d	Delete updates that are older than a week, unless versioning or preserveHistory is enabled	2014-03-28 16:01:34 +00:00
James Allen	9f1efe6dca	Add in getProjectDetails to WebApiManager	2014-03-28 13:05:16 +00:00
James Allen	22e3aac5b0	Don't trip up over empty ops	2014-03-25 11:40:48 +00:00
James Allen	bd4bb3d3cf	Add in project flushing end point	2014-03-21 15:57:17 +00:00
James Allen	8cae726838	Backport project_id onto doc updates that don't have one yet	2014-03-21 14:40:51 +00:00
James Allen	2cd85fefec	Flush all docs in a project before getting updates	2014-03-21 13:48:14 +00:00
James Allen	cd9cb51027	Delete doc_id from DocsWithHistoryOps set when processing	2014-03-21 13:17:58 +00:00
James Allen	6aaa7ba8d5	Group toV and fromV by the doc they correspond to	2014-03-20 13:37:23 +00:00
James Allen	5595910122	Return a summary of the entire project changes	2014-03-20 12:10:04 +00:00
James Allen	b7de4c9c6c	Implement project update getter methods	2014-03-19 17:44:16 +00:00
James Allen	962fc18329	Store project_id alongside each change	2014-03-19 16:40:55 +00:00
James Allen	fec648666c	Add in project_id to flushing HTTP endpoint	2014-03-19 16:14:17 +00:00
James Allen	d32b0ee12f	Fetch updates up to the limit, even after summarising	2014-03-18 18:09:25 +00:00
James Allen	81811d7cc5	Move update summarizing logic into UpdatesManager	2014-03-18 11:41:48 +00:00
James Allen	22a806a200	Fix issues with consuming delete updates beyond the end of the diff	2014-03-17 14:54:02 +00:00
James Allen	540aaf0672	Add in some null checks	2014-03-13 14:30:01 +00:00
James Allen	9977a418c3	Compare diffs with user.id, not user_id	2014-03-12 14:04:33 +00:00
James Allen	575afae048	Compress adjacent inserts and deletes into one diff item	2014-03-12 13:27:18 +00:00
James Allen	7fa88f6b41	Summarise updates when returning them	2014-03-11 17:40:07 +00:00
James Allen	4ecb17b16e	Put multiple ops in one update	2014-03-11 15:24:38 +00:00
James Allen	064bdc3eea	Take user id in from request header and pass to doc updater	2014-03-11 13:01:07 +00:00
James Allen	3d1d962501	Don't try to fetch user when id doesn't exist	2014-03-11 11:45:25 +00:00
James Allen	83b2aa3082	add in restore end point	2014-03-10 16:58:39 +00:00
James Allen	7eb8699b93	Refactor diff manager	2014-03-10 16:03:03 +00:00
James Allen	866084ee6b	Pop last version, not last timestamp	2014-03-07 14:02:16 +00:00
James Allen	b45db3aa2b	Return user details like email and name in updates	2014-03-06 18:04:00 +00:00
James Allen	5fc139db00	Return version numbers of updates	2014-03-06 11:00:49 +00:00
James Allen	aadce232a1	Use version numbers for sorting and querying, not dates	2014-03-06 10:45:51 +00:00
James Allen	2e1307bd82	Doc is always one version ahead of latest op version	2014-03-05 16:31:38 +00:00
James Allen	3660253fd4	Add in /updates end point to get updates	2014-03-05 15:59:40 +00:00
James Allen	a46963a349	Refactor arguments to MongoManager.getUpdatesBetweenDates	2014-03-05 15:06:46 +00:00
James Allen	188d620ce1	Log out and put the last update back when an error occurs	2014-03-05 13:22:38 +00:00
James Allen	e4d8cc7a11	Add in acceptance tests for getting a diff	2014-03-04 15:27:03 +00:00
James Allen	8b71d222d4	Create DiffManager.getDiff	2014-03-04 14:05:17 +00:00
James Allen	1d1dcdfa2f	Add in methods for retrieving updates and doc version	2014-03-04 13:02:48 +00:00
James Allen	20d70859aa	Create buildDiff function	2014-03-03 17:39:59 +00:00
James Allen	8d044b7f13	Fix acceptance tests	2014-03-03 13:36:05 +00:00
James Allen	ba2c4768d0	Use port 3015 by default	2014-03-03 13:31:10 +00:00
James Allen	c15df4c2aa	Add in /status end point	2014-03-03 13:14:01 +00:00
James Allen	e0402692cf	Add in diff generating functions	2014-03-01 13:31:34 +00:00
James Allen	76cdd5cf98	Delete only the updates that were processed, not a full batch	2014-03-01 11:42:31 +00:00
James Allen	d1e18d82aa	Add simple benchmark script	2014-02-26 17:35:10 +00:00
James Allen	3570e8f408	Use grunt forever to run service daemonized for acceptance testing on travis	2014-02-26 16:44:13 +00:00
James Allen	53db11466b	Fix YAML	2014-02-26 16:39:58 +00:00
James Allen	cef17a7fbc	Experiment with acceptance tests in Travis	2014-02-26 16:36:53 +00:00
James Allen	6e9485c0c4	Add README and LICENSE	2014-02-26 16:29:14 +00:00
James Allen	1e7fc3dc29	Add Travis CI	2014-02-26 16:27:09 +00:00
James Allen	834f41eea1	Remove Rakefile	2014-02-26 16:17:26 +00:00
James Allen	ad18c1d5a5	Add Gruntfile	2014-02-26 16:17:15 +00:00
James Allen	a21f8a8004	Add acceptance test for batch processing	2014-02-26 12:44:13 +00:00
James Allen	80af34895b	Refactor and improve acceptance tests	2014-02-26 12:38:47 +00:00
James Allen	d27872c9bd	Get acceptance tests running	2014-02-26 12:11:45 +00:00
James Allen	45fe6978af	Add in /doc/<doc-id>/flush endpoint	2014-02-26 11:34:56 +00:00
James Allen	65360a9a2b	Continue to process raw updates until redis is empty	2014-02-26 11:18:26 +00:00
James Allen	8405a37c2c	Add a lock around processing updates	2014-02-26 10:55:20 +00:00
James Allen	f33a3bde3e	Create processUncompressedUpdates method	2014-02-25 16:48:42 +00:00
James Allen	34d3847fe4	Add Redis Manager for fetching and deleting uncompressed ops	2014-02-25 16:27:14 +00:00
James Allen	8ae9bcd60f	Ensure that updates are compressed in continuous incrementing order	2014-02-25 12:28:15 +00:00
James Allen	de783bf5b0	Pull out MongoManager module and add tests	2014-02-24 17:43:27 +00:00
James Allen	d040e7c410	Add acceptance tests for multiple appends	2014-01-27 18:20:38 +00:00
James Allen	d4295c2023	Create HttpController for HTTP requestS	2014-01-27 18:09:37 +00:00
James Allen	5dea123b13	Get append end point working with a simple acceptance test	2014-01-27 17:51:09 +00:00
James Allen	533b8e59a3	Big refactor to use better names and separation of concerns	2014-01-27 16:26:58 +00:00
James Allen	8a0aa55c91	Refactor to take doc ops from an HTTP request from doc updater	2013-09-03 17:17:27 +01:00
James Allen	dab2781e87	Do two passes better	2013-08-23 14:58:00 +01:00
James Allen	dbee4a57fb	Compress doc ops in two passes	2013-08-23 14:35:13 +01:00
James Allen	bef05c31f4	No need to print the entire history each time	2013-08-09 13:54:30 +01:00
James Allen	7a3b78da43	Return when calling callback	2013-08-09 13:51:02 +01:00
James Allen	07f078b527	Don't insert a null update if there are no updates or raw updates	2013-08-09 13:46:03 +01:00
James Allen	fe503010aa	Pop and set history in batches for speed	2013-08-09 13:27:35 +01:00
James Allen	3ab45c2a35	Handle if two updates cancel each other	2013-08-09 12:36:17 +01:00
James Allen	54c7959647	Match if both user ids are null/undefined	2013-08-09 12:26:23 +01:00
James Allen	64eb794c02	Compress all docs using compressHistory script	2013-08-09 11:36:19 +01:00
James Allen	c5e7f14ba1	Factor methods out into ConversionManager	2013-08-09 11:10:19 +01:00
James Allen	7e96933cf2	Initial commit of script for compressing one docs history	2013-08-08 16:42:14 +01:00