97 commits

Author	SHA1	Message	Date
Brian Gough	775f5ebbe1	add configurable limit, delay and timeout to /pack via query string	2015-06-05 13:38:47 +01:00
Brian Gough	23d2518ebb	added a /pack endpoint to fork a pack worker	2015-06-04 16:36:56 +01:00
Brian Gough	289616d3db	added a /doc/:doc_id/pack endpoint	2015-06-04 16:23:49 +01:00
Brian Gough	3f2e4b0c11	move pack script functionality into PackManager	2015-06-04 16:21:40 +01:00
Brian Gough	27a3511b37	update docHistoryStats after packing ops	2015-06-03 10:36:07 +01:00
Brian Gough	19d812734e	make PackManager parameters configurable	2015-06-03 10:35:36 +01:00
Brian Gough	66bca8d05c	include the current date in the updates to docHistoryStats	2015-05-26 11:00:55 +01:00
Brian Gough	1811ac2145	added support for cleaning old expired ops in packs	2015-05-22 15:40:02 +01:00
Brian Gough	5c4afd5303	add docHistoryStats collection to keep track of updates to docs	2015-05-22 15:40:01 +01:00
Brian Gough	78f0bdbae3	fix name of temporary parameter to match other methods	2015-05-22 15:40:01 +01:00
Brian Gough	adc2866a7d	add check to exclude temporary ops from packs	2015-05-22 15:40:01 +01:00
Brian Gough	ffeb1cccb6	move pack migration code into PackManager	2015-05-22 15:40:01 +01:00
Brian Gough	4c0eea9916	return an error if trying to pop the last update from a pack	2015-02-17 14:53:50 +00:00
Brian Gough	24701219ff	clean up comments and remove console.logs	2015-02-17 13:47:55 +00:00
Brian Gough	76cbf32e6a	cleanup ... remove unnecessary comments, whitespace and unused modules	2015-02-17 13:41:31 +00:00
Brian Gough	448a7b7f36	rename MongoPackManager to PackManager	2015-02-17 11:14:13 +00:00
Brian Gough	92e67511d5	sort by doc_id to ensure consistent order for all changes with the same timestamp	2015-02-16 16:44:06 +00:00
Brian Gough	fa1e890282	move update deduplication to filterAndLimit method	2015-02-16 15:37:47 +00:00
Brian Gough	0516e9429d	ensure document results are in version order	2015-02-16 13:43:27 +00:00
Brian Gough	8615b7a086	fix project results order, sort by time	2015-02-16 13:43:11 +00:00
Brian Gough	4f36ccd519	moved pack code into MongoPackManager	2015-02-13 16:18:15 +00:00
Brian Gough	682e8e8ab6	add a sparse mongo index for finding packs	2015-02-10 16:54:58 +00:00
Brian Gough	1d7f0919a4	fix mongo logic for project search with packs	2015-02-10 16:54:45 +00:00
Brian Gough	7fdce8fc48	split pack handling code into separate parts for docs and projects ... need to debug projects	2015-02-09 16:53:44 +00:00
Brian Gough	d8dc56b031	don't try to getLastCompressedUpdates from packs	2015-02-09 16:53:05 +00:00
Brian Gough	f50f091fc6	added comments	2015-02-06 16:59:09 +00:00
Brian Gough	e47476369a	clean up docHistory pack decoding	2015-02-06 15:04:46 +00:00
Brian Gough	8e810bab14	report error for inconsistent history results	2015-02-05 16:37:06 +00:00
Brian Gough	715b0df4a1	prototype for expanding packs	2015-02-05 16:36:41 +00:00
Henry Oswald	a0bb289fd3	works with sentinal v1	2014-09-26 17:21:33 +01:00
James Allen	eb7bcc6922	Remove old history deletion method	2014-05-29 15:37:16 +01:00
James Allen	cc962e1c44	Add indexes in background	2014-05-16 17:00:30 +01:00
James Allen	6a371c267f	Fix indexes	2014-05-16 16:41:40 +01:00
James Allen	29ad81c134	Use expiresAt rather than tempCreatedAt	2014-05-16 16:41:14 +01:00
James Allen	8b0b79bc32	Use TTL index to auto-delete updates after a week when versioning is not enabled	2014-05-16 15:59:12 +01:00
James Allen	24343a38cd	Add error handling of mismatched versions back in	2014-05-01 10:26:01 +01:00
James Allen	eebfa6499e	Be more forgiving with version mismatches	2014-04-15 08:02:49 +01:00
James Allen	953081c39d	Delete updates that are older than a week, unless versioning or preserveHistory is enabled	2014-03-28 16:01:34 +00:00
James Allen	9f1efe6dca	Add in getProjectDetails to WebApiManager	2014-03-28 13:05:16 +00:00
James Allen	22e3aac5b0	Don't trip up over empty ops	2014-03-25 11:40:48 +00:00
James Allen	bd4bb3d3cf	Add in project flushing end point	2014-03-21 15:57:17 +00:00
James Allen	8cae726838	Backport project_id onto doc updates that don't have one yet	2014-03-21 14:40:51 +00:00
James Allen	2cd85fefec	Flush all docs in a project before getting updates	2014-03-21 13:48:14 +00:00
James Allen	cd9cb51027	Delete doc_id from DocsWithHistoryOps set when processing	2014-03-21 13:17:58 +00:00
James Allen	6aaa7ba8d5	Group toV and fromV by the doc they correspond to	2014-03-20 13:37:23 +00:00
James Allen	5595910122	Return a summary of the entire project changes	2014-03-20 12:10:04 +00:00
James Allen	b7de4c9c6c	Implement project update getter methods	2014-03-19 17:44:16 +00:00
James Allen	962fc18329	Store project_id alongside each change	2014-03-19 16:40:55 +00:00
James Allen	d32b0ee12f	Fetch updates up to the limit, even after summarising	2014-03-18 18:09:25 +00:00
James Allen	81811d7cc5	Move update summarizing logic into UpdatesManager	2014-03-18 11:41:48 +00:00