152 commits

Author	SHA1	Message	Date
Henrique Dias	98ce03b2f2	replace docs collection to DocstoreHandler	2015-08-24 10:38:31 -03:00
Henrique Dias	04ec45529f	restore updates from S3 when exists ... fix: avoid rearchiving	2015-08-18 17:11:19 -03:00
Henrique Dias	20c3e15f93	fix bulk insert limit	2015-08-14 19:58:38 -03:00
Henrique Dias	26c8048729	change mongo stream method (still have a bug in bulk insert limit)	2015-08-14 19:19:54 -03:00
Henrique Dias	fd4afb3574	Archive changes, care about: versioin, expiresAt and Lock	2015-08-14 15:07:16 -03:00
Henrique Dias	6bc9c9010a	handle auto unarchive track changes	2015-08-09 19:52:32 -03:00
Henrique Dias	3bc5380468	handle inS3 flag	2015-08-09 17:50:15 -03:00
Henrique Dias	daa42bcea0	change s3Stream lib	2015-08-09 15:47:47 -03:00
Henrique Dias	bca48ac117	add unarchive doc track from s3	2015-08-06 17:09:36 -03:00
Henrique Dias	438c4f4d0c	using mongoexport for s3 archive	2015-08-06 15:46:44 -03:00
Henrique Dias	028fe2fa03	archive docChanges list to s3	2015-08-06 11:11:43 -03:00
Henrique Dias	ae047ecf76	init s3 feature	2015-08-06 10:00:09 -03:00
Brian Gough	775f5ebbe1	add configurable limit, delay and timeout to /pack via query string	2015-06-05 13:38:47 +01:00
Brian Gough	76d1350593	fix unit tests ... packManager now uses LockManager, which tries to talk to redis and needs to be replaced by a stub in the unit tests.	2015-06-05 10:59:46 +01:00
Brian Gough	23d2518ebb	added a /pack endpoint to fork a pack worker	2015-06-04 16:36:56 +01:00
Brian Gough	289616d3db	added a /doc/:doc_id/pack endpoint	2015-06-04 16:23:49 +01:00
Brian Gough	3f2e4b0c11	move pack script functionality into PackManager	2015-06-04 16:21:40 +01:00
Brian Gough	8668bb9be1	use docHistoryStats to drive the packing script	2015-06-03 10:36:31 +01:00
Brian Gough	27a3511b37	update docHistoryStats after packing ops	2015-06-03 10:36:07 +01:00
Brian Gough	19d812734e	make PackManager parameters configurable	2015-06-03 10:35:36 +01:00
Brian Gough	2521c8f751	added npm packages for pack.coffee script	2015-05-26 14:14:51 +01:00
Brian Gough	66bca8d05c	include the current date in the updates to docHistoryStats	2015-05-26 11:00:55 +01:00
Brian Gough	1811ac2145	added support for cleaning old expired ops in packs	2015-05-22 15:40:02 +01:00
Brian Gough	5c4afd5303	add docHistoryStats collection to keep track of updates to docs	2015-05-22 15:40:01 +01:00
Brian Gough	78f0bdbae3	fix name of temporary parameter to match other methods	2015-05-22 15:40:01 +01:00
Brian Gough	adc2866a7d	add check to exclude temporary ops from packs	2015-05-22 15:40:01 +01:00
Brian Gough	ffeb1cccb6	move pack migration code into PackManager	2015-05-22 15:40:01 +01:00
Brian Gough	8d3e0b2353	added consistency check to pack migration script	2015-05-21 15:46:29 +01:00
Henry Oswald	b37d0dd08a	make startup message consistent	2015-04-30 15:07:11 +01:00
James Allen	24319f6d50	Release version 0.1.4	2015-03-20 15:27:34 +00:00
James Allen	79b9c48efd	Release version 0.1.3	2015-02-26 11:35:14 +00:00
Brian Gough	34fa398cf6	increase pack migrate delay to 2 seconds	2015-02-23 17:00:54 +00:00
Brian Gough	09e24413e6	fix pack migration to run sequentially not in parallel	2015-02-23 17:00:43 +00:00
Brian Gough	ff7860b6dc	added a time delay to the pack migration script	2015-02-23 14:10:09 +00:00
Brian Gough	b19f3835d5	added checkpointing and logging to pack script	2015-02-23 12:13:38 +00:00
Brian Gough	4c0eea9916	return an error if trying to pop the last update from a pack	2015-02-17 14:53:50 +00:00
Brian Gough	24701219ff	clean up comments and remove console.logs	2015-02-17 13:47:55 +00:00
Brian Gough	76cbf32e6a	cleanup ... remove unnecessary comments, whitespace and unused modules	2015-02-17 13:41:31 +00:00
Brian Gough	f69f6452e9	Merge remote-tracking branch 'origin/master' into support-packs	2015-02-17 13:38:30 +00:00
Brian Gough	448a7b7f36	rename MongoPackManager to PackManager	2015-02-17 11:14:13 +00:00
Brian Gough	92e67511d5	sort by doc_id to ensure consistent order for all changes with the same timestamp	2015-02-16 16:44:06 +00:00
Brian Gough	7d6811559c	test pack for getDocUpdates with time	2015-02-16 16:43:27 +00:00
Brian Gough	e55f2a0ff7	test pack for getDocUpdates with version	2015-02-16 15:59:58 +00:00
Brian Gough	f5a9184b57	update the tests to work with packs	2015-02-16 15:38:40 +00:00
Brian Gough	fa1e890282	move update deduplication to filterAndLimit method	2015-02-16 15:37:47 +00:00
Brian Gough	0516e9429d	ensure document results are in version order	2015-02-16 13:43:27 +00:00
Brian Gough	8615b7a086	fix project results order, sort by time	2015-02-16 13:43:11 +00:00
Brian Gough	3ab8238013	update mongojs version to allow use of bulk updates	2015-02-13 17:01:55 +00:00
Brian Gough	18b34d1bcb	clean up packing script	2015-02-13 17:01:37 +00:00
Brian Gough	cafda57710	command-line packing script	2015-02-13 16:23:36 +00:00