23 commits

Author	SHA1	Message	Date
Brian Gough	92e0b0f04c	add logging to each stage of archiving	2015-09-24 09:10:06 +01:00
Brian Gough	692e8c657c	Revert to the default lock timeout now we have write barriers ... Revert "increase lock timeouts for archiving" This reverts commit 9eee1b383772adf058130d6e5eab409f57ce03cd.	2015-09-24 08:53:09 +01:00
Brian Gough	dc0044020f	only archive entries older than the current update ... to avoid a stale version of the current update ever being pulled back from S3	2015-09-23 14:33:40 +01:00
Brian Gough	847a553344	prevent double archiving by checking if any inS3 field is already present	2015-09-23 13:29:32 +01:00
Brian Gough	e49f260507	allow rollback/locking by setting inS3:false when starting the archive process	2015-09-23 13:28:07 +01:00
Brian Gough	7af5050370	add lock to unarchive doc	2015-09-16 16:18:36 +01:00
Brian Gough	18f06a3daf	increase lock timeouts for archiving	2015-09-16 16:09:38 +01:00
Brian Gough	b4ffa7d57e	share the document lock between archiving and packing	2015-09-16 16:03:55 +01:00
Brian Gough	1c1b1d9595	log the case where there are no entries in the document history	2015-09-16 15:34:30 +01:00
Brian Gough	82d0f4fce8	make unarchive more responsive by downloading documents in parallel ... unarchive is triggered interactively so we should try to make it reasonably fast	2015-09-16 15:33:59 +01:00
Henry Oswald	18d817ee0a	added some missing error handling	2015-09-08 16:33:45 +01:00
Henry Oswald	17b0d99a65	rework the archiveDocChangesWithLock function ... make it a bit more readable for me, struggle to trust indentation based calls in coffeescript	2015-09-08 16:26:01 +01:00
Henry Oswald	0b3ebcff06	remove if statments checking if s3 is a backend ... if its not enable then it can crash. In prod it should always be there or not used at all	2015-09-08 16:23:15 +01:00
Henrique Dias	da9e7dc7e1	init archive acceptance tests	2015-09-02 18:47:34 -03:00
Henrique Dias	1ccba422c8	remove unused function	2015-08-24 10:55:27 -03:00
Henrique Dias	98ce03b2f2	replace docs collection to DocstoreHandler	2015-08-24 10:38:31 -03:00
Henrique Dias	fd4afb3574	Archive changes, care about: versioin, expiresAt and Lock	2015-08-14 15:07:16 -03:00
Henrique Dias	6bc9c9010a	handle auto unarchive track changes	2015-08-09 19:52:32 -03:00
Henrique Dias	3bc5380468	handle inS3 flag	2015-08-09 17:50:15 -03:00
Henrique Dias	daa42bcea0	change s3Stream lib	2015-08-09 15:47:47 -03:00
Henrique Dias	bca48ac117	add unarchive doc track from s3	2015-08-06 17:09:36 -03:00
Henrique Dias	438c4f4d0c	using mongoexport for s3 archive	2015-08-06 15:46:44 -03:00
Henrique Dias	028fe2fa03	archive docChanges list to s3	2015-08-06 11:11:43 -03:00