475 commits

Author	SHA1	Message	Date
Hayden Faulds	52d6b710bd	add ability to resync project structure	2018-03-02 15:01:53 +00:00
James Allen	939eaa2d4b	Don't allow a document to be loaded without a pathname	2018-03-02 10:02:49 +00:00
Hayden Faulds	5a11332aa3	remove unecessary method wrapping	2018-02-22 10:17:59 +00:00
Hayden Faulds	0f87ae1f74	simplify comments	2018-02-22 10:16:29 +00:00
Hayden Faulds	ea0dd9700b	reduce the number of times we flush project history	2018-02-22 10:01:05 +00:00
James Allen	3d5740fd7d	Merge pull request #18 from sharelatex/msw-flush-project-ops ... Flush project structure changes every 500	2018-02-16 10:30:00 +00:00
James Allen	5425fdef8a	update to 1.0.1 build scripts	2018-02-15 16:54:21 +00:00
James Allen	657da70d45	Fix unit test namespacing from mocha upgrade	2018-02-15 16:28:58 +00:00
James Allen	5d1659457e	Update to build 1.0.0 build scripts	2018-02-15 16:28:40 +00:00
James Allen	f6c79f3203	Fix and extend unit tests	2018-02-15 15:55:12 +00:00
Michael Walker	6c57317f8d	Add a test that sending too few updates does not flush history	2018-01-31 11:41:08 +00:00
Michael Walker	241d1b27d5	Remove _shouldFlushHistoryOps wrapper	2018-01-31 11:27:40 +00:00
Michael Walker	772ee4083a	Turn a unit test into an acceptance test	2018-01-31 11:17:56 +00:00
Michael Walker	bdaa2ffa77	Add an acceptance test for flushing project changes	2018-01-26 14:41:47 +00:00
Michael Walker	d2865f0650	Correctly count project_ops_length	2018-01-26 14:41:28 +00:00
Michael Walker	3028fb9c3d	Only flush project updates when crossing the threshold	2018-01-24 11:57:03 +00:00
Michael Walker	24c74db0dc	Flush project changes when queue hits limit	2018-01-23 11:18:20 +00:00
Michael Walker	3d313ebc53	Add method to get number of queued project updates	2018-01-23 11:10:54 +00:00
James Allen	ccf6cb1a18	Provide hosts as environment settings, add npm run start script and update coffeescript	2017-12-29 08:13:16 +00:00
Brian Gough	0b583dd4e6	fix log message	2017-12-20 13:27:10 +00:00
Brian Gough	a8b14552c0	allow flush to succeed when doc is already deleted	2017-12-19 12:27:57 +00:00
Brian Gough	41f15c4fa8	fix unit test	2017-12-14 14:46:27 +00:00
Brian Gough	947e18eccf	Merge branch 'bg-limit-ops-in-lock'	2017-12-14 14:26:44 +00:00
James Allen	6abf9c227d	Calculate and send doc length before each update	2017-12-11 17:26:32 +00:00
Hayden Faulds	bd45fcb5f8	Merge pull request #12 from sharelatex/hof-version-entity-creation ... version entity creation; Connects to sharelatex/web-sharelatex-internal#104	2017-11-24 10:02:51 +00:00
Brian Gough	fb572670cd	Merge pull request #11 from sharelatex/bg-use-separate-flush-count-for-projects ... use a separate parameter for doc and project flush	2017-11-21 13:54:03 +00:00
Brian Gough	0bb9f147aa	fix whitespace	2017-11-13 11:56:08 +00:00
Brian Gough	a4bbf5cf52	use a separate parameter for doc and project flush	2017-11-13 11:53:39 +00:00
Hayden Faulds	d0e56e5054	add acceptance tests for entity additions	2017-11-10 15:01:37 +00:00
Hayden Faulds	a3420b1236	version entity additions	2017-11-10 14:54:56 +00:00
Hayden Faulds	944e633bac	add acceptance test for entity renaming	2017-11-08 09:20:38 +00:00
Hayden Faulds	7e86afe55e	version file renames	2017-11-08 09:20:38 +00:00
Hayden Faulds	6d571e6d23	version document renames	2017-11-08 09:20:37 +00:00
Hayden Faulds	b8052e7612	allow settings.redis.project_history to be undefined	2017-10-25 13:56:38 +01:00
Hayden Faulds	5b7be93c79	Merge pull request #2 from sharelatex/hof-doc-pathname ... Add metadata to updates for history	2017-10-25 13:13:00 +01:00
Brian Gough	e590543e42	Merge pull request #4 from sharelatex/bg-fix-listen-in-acceptance-tests ... exit if mock servers fail to start	2017-10-25 09:13:48 +01:00
Brian Gough	f3098f7470	upgrade ioredis to 3.2.1 via redis-sharelatex	2017-10-24 12:20:14 +01:00
Brian Gough	367ed1e941	Merge pull request #8 from sharelatex/bg-upgrade-to-node-6x ... upgrade to node 6.9.5	2017-10-24 11:11:23 +01:00
Brian Gough	56fd6e3d48	upgrade to node 6.9.5	2017-10-24 11:08:20 +01:00
Brian Gough	d9d58393d7	remove unused ioredis package ... it is loaded from redis-sharelatex, not here.	2017-10-24 10:39:00 +01:00
Hayden Faulds	d1f0c4ceae	add acceptance tests for project history API	2017-10-24 09:06:23 +01:00
Brian Gough	14f3d22071	upgrade to latest async ^2.5.0	2017-10-23 16:02:24 +01:00
Brian Gough	20655b6eeb	remove unused requires of async	2017-10-23 15:59:32 +01:00
Hayden Faulds	04ecd1e7ee	set pathname in acceptance tests	2017-10-23 15:32:25 +01:00
Hayden Faulds	be41a1614d	decorate ops with pathname and doc_length	2017-10-23 15:32:25 +01:00
Hayden Faulds	962520fca8	flush track-changes and project-history in HistoryManager	2017-10-23 15:32:25 +01:00
Hayden Faulds	d003aef31c	conditionally enqueue history updates for project	2017-10-23 15:32:25 +01:00
Hayden Faulds	c27df0bfef	split apart multi and rclient in tests	2017-10-23 14:24:23 +01:00
Hayden Faulds	81f998afe9	return pathname from DocumentManager.getDoc	2017-10-23 14:23:21 +01:00
Hayden Faulds	748315aadc	handle pathname in DocumentManager.getDoc	2017-10-23 14:23:21 +01:00
Hayden Faulds	cbdace7386	store pathname in Redis cache	2017-10-23 14:23:21 +01:00
Hayden Faulds	05b93a629a	return pathname from PersistenceManager	2017-10-23 14:17:14 +01:00
Brian Gough	02d3d1bd17	fix unit tests ... timekeeper must be called before SandboxedModule.require	2017-10-23 14:02:53 +01:00
Brian Gough	7c2a28c161	fix use of timekeeper in unit tests	2017-10-23 13:33:14 +01:00
Brian Gough	4d82f1432a	Merge pull request #5 from sharelatex/bg-upgrade-ioredis-to-3x ... update to ioredis 3	2017-10-23 13:27:02 +01:00
Brian Gough	448f131011	exit if mock servers fail to start	2017-10-20 14:56:12 +01:00
Joe Green	3df2d60948	Update Jenkinsfile	2017-10-16 14:14:06 +01:00
Joe Green	d387f979bc	only alert on master	2017-10-12 16:53:31 +01:00
Brian Gough	3954ecf85e	add missing timekeeper package	2017-10-12 11:23:24 +01:00
Brian Gough	08f0c67cbf	Merge pull request #3 from sharelatex/bg-auto-doc-flush ... add unflushed time to doc in redis; connects to overleaf/sharelatex#190	2017-10-12 10:55:54 +01:00
Brian Gough	79c276ea77	update to ioredis 3	2017-10-11 17:00:01 +01:00
Brian Gough	727a534d01	keep the existing GET method temporarily ... to avoid any problems due to deployment in the wrong order	2017-10-11 15:44:35 +01:00
Brian Gough	7cbb3e7af8	change getProjectDocs endpoint from GET to POST ... also note that it flushes docs if they are considered old (i.e. not recently flushed)	2017-10-11 15:30:29 +01:00
Brian Gough	8d3f82360c	update DocumentManager.getDoc signature ... keep alreadyLoaded flag at the end for consistency	2017-10-11 14:25:33 +01:00
Brian Gough	2bbbf3c005	add unflushed time to doc in redis	2017-10-06 12:34:28 +01:00
James Allen	340aa98de5	Add OSS syncing task	2017-10-04 11:27:19 +01:00
Brian Gough	ad745f133d	Merge pull request #59 from sharelatex/bg-reset-project-state ... add endpoint to clear project state	2017-09-13 10:39:47 +01:00
Brian Gough	3842a27278	change .../clear endpoint to .../clearState	2017-09-12 11:39:18 +01:00
Brian Gough	2047bd5516	fix broken unit test	2017-09-11 09:44:05 +01:00
Brian Gough	f34c12fdc7	add endpoint to clear project state	2017-09-08 15:50:26 +01:00
Brian Gough	215a939d4e	add comment about log.error for excludeVersions	2017-09-08 13:43:22 +01:00
Brian Gough	1e54b4c72c	log all errors in getProjectDocs	2017-09-07 14:12:48 +01:00
Joe Green	c16c6c3bd3	added build.txt	2017-09-04 14:48:47 +01:00
Brian Gough	9d931a3fa7	fix broken unit tests	2017-08-18 12:08:39 +01:00
Brian Gough	230c93766d	fix broken RedisManager unit test	2017-08-18 11:59:31 +01:00
Brian Gough	8d408de875	Merge pull request #56 from sharelatex/bg-compile-from-redis ... provide endpoint for current project docs in redis	2017-08-18 11:33:27 +01:00
Joe Green	0e8ce29414	compile acceptance tests	2017-08-14 15:33:30 +01:00
Joe Green	b1a7f779d1	add acceptance tests	2017-08-14 15:28:04 +01:00
Brian Gough	8372911a1b	return doclines as array from getProjectDocs ... for compatibility with getDoc	2017-08-11 16:56:30 +01:00
Brian Gough	5971a19084	added acceptance tests	2017-08-11 16:55:31 +01:00
Brian Gough	f6be68eb08	added missing unit tests file	2017-08-11 16:49:16 +01:00
Joe Green	1146253c0a	Create Jenkinsfile	2017-08-11 11:06:36 +01:00
Brian Gough	f696ccb0d9	add unit tests for getProjectDocs	2017-08-10 16:41:28 +01:00
Brian Gough	1eb80936f2	fix log line	2017-08-10 14:57:27 +01:00
Brian Gough	47bebf9638	no need to support optional keys.projectState	2017-08-09 16:47:09 +01:00
Brian Gough	bd6b5b2c59	use v instead of rev in getProjectDocs	2017-08-09 15:30:53 +01:00
Brian Gough	ca7d9dce85	fix unit tests	2017-08-08 09:40:39 +01:00
Brian Gough	9f3ec72f81	switch to single get/set method for getProjectDocs ... if project state hasn't changed, return the docs. Otherwise set the hash and return a 409 Conflict response.	2017-08-07 14:43:28 +01:00
Brian Gough	f5f516a910	delete clsi state when deleting doc (if used)	2017-08-03 15:04:12 +01:00
Brian Gough	860537146b	avoid logging doclines in getProjectDocs	2017-08-03 15:04:12 +01:00
Brian Gough	80be5adc0d	change filter to exclude in getProjectDocs	2017-08-03 15:04:06 +01:00
Brian Gough	54e02cd895	update docupdater endpoint to /project/id/docs	2017-08-03 14:41:34 +01:00
Brian Gough	0109585092	provide endpoint for current project docs in redis	2017-08-02 13:42:10 +01:00
Shane Kilkelly	c3465cf3d4	Reduce retry delay to 10ms, and refactor	2017-07-18 15:28:18 +01:00
Shane Kilkelly	dc8d08c030	Update acceptance tests to reflect retry logic	2017-07-17 11:13:21 +01:00
Shane Kilkelly	0d46c3e2b3	WIP: auto-retry web requests	2017-07-17 10:08:21 +01:00
Brian Gough	c21cc013f3	use null instead of err in callbacks on success	2017-07-12 10:48:32 +01:00
Brian Gough	d2730c8d6b	unit tests for locking timeouts	2017-07-12 10:48:32 +01:00
Brian Gough	bb0dc4b4d5	release the lock if it took too long to acquire it	2017-07-12 10:48:32 +01:00
Brian Gough	54c0fc1180	put a 5 second timeout in getting redis lock	2017-07-11 14:28:58 +01:00