71 commits

Author	SHA1	Message	Date
Tim Alby	72d16c7c1f	filter out duplicates learned words	2020-02-18 10:58:03 -05:00
Tim Alby	1d405914fd	don't learn the same word twice	2020-02-18 09:22:50 -05:00
Jakob Ackermann	90d12cc602	[test/unit] misc: cleanup a pending interval	2020-02-11 19:01:11 +01:00
Brian Gough	1f861a6772	fix regex and add AspellWorker unit tests	2019-10-02 16:29:18 +01:00
Brian Gough	b0e0eeff3c	look for end marker across chunk boundaries	2019-09-27 11:57:45 +01:00
Brian Gough	f273a27b95	use utf8 encoding for stdout from aspell	2019-09-27 11:28:03 +01:00
Simon Detheridge	00d09fd6f5	Return 204 instead of 200 when [un]learning words ... Also remove unnecessary calls to `next()`	2019-07-22 12:15:07 +01:00
Simon Detheridge	e7ab9f79a9	Add endpoint to remove learned words	2019-07-20 14:04:08 +01:00
Miguel Serrano	134ff0b29d	Removed concurrent aspell works within the same request (#32)	2019-07-16 08:51:15 +02:00
Miguel Serrano	74c9a3c095	updated API Manager to call aspell in batches (#30)	2019-07-11 12:29:00 +02:00
Miguel Serrano	ba642b9807	fixed renaming missing callback (#28)	2019-07-05 10:30:43 +01:00
Miguel Serrano	46d0cf9c4b	increased logging info (#27)	2019-07-04 15:17:14 +01:00
Miguel Serrano	6ca60b8724	improved error handling and increased timeout (#26)	2019-07-04 11:55:16 +01:00
Miguel Serrano	0eba057cef	Initial decaffeination (#24)	2019-07-03 13:41:01 +01:00
Henry Oswald	f94deb2cf2	improve metrics of aspool	2019-01-14 10:35:32 +00:00
Henry Oswald	186f321391	change metrics a bit for promethious	2019-01-14 10:18:12 +00:00
Henry Oswald	5eaf4c8551	increase mongo cache size	2019-01-14 10:10:32 +00:00
Henry Oswald	74ceea14dd	set lru cache to 10 hours	2019-01-13 21:43:12 +00:00
Henry Oswald	b89db17ea6	reduce logging	2019-01-09 15:41:52 +00:00
Henry Oswald	a4eda59189	add getDic	2019-01-02 15:23:40 +00:00
Henry Oswald	31d62c3359	added delete dic endpoint	2017-10-30 16:57:34 +00:00
Shane Kilkelly	a03bfbc020	Use post-filtering for whitelist, like learnedWords	2017-06-23 10:00:47 +01:00
Shane Kilkelly	407283ee3c	Fix a daft mistake, blank out whitelisted words, rather than remove ... This had caused an issue whereby spelling-mistakes would be highlighted on the wrong word in the client. This was a function of how many whitelisted words had already occured in the sequence. An off-by-n error.	2017-06-23 09:14:39 +01:00
Shane Kilkelly	7842bcd24f	Add a whitelist of words which should not be spellchecked	2017-06-22 09:23:47 +01:00
Shane Kilkelly	31128a2580	update to new api	2017-03-17 15:19:25 +00:00
Shane Kilkelly	54af5fec96	Upgrade metrics	2017-03-16 16:35:51 +00:00
Henry Oswald	33df3346f8	Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex	2016-12-13 09:14:31 +00:00
Henry Oswald	a695fd33b2	write cache into cache dir	2016-12-13 09:14:09 +00:00
Henry Oswald	e56c4b189a	remove a bit of logging which is filling disk up	2016-11-24 18:54:32 +00:00
Brian Gough	0a94d1e475	avoid null callback	2016-03-23 13:44:29 +00:00
Brian Gough	8239bcd0b5	dump the cache every 30 minutes and load at startup	2016-03-04 11:58:37 +00:00
Henry Oswald	ef133cbf9a	fix bad res.send	2016-03-01 13:22:51 +00:00
Henry Oswald	b872fbee32	add error check into health check	2016-03-01 13:20:20 +00:00
Henry Oswald	872612a8d3	added null check to health check controller	2016-02-29 12:50:37 +00:00
Brian Gough	f70476284b	move callback _.once down to Worker, add handler for process close event ... should fix timeout errors in tests	2015-05-20 11:53:28 +01:00
Brian Gough	01d5322ef3	fix end of stream marker to handle languages like en_GB ... when using language like 'en_GB' aspell reports it as 'en' in response to $$l	2015-03-12 14:41:23 +00:00
Brian Gough	a91faaf55c	use the language code $$l as the end of stream marker ... cannot use a custom word in the session dictionary due to language restrictions on allowed characters, e.g. armenian 'hy' does not allow latin characters	2015-03-12 12:33:45 +00:00
Brian Gough	86d1092f85	include log line for each spell check	2015-03-12 11:43:09 +00:00
Brian Gough	e4a3e63ff7	remove unused parameter	2015-03-12 11:42:59 +00:00
Brian Gough	c9771272df	include log message for process timeout	2015-03-12 11:24:04 +00:00
Brian Gough	821f4b9a24	clean up timers when Aspell process exits	2015-03-12 11:13:58 +00:00
Brian Gough	00153e61ad	trim output when error occurs	2015-03-12 11:12:46 +00:00
Brian Gough	3bbd0d49a9	don't let error events overwrite exit event ... (not sure if this can happen but it would be bad if it did)	2015-03-12 10:27:50 +00:00
Brian Gough	c8103a4f35	don't run the idle shutdown timer if the process has errored	2015-03-12 10:27:11 +00:00
Brian Gough	3da42df92c	log when a worker is removed from the pool	2015-03-12 10:26:52 +00:00
Brian Gough	3542918941	add logging for ASpell worker errors	2015-03-12 09:55:15 +00:00
Brian Gough	7936269804	add metrics for ASpell workers	2015-03-12 09:54:57 +00:00
Brian Gough	ed33cd59b7	show hit rate to 2dp only	2015-03-12 09:53:58 +00:00
Brian Gough	b684ed0837	put a unique end of stream marker in the session dictionary	2015-03-11 16:58:22 +00:00
Brian Gough	a655041bdd	fix typo in iterator for cache object	2015-03-11 15:57:33 +00:00