Commit graph

68 commits

Author SHA1 Message Date
Brian Gough
1f861a6772 fix regex and add AspellWorker unit tests 2019-10-02 16:29:18 +01:00
Brian Gough
b0e0eeff3c look for end marker across chunk boundaries 2019-09-27 11:57:45 +01:00
Brian Gough
f273a27b95 use utf8 encoding for stdout from aspell 2019-09-27 11:28:03 +01:00
Simon Detheridge
00d09fd6f5 Return 204 instead of 200 when [un]learning words
Also remove unnecessary calls to `next()`
2019-07-22 12:15:07 +01:00
Simon Detheridge
e7ab9f79a9 Add endpoint to remove learned words 2019-07-20 14:04:08 +01:00
Miguel Serrano
134ff0b29d Removed concurrent aspell works within the same request (#32) 2019-07-16 08:51:15 +02:00
Miguel Serrano
74c9a3c095 updated API Manager to call aspell in batches (#30) 2019-07-11 12:29:00 +02:00
Miguel Serrano
ba642b9807 fixed renaming missing callback (#28) 2019-07-05 10:30:43 +01:00
Miguel Serrano
46d0cf9c4b increased logging info (#27) 2019-07-04 15:17:14 +01:00
Miguel Serrano
6ca60b8724 improved error handling and increased timeout (#26) 2019-07-04 11:55:16 +01:00
Miguel Serrano
0eba057cef Initial decaffeination (#24) 2019-07-03 13:41:01 +01:00
Henry Oswald
f94deb2cf2 improve metrics of aspool 2019-01-14 10:35:32 +00:00
Henry Oswald
186f321391 change metrics a bit for promethious 2019-01-14 10:18:12 +00:00
Henry Oswald
5eaf4c8551 increase mongo cache size 2019-01-14 10:10:32 +00:00
Henry Oswald
74ceea14dd set lru cache to 10 hours 2019-01-13 21:43:12 +00:00
Henry Oswald
b89db17ea6 reduce logging 2019-01-09 15:41:52 +00:00
Henry Oswald
a4eda59189 add getDic 2019-01-02 15:23:40 +00:00
Henry Oswald
31d62c3359 added delete dic endpoint 2017-10-30 16:57:34 +00:00
Shane Kilkelly
a03bfbc020 Use post-filtering for whitelist, like learnedWords 2017-06-23 10:00:47 +01:00
Shane Kilkelly
407283ee3c Fix a daft mistake, blank out whitelisted words, rather than remove
This had caused an issue whereby spelling-mistakes would be highlighted
on the wrong word in the client. This was a function of how many whitelisted
words had already occured in the sequence. An off-by-n error.
2017-06-23 09:14:39 +01:00
Shane Kilkelly
7842bcd24f Add a whitelist of words which should not be spellchecked 2017-06-22 09:23:47 +01:00
Shane Kilkelly
31128a2580 update to new api 2017-03-17 15:19:25 +00:00
Shane Kilkelly
54af5fec96 Upgrade metrics 2017-03-16 16:35:51 +00:00
Henry Oswald
33df3346f8 Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex 2016-12-13 09:14:31 +00:00
Henry Oswald
a695fd33b2 write cache into cache dir 2016-12-13 09:14:09 +00:00
Henry Oswald
e56c4b189a remove a bit of logging which is filling disk up 2016-11-24 18:54:32 +00:00
Brian Gough
0a94d1e475 avoid null callback 2016-03-23 13:44:29 +00:00
Brian Gough
8239bcd0b5 dump the cache every 30 minutes and load at startup 2016-03-04 11:58:37 +00:00
Henry Oswald
ef133cbf9a fix bad res.send 2016-03-01 13:22:51 +00:00
Henry Oswald
b872fbee32 add error check into health check 2016-03-01 13:20:20 +00:00
Henry Oswald
872612a8d3 added null check to health check controller 2016-02-29 12:50:37 +00:00
Brian Gough
f70476284b move callback _.once down to Worker, add handler for process close event
should fix timeout errors in tests
2015-05-20 11:53:28 +01:00
Brian Gough
01d5322ef3 fix end of stream marker to handle languages like en_GB
when using language like 'en_GB' aspell reports it as 'en' in response
to $$l
2015-03-12 14:41:23 +00:00
Brian Gough
a91faaf55c use the language code $$l as the end of stream marker
cannot use a custom word in the session dictionary due to language
restrictions on allowed characters, e.g. armenian 'hy' does not allow
latin characters
2015-03-12 12:33:45 +00:00
Brian Gough
86d1092f85 include log line for each spell check 2015-03-12 11:43:09 +00:00
Brian Gough
e4a3e63ff7 remove unused parameter 2015-03-12 11:42:59 +00:00
Brian Gough
c9771272df include log message for process timeout 2015-03-12 11:24:04 +00:00
Brian Gough
821f4b9a24 clean up timers when Aspell process exits 2015-03-12 11:13:58 +00:00
Brian Gough
00153e61ad trim output when error occurs 2015-03-12 11:12:46 +00:00
Brian Gough
3bbd0d49a9 don't let error events overwrite exit event
(not sure if this can happen but it would be bad if it did)
2015-03-12 10:27:50 +00:00
Brian Gough
c8103a4f35 don't run the idle shutdown timer if the process has errored 2015-03-12 10:27:11 +00:00
Brian Gough
3da42df92c log when a worker is removed from the pool 2015-03-12 10:26:52 +00:00
Brian Gough
3542918941 add logging for ASpell worker errors 2015-03-12 09:55:15 +00:00
Brian Gough
7936269804 add metrics for ASpell workers 2015-03-12 09:54:57 +00:00
Brian Gough
ed33cd59b7 show hit rate to 2dp only 2015-03-12 09:53:58 +00:00
Brian Gough
b684ed0837 put a unique end of stream marker in the session dictionary 2015-03-11 16:58:22 +00:00
Brian Gough
a655041bdd fix typo in iterator for cache object 2015-03-11 15:57:33 +00:00
Brian
c3a70b6184 fix bug in worker cleanup 2015-03-11 14:53:06 +00:00
Brian
220f82a395 store suggestions as language:word instead of word
avoid words like 'constructor' from accessing properties of
suggestions object.
2015-03-11 14:52:06 +00:00
Brian
9bb534707f shutdown workers when idle 2015-03-10 13:33:05 +00:00