82 commits

Author	SHA1	Message	Date
Jakob Ackermann	944a243753	[AspellWorker] sanitize user input before writing it to the worker pipe	2021-05-03 11:57:48 +01:00
Jakob Ackermann	9afdb32689	[misc] bump metrics module to 3.4.1 ... - renamed package from `metrics-sharelatex` to `@overleaf/metrics` - drop support for statsd backend - decaffeinate - compress `/metrics` response using gzip - bump debugging agents to latest versions - expose prometheus interfaces for custom metrics (custom tags) - cleanup of open sockets metrics - fix deprecation warnings for header access	2020-11-25 11:57:24 +00:00
Jakob Ackermann	033af5091f	[SpellingAPIManager] get the list of ignored misspellings from settings ... The settings will allow overrides via the environment variable `IGNORED_MISSPELLINGS`.	2020-10-08 09:36:47 +01:00
Jakob Ackermann	baaf376128	[misc] mongodb: use the new db connector by default ... mongojs was enabling it by default as well.	2020-09-10 10:57:29 +01:00
Jakob Ackermann	cb4a7516ac	[misc] migrate the app to the native mongo driver, drop mongojs	2020-09-07 12:21:48 +01:00
Jakob Ackermann	c722a79e93	[misc] bump the dev-env to 3.3.2	2020-08-10 17:23:15 +01:00
Jakob Ackermann	5cfd92cf85	[ASpell] error handling of cache dump: fix an async fs function call ... fs.unlink requires a callback as second parameter. Signed-off-by: Jakob Ackermann <das7pad@outlook.com>	2020-07-03 11:13:01 +01:00
Miguel Serrano	1662622c23	Updated OError code to v3	2020-06-03 11:14:44 +02:00
Miguel Serrano	b91e59e8a7	fixed linting	2020-06-03 11:00:35 +02:00
Miguel Serrano	803ed1607c	format:fix	2020-06-03 10:52:36 +02:00
mserranom	caa28a0ff0	updated minor, patch dependencies and lru-cache. Fixed constructor in lru-cache	2020-03-30 12:49:56 +02:00
Tim Alby	72d16c7c1f	filter out duplicates learned words	2020-02-18 10:58:03 -05:00
Tim Alby	1d405914fd	don't learn the same word twice	2020-02-18 09:22:50 -05:00
Jakob Ackermann	90d12cc602	[test/unit] misc: cleanup a pending interval	2020-02-11 19:01:11 +01:00
Brian Gough	1f861a6772	fix regex and add AspellWorker unit tests	2019-10-02 16:29:18 +01:00
Brian Gough	b0e0eeff3c	look for end marker across chunk boundaries	2019-09-27 11:57:45 +01:00
Brian Gough	f273a27b95	use utf8 encoding for stdout from aspell	2019-09-27 11:28:03 +01:00
Simon Detheridge	00d09fd6f5	Return 204 instead of 200 when [un]learning words ... Also remove unnecessary calls to `next()`	2019-07-22 12:15:07 +01:00
Simon Detheridge	e7ab9f79a9	Add endpoint to remove learned words	2019-07-20 14:04:08 +01:00
Miguel Serrano	134ff0b29d	Removed concurrent aspell works within the same request (#32)	2019-07-16 08:51:15 +02:00
Miguel Serrano	74c9a3c095	updated API Manager to call aspell in batches (#30)	2019-07-11 12:29:00 +02:00
Miguel Serrano	ba642b9807	fixed renaming missing callback (#28)	2019-07-05 10:30:43 +01:00
Miguel Serrano	46d0cf9c4b	increased logging info (#27)	2019-07-04 15:17:14 +01:00
Miguel Serrano	6ca60b8724	improved error handling and increased timeout (#26)	2019-07-04 11:55:16 +01:00
Miguel Serrano	0eba057cef	Initial decaffeination (#24)	2019-07-03 13:41:01 +01:00
Henry Oswald	f94deb2cf2	improve metrics of aspool	2019-01-14 10:35:32 +00:00
Henry Oswald	186f321391	change metrics a bit for promethious	2019-01-14 10:18:12 +00:00
Henry Oswald	5eaf4c8551	increase mongo cache size	2019-01-14 10:10:32 +00:00
Henry Oswald	74ceea14dd	set lru cache to 10 hours	2019-01-13 21:43:12 +00:00
Henry Oswald	b89db17ea6	reduce logging	2019-01-09 15:41:52 +00:00
Henry Oswald	a4eda59189	add getDic	2019-01-02 15:23:40 +00:00
Henry Oswald	31d62c3359	added delete dic endpoint	2017-10-30 16:57:34 +00:00
Shane Kilkelly	a03bfbc020	Use post-filtering for whitelist, like learnedWords	2017-06-23 10:00:47 +01:00
Shane Kilkelly	407283ee3c	Fix a daft mistake, blank out whitelisted words, rather than remove ... This had caused an issue whereby spelling-mistakes would be highlighted on the wrong word in the client. This was a function of how many whitelisted words had already occured in the sequence. An off-by-n error.	2017-06-23 09:14:39 +01:00
Shane Kilkelly	7842bcd24f	Add a whitelist of words which should not be spellchecked	2017-06-22 09:23:47 +01:00
Shane Kilkelly	31128a2580	update to new api	2017-03-17 15:19:25 +00:00
Shane Kilkelly	54af5fec96	Upgrade metrics	2017-03-16 16:35:51 +00:00
Henry Oswald	33df3346f8	Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex	2016-12-13 09:14:31 +00:00
Henry Oswald	a695fd33b2	write cache into cache dir	2016-12-13 09:14:09 +00:00
Henry Oswald	e56c4b189a	remove a bit of logging which is filling disk up	2016-11-24 18:54:32 +00:00
Brian Gough	0a94d1e475	avoid null callback	2016-03-23 13:44:29 +00:00
Brian Gough	8239bcd0b5	dump the cache every 30 minutes and load at startup	2016-03-04 11:58:37 +00:00
Henry Oswald	ef133cbf9a	fix bad res.send	2016-03-01 13:22:51 +00:00
Henry Oswald	b872fbee32	add error check into health check	2016-03-01 13:20:20 +00:00
Henry Oswald	872612a8d3	added null check to health check controller	2016-02-29 12:50:37 +00:00
Brian Gough	f70476284b	move callback _.once down to Worker, add handler for process close event ... should fix timeout errors in tests	2015-05-20 11:53:28 +01:00
Brian Gough	01d5322ef3	fix end of stream marker to handle languages like en_GB ... when using language like 'en_GB' aspell reports it as 'en' in response to $$l	2015-03-12 14:41:23 +00:00
Brian Gough	a91faaf55c	use the language code $$l as the end of stream marker ... cannot use a custom word in the session dictionary due to language restrictions on allowed characters, e.g. armenian 'hy' does not allow latin characters	2015-03-12 12:33:45 +00:00
Brian Gough	86d1092f85	include log line for each spell check	2015-03-12 11:43:09 +00:00
Brian Gough	e4a3e63ff7	remove unused parameter	2015-03-12 11:42:59 +00:00