Tim Alby
72d16c7c1f
filter out duplicates learned words
2020-02-18 10:58:03 -05:00
Tim Alby
1d405914fd
don't learn the same word twice
2020-02-18 09:22:50 -05:00
Jakob Ackermann
df7a918e08
Merge pull request #49 from overleaf/jpa-dependencies-cleanup
...
[misc] cleanup dependencies
2020-02-14 10:56:17 +01:00
Jakob Ackermann
d0f861020a
[misc] cleanup unused dependency on redis
2020-02-12 14:43:18 +01:00
Jakob Ackermann
fc17d6adf1
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
...
Also delete unused redis dependency.
2020-02-12 14:41:14 +01:00
Brian Gough
ee88b6d195
remove unused .travis.yml file
2020-02-12 12:37:00 +00:00
Jakob Ackermann
90d12cc602
[test/unit] misc: cleanup a pending interval
2020-02-11 19:01:11 +01:00
Jakob Ackermann
94d564bce3
[misc] fix prettier-eslint errors
...
using prettier-eslint --write
2020-02-11 18:59:29 +01:00
Jakob Ackermann
24270b3e78
[misc] update the build scripts to 1.3.5
2020-02-11 18:59:24 +01:00
Jakob Ackermann
9ee1aef45c
[misc] use node:10.19.0 as base image
...
Also adjust the node version in the other build-script files.
2020-02-07 14:49:42 +01:00
Brian Gough
2759355408
update to gcr.io/overleaf-ops/node:10.19.0
2020-02-06 03:37:26 +00:00
Brian Gough
223260e9fa
upgrade to local node:10.18.1 image
2020-02-04 16:11:46 +00:00
Tim Alby
077ceaba54
delete decaffeinate.sh
2020-01-14 18:27:51 +01:00
Brian Gough
672d03eae6
formatting fixes
2019-10-03 09:41:16 +01:00
Brian Gough
c7a7887d67
remove decaff comments
2019-10-02 16:47:36 +01:00
Brian Gough
0e14ad50db
fix eslint check
2019-10-02 16:34:15 +01:00
Brian Gough
1f861a6772
fix regex and add AspellWorker unit tests
2019-10-02 16:29:18 +01:00
Brian Gough
d96ec9d7fd
add acceptance tests for utf8 responses
2019-09-27 11:58:35 +01:00
Brian Gough
b0e0eeff3c
look for end marker across chunk boundaries
2019-09-27 11:57:45 +01:00
Brian Gough
f273a27b95
use utf8 encoding for stdout from aspell
2019-09-27 11:28:03 +01:00
Simon Detheridge
00d09fd6f5
Return 204 instead of 200 when [un]learning words
...
Also remove unnecessary calls to `next()`
2019-07-22 12:15:07 +01:00
Simon Detheridge
7105ee58d3
Cleanup decaffienation in LearnedWordsManagerTests
2019-07-22 12:14:30 +01:00
Simon Detheridge
e7ab9f79a9
Add endpoint to remove learned words
2019-07-20 14:04:08 +01:00
Miguel Serrano
134ff0b29d
Removed concurrent aspell works within the same request ( #32 )
2019-07-16 08:51:15 +02:00
Miguel Serrano
a27ca151fb
updated logger-sharelatex to 1.8.0 ( #31 )
2019-07-11 16:57:45 +02:00
Miguel Serrano
74c9a3c095
updated API Manager to call aspell in batches ( #30 )
2019-07-11 12:29:00 +02:00
Miguel Serrano
a28ecc0c39
Added acceptance tests for the spelling module ( #29 )
2019-07-09 20:12:30 +02:00
Miguel Serrano
ba642b9807
fixed renaming missing callback ( #28 )
2019-07-05 10:30:43 +01:00
Miguel Serrano
46d0cf9c4b
increased logging info ( #27 )
2019-07-04 15:17:14 +01:00
Miguel Serrano
6ca60b8724
improved error handling and increased timeout ( #26 )
2019-07-04 11:55:16 +01:00
Miguel Serrano
0518840b4e
updated node version to v10 and removed v8 profiler ( #25 )
2019-07-03 14:19:01 +01:00
Miguel Serrano
0eba057cef
Initial decaffeination ( #24 )
2019-07-03 13:41:01 +01:00
Shane Kilkelly
7034c65696
update logger and metrics
2019-06-21 11:52:15 +01:00
Timothée Alby
ddd53dec6b
update Git URL in Jenkinsfile
2019-05-07 17:45:10 +01:00
Timothée Alby
d8ada98704
Update README.md
2019-05-07 16:40:11 +01:00
Henry Oswald
b9c3bf3f58
add missing aspell-sl lang
2019-04-23 13:47:11 +01:00
Henry Oswald
4445b390af
add sentry into settings.defaults
2019-03-05 17:33:23 +00:00
Christopher Hoskin
67f3cc7f31
Fix aspell-ta
2019-02-23 01:40:28 +00:00
Christopher Hoskin
49c9108788
Fix aspell or, te and no. Still need to fix ta
2019-02-21 10:15:23 +00:00
Christopher Hoskin
59c18c470d
Clarify which dicts are from Ubuntu
2019-02-21 09:09:07 +00:00
Christopher Hoskin
9869be319e
Merge branch 'master' into cmg-csh-ho-docker-spelling
2019-02-21 08:56:17 +00:00
Henry Oswald
54d16bcab9
remove redis from config, it doesn't use redis
2019-02-06 15:20:30 +00:00
Christopher Hoskin
bb9b0ba6bd
Merge branch 'ho-docker' into cmg-csh-ho-docker-spelling
2019-02-04 19:47:36 +00:00
Henry Oswald
b38b5989db
bulk upgrade to 1.1.12, moved to npm rather than git
2019-01-31 16:44:24 +00:00
Christopher Hoskin
a708c347d4
Run gpg with no tty
2019-01-25 11:33:23 +00:00
Chrystal Griffiths
6eccaf30a3
Bump build scripts to 1.11 and node to 6.16.0
2019-01-25 09:41:33 +00:00
Henry Oswald
37458ef655
add ss lang
2019-01-15 17:28:37 +00:00
Henry Oswald
4fb31e54c4
add pt dic
2019-01-15 17:07:32 +00:00
Henry Oswald
e81ca6a5a3
add missing dictionarys
2019-01-15 16:48:07 +00:00
Henry Oswald
f94deb2cf2
improve metrics of aspool
2019-01-14 10:35:32 +00:00
Henry Oswald
186f321391
change metrics a bit for promethious
2019-01-14 10:18:12 +00:00
Henry Oswald
5eaf4c8551
increase mongo cache size
2019-01-14 10:10:32 +00:00
Henry Oswald
74ceea14dd
set lru cache to 10 hours
2019-01-13 21:43:12 +00:00
Henry Oswald
72fdadf84c
Merge pull request #14 from sharelatex/csh-ho-docker-issue-1338-grunt
...
Additional issue 1338 for spelling
2019-01-11 14:31:03 +00:00
Henry Oswald
b89db17ea6
reduce logging
2019-01-09 15:41:52 +00:00
Christopher Hoskin
f0086b7a26
Add **/*.map to .gitignore
2019-01-05 07:47:26 +00:00
Christopher Hoskin
202ad40fb0
Bump settings to v1.1.0
2019-01-05 07:46:03 +00:00
Christopher Hoskin
f94754d041
Remove grunt
2019-01-05 07:44:30 +00:00
Christopher Hoskin
e3e99a6214
Bump logger to v1.5.9
2019-01-03 16:30:36 +00:00
Christopher Hoskin
2c154d93b0
Add app.js.map to .gitignore
2019-01-03 15:28:33 +00:00
Christopher Hoskin
0f74fc5a1f
Add dev to npm-shrinkwrap
2019-01-03 15:19:14 +00:00
Christopher Hoskin
2f15f5d6f0
Bump logger to v1.5.8
2019-01-03 10:09:43 +00:00
Christopher Hoskin
3e9d2b9656
Bump build scripts to 1.1.10
2019-01-03 10:06:42 +00:00
Christopher Hoskin
f73856064b
Switch to v2 metrics
2019-01-03 10:03:49 +00:00
Christopher Hoskin
d5017f41fe
Fix npm-shrinkwrap
2019-01-03 09:45:27 +00:00
Henry Oswald
a4eda59189
add getDic
2019-01-02 15:23:40 +00:00
Henry Oswald
de051ceebc
make cache read and writeable
2018-10-04 10:42:43 +01:00
Henry Oswald
6d1f4db12e
make cache dir
2018-10-04 10:15:32 +01:00
Henry Oswald
493e4fe693
bump mocha
2018-10-03 15:32:50 +01:00
Henry Oswald
836c77616f
update build scripts to 1.1.9
2018-10-03 15:19:45 +01:00
Henry Oswald
faedd31957
update config to use more env vars
2018-10-03 15:18:53 +01:00
Henry Oswald
3dd8513015
try pointing it to gcr.io/csh-gcdm-test
2018-05-22 12:31:16 +01:00
Henry Oswald
aada9417ea
dockerised for k8, update build scripts to 1.1.3
2018-05-22 12:26:36 +01:00
James Allen
b2ca5c993f
Add custom Dockerfile with aspell packages
2017-12-29 08:16:19 +00:00
James Allen
4ab7f7212d
Provide hosts as environment settings and add npm run start script
2017-12-29 08:16:04 +00:00
Henry Oswald
8da92907b1
fix unit test
2017-11-02 11:24:01 +00:00
Henry Oswald
31d62c3359
added delete dic endpoint
2017-10-30 16:57:34 +00:00
Joe Green
84ff55cf14
Update Jenkinsfile
2017-10-16 14:11:57 +01:00
Joe Green
225b265e34
only alert on master
2017-10-12 16:58:19 +01:00
Joe Green
a483976b35
build.txt
2017-09-04 14:54:54 +01:00
Joe Green
b1b0acc4b3
use aspell utility image
2017-08-14 09:14:13 +01:00
Joe Green
094f3b0168
use node 6.9.5
2017-08-11 14:33:57 +01:00
Joe Green
266fbd0e6d
Create Jenkinsfile
2017-08-11 14:28:45 +01:00
Shane Kilkelly
ca293bdd8c
upgrade to node 6.9.5
2017-06-27 13:29:27 +01:00
Shane Kilkelly
a03bfbc020
Use post-filtering for whitelist, like learnedWords
2017-06-23 10:00:47 +01:00
Shane Kilkelly
407283ee3c
Fix a daft mistake, blank out whitelisted words, rather than remove
...
This had caused an issue whereby spelling-mistakes would be highlighted
on the wrong word in the client. This was a function of how many whitelisted
words had already occured in the sequence. An off-by-n error.
2017-06-23 09:14:39 +01:00
Shane Kilkelly
00358aa14b
Use more robust checking of error values
2017-06-22 10:09:30 +01:00
Shane Kilkelly
b7f79699fc
Pin sinon version
2017-06-22 10:09:20 +01:00
Shane Kilkelly
e19806cf8b
Mock out metrics in test
2017-06-22 09:24:08 +01:00
Shane Kilkelly
7842bcd24f
Add a whitelist of words which should not be spellchecked
2017-06-22 09:23:47 +01:00
Shane Kilkelly
0229794616
Add a .nvmrc file
2017-03-27 14:50:56 +01:00
Shane Kilkelly
8fead43fbe
Update to metrics 1.7.1
2017-03-24 15:26:08 +00:00
Shane Kilkelly
6b3e2371c0
Update metrics version to 1.7.0
2017-03-21 13:47:49 +00:00
Shane Kilkelly
31128a2580
update to new api
2017-03-17 15:19:25 +00:00
Shane Kilkelly
54af5fec96
Upgrade metrics
2017-03-16 16:35:51 +00:00
Henry Oswald
33df3346f8
Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex
2016-12-13 09:14:31 +00:00
Henry Oswald
a695fd33b2
write cache into cache dir
2016-12-13 09:14:09 +00:00
Henry Oswald
e56c4b189a
remove a bit of logging which is filling disk up
2016-11-24 18:54:32 +00:00
Brian Gough
f5c31cffd1
added npm shrinkwrap file
2016-03-24 15:44:49 +00:00
Brian Gough
bf2e1dfbfe
add sentry logging
2016-03-23 13:47:28 +00:00
Brian Gough
0a94d1e475
avoid null callback
2016-03-23 13:44:29 +00:00
Brian Gough
8239bcd0b5
dump the cache every 30 minutes and load at startup
2016-03-04 11:58:37 +00:00
Brian Gough
fdd9357a42
upgrade lru-cache module to avoid performance regression with node 4.2
...
Fix performance regression on Node 4x #55
https://github.com/isaacs/node-lru-cache/pull/55
2016-03-04 11:33:35 +00:00
Henry Oswald
ef133cbf9a
fix bad res.send
2016-03-01 13:22:51 +00:00
Henry Oswald
b872fbee32
add error check into health check
2016-03-01 13:20:20 +00:00
Henry Oswald
872612a8d3
added null check to health check controller
2016-02-29 12:50:37 +00:00
Henry Oswald
a427634cbb
lock down metrics and spelling
2015-09-17 10:42:36 +01:00
Brian Gough
af21e0aec6
add metrics for memory and gc
2015-08-18 12:31:35 +01:00
Brian Gough
518dc17fdc
upgrade to mongojs 1.3.0 (use mongodb-core driver)
...
also add garbage collection
2015-08-18 09:56:05 +01:00
Henry Oswald
b32064e2d5
bump logger-sharelatex
2015-06-08 13:10:53 +01:00
Henry Oswald
d0b6a4157f
Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex
2015-06-07 11:43:51 +01:00
Henry Oswald
c3c5d8720a
update mongojs driver
2015-06-07 11:43:43 +01:00
Brian
9a41def921
increase time allowed for exiting ASpellWorker test from 100ms to 1s
2015-05-20 20:42:49 +01:00
Brian
81fb8de1db
allow mocha timeout to be specified on grunt command line
2015-05-20 20:41:51 +01:00
Brian Gough
f70476284b
move callback _.once down to Worker, add handler for process close event
...
should fix timeout errors in tests
2015-05-20 11:53:28 +01:00
Brian Gough
6a241cba28
add grep option to grunt test:unit
2015-05-20 11:45:32 +01:00
Brian Gough
6e0d72a3b1
timeout does not need async test here
2015-05-20 11:45:17 +01:00
Brian Gough
da7250c6f2
disable logger in tests
2015-05-20 11:44:54 +01:00
Henry Oswald
800666fcb5
make startup message consistent
2015-04-30 15:05:49 +01:00
James Allen
f3338f621e
Release version 0.1.4
2015-03-20 15:25:59 +00:00
James Allen
f7e0f0c54b
Add comment about tests on OS X
2015-03-20 15:02:26 +00:00
Brian Gough
01d5322ef3
fix end of stream marker to handle languages like en_GB
...
when using language like 'en_GB' aspell reports it as 'en' in response
to $$l
2015-03-12 14:41:23 +00:00
Brian Gough
a91faaf55c
use the language code $$l as the end of stream marker
...
cannot use a custom word in the session dictionary due to language
restrictions on allowed characters, e.g. armenian 'hy' does not allow
latin characters
2015-03-12 12:33:45 +00:00
Brian Gough
86d1092f85
include log line for each spell check
2015-03-12 11:43:09 +00:00
Brian Gough
e4a3e63ff7
remove unused parameter
2015-03-12 11:42:59 +00:00
Brian Gough
c9771272df
include log message for process timeout
2015-03-12 11:24:04 +00:00
Brian Gough
821f4b9a24
clean up timers when Aspell process exits
2015-03-12 11:13:58 +00:00
Brian Gough
00153e61ad
trim output when error occurs
2015-03-12 11:12:46 +00:00
Brian Gough
3bbd0d49a9
don't let error events overwrite exit event
...
(not sure if this can happen but it would be bad if it did)
2015-03-12 10:27:50 +00:00
Brian Gough
c8103a4f35
don't run the idle shutdown timer if the process has errored
2015-03-12 10:27:11 +00:00
Brian Gough
3da42df92c
log when a worker is removed from the pool
2015-03-12 10:26:52 +00:00
Brian Gough
3542918941
add logging for ASpell worker errors
2015-03-12 09:55:15 +00:00
Brian Gough
7936269804
add metrics for ASpell workers
2015-03-12 09:54:57 +00:00
Brian Gough
ed33cd59b7
show hit rate to 2dp only
2015-03-12 09:53:58 +00:00
Brian Gough
b684ed0837
put a unique end of stream marker in the session dictionary
2015-03-11 16:58:22 +00:00
Brian Gough
a655041bdd
fix typo in iterator for cache object
2015-03-11 15:57:33 +00:00
Brian
31f6013172
increase delay for timeout in test
2015-03-11 15:38:19 +00:00
Brian
080f33335a
added stress test example
2015-03-11 15:37:18 +00:00
Brian
c3a70b6184
fix bug in worker cleanup
2015-03-11 14:53:06 +00:00
Brian
220f82a395
store suggestions as language:word instead of word
...
avoid words like 'constructor' from accessing properties of
suggestions object.
2015-03-11 14:52:06 +00:00
Brian
9bb534707f
shutdown workers when idle
2015-03-10 13:33:05 +00:00
Brian
9c0272445f
extend worker to include request count
2015-03-10 13:32:42 +00:00
Brian
5ba5fd5533
fix caching logic to include valid words, as well as mispellings
...
include logging of cache hits
2015-03-10 13:31:06 +00:00
Brian
10c3d3eb70
replace deprecated res.send(code) with res.sendStatus(code)
2015-03-09 15:56:49 +00:00
Brian
21c664b28c
fix variable mismatch in error handler
2015-03-09 15:52:25 +00:00
Brian Gough
a36d14f4cc
fix caching of suggestions
2015-03-04 17:00:19 +00:00
Brian Gough
c549d29d8e
test that Aspell is killed by timeout
2015-03-04 16:44:13 +00:00
Brian Gough
a49f80cb21
support Aspell worker pool
2015-03-04 16:43:59 +00:00
Henry Oswald
726afb6b90
use sendstatus not send
2015-03-03 15:20:05 +00:00
Henry Oswald
a7185c412c
use res.sendStatus not re.send
2015-03-03 14:45:32 +00:00