Commit graph

281 commits

Author SHA1 Message Date
Jakob Ackermann
2e8b6fccce [misc] install_deps: fix apt install for aspell-or, aspell-te, aspell-ta
The specified versions were removed. use any latest version instead.

```
# in a node:10.19.0 container will all steps from install_deps.sh
#  executed -- except for the 'apt install' steps.
$ apt policy aspell-or aspell-te aspell-no aspell-ta
  aspell-or:
    Installed: (none)
    Candidate: 0.03-1-7
    Version table:
       0.03-1-7 1337
          500 http://deb.debian.org/debian unstable/main ...
       0.03-1-5 990
          990 http://deb.debian.org/debian stretch/main ...
       0.03-1-5 500
          500 http://archive.ubuntu.com/ubuntu bionic/universe ...
  aspell-te:
    Installed: (none)
    Candidate: 0.01-2-7
    Version table:
       0.01-2-7 1337
          500 http://deb.debian.org/debian unstable/main ...
       0.01-2-5 990
          990 http://deb.debian.org/debian stretch/main ...
       0.01-2-5 500
          500 http://archive.ubuntu.com/ubuntu bionic/universe ...
  aspell-no:
    Installed: (none)
    Candidate: 2.2-4
    Version table:
       2.2-4 1337
          500 http://deb.debian.org/debian unstable/main ...
       2.2-3 500
          500 http://archive.ubuntu.com/ubuntu bionic/universe ...
       2.2-2 990
          990 http://deb.debian.org/debian stretch/main ...
  aspell-ta:
    Installed: (none)
    Candidate: 20040424-1-3
    Version table:
       20040424-1-3 1337
          500 http://deb.debian.org/debian unstable/main ...
       20040424-1-1 990
          990 http://deb.debian.org/debian stretch/main ...
       20040424-1-1 500
          500 http://archive.ubuntu.com/ubuntu bionic/universe ...
```
2020-04-23 17:22:22 +02:00
Jakob Ackermann
c660115d98 [misc] install_deps: download packages from a near-by mirror 2020-04-23 16:44:49 +02:00
mserranom
241e7d979f Bump to new debian version of ta 2020-04-01 13:15:27 +02:00
mserranom
19808cb127 updated mocha, sinon and node-statsd 2020-03-30 12:53:35 +02:00
mserranom
caa28a0ff0 updated minor, patch dependencies and lru-cache. Fixed constructor in lru-cache 2020-03-30 12:49:56 +02:00
mserranom
72a06c4474 npm audit fix 2020-03-30 12:34:29 +02:00
mserranom
3885c48d42 updated build scripts 2020-03-30 12:33:07 +02:00
Tim Alby
72d16c7c1f filter out duplicates learned words 2020-02-18 10:58:03 -05:00
Tim Alby
1d405914fd don't learn the same word twice 2020-02-18 09:22:50 -05:00
Jakob Ackermann
df7a918e08 Merge pull request #49 from overleaf/jpa-dependencies-cleanup
[misc] cleanup dependencies
2020-02-14 10:56:17 +01:00
Jakob Ackermann
d0f861020a [misc] cleanup unused dependency on redis 2020-02-12 14:43:18 +01:00
Jakob Ackermann
fc17d6adf1 [misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
Also delete unused redis dependency.
2020-02-12 14:41:14 +01:00
Brian Gough
ee88b6d195 remove unused .travis.yml file 2020-02-12 12:37:00 +00:00
Jakob Ackermann
90d12cc602 [test/unit] misc: cleanup a pending interval 2020-02-11 19:01:11 +01:00
Jakob Ackermann
94d564bce3 [misc] fix prettier-eslint errors
using prettier-eslint --write
2020-02-11 18:59:29 +01:00
Jakob Ackermann
24270b3e78 [misc] update the build scripts to 1.3.5 2020-02-11 18:59:24 +01:00
Jakob Ackermann
9ee1aef45c [misc] use node:10.19.0 as base image
Also adjust the node version in the other build-script files.
2020-02-07 14:49:42 +01:00
Brian Gough
2759355408 update to gcr.io/overleaf-ops/node:10.19.0 2020-02-06 03:37:26 +00:00
Brian Gough
223260e9fa upgrade to local node:10.18.1 image 2020-02-04 16:11:46 +00:00
Tim Alby
077ceaba54 delete decaffeinate.sh 2020-01-14 18:27:51 +01:00
Brian Gough
672d03eae6 formatting fixes 2019-10-03 09:41:16 +01:00
Brian Gough
c7a7887d67 remove decaff comments 2019-10-02 16:47:36 +01:00
Brian Gough
0e14ad50db fix eslint check 2019-10-02 16:34:15 +01:00
Brian Gough
1f861a6772 fix regex and add AspellWorker unit tests 2019-10-02 16:29:18 +01:00
Brian Gough
d96ec9d7fd add acceptance tests for utf8 responses 2019-09-27 11:58:35 +01:00
Brian Gough
b0e0eeff3c look for end marker across chunk boundaries 2019-09-27 11:57:45 +01:00
Brian Gough
f273a27b95 use utf8 encoding for stdout from aspell 2019-09-27 11:28:03 +01:00
Simon Detheridge
00d09fd6f5 Return 204 instead of 200 when [un]learning words
Also remove unnecessary calls to `next()`
2019-07-22 12:15:07 +01:00
Simon Detheridge
7105ee58d3 Cleanup decaffienation in LearnedWordsManagerTests 2019-07-22 12:14:30 +01:00
Simon Detheridge
e7ab9f79a9 Add endpoint to remove learned words 2019-07-20 14:04:08 +01:00
Miguel Serrano
134ff0b29d Removed concurrent aspell works within the same request (#32) 2019-07-16 08:51:15 +02:00
Miguel Serrano
a27ca151fb updated logger-sharelatex to 1.8.0 (#31) 2019-07-11 16:57:45 +02:00
Miguel Serrano
74c9a3c095 updated API Manager to call aspell in batches (#30) 2019-07-11 12:29:00 +02:00
Miguel Serrano
a28ecc0c39 Added acceptance tests for the spelling module (#29) 2019-07-09 20:12:30 +02:00
Miguel Serrano
ba642b9807 fixed renaming missing callback (#28) 2019-07-05 10:30:43 +01:00
Miguel Serrano
46d0cf9c4b increased logging info (#27) 2019-07-04 15:17:14 +01:00
Miguel Serrano
6ca60b8724 improved error handling and increased timeout (#26) 2019-07-04 11:55:16 +01:00
Miguel Serrano
0518840b4e updated node version to v10 and removed v8 profiler (#25) 2019-07-03 14:19:01 +01:00
Miguel Serrano
0eba057cef Initial decaffeination (#24) 2019-07-03 13:41:01 +01:00
Shane Kilkelly
7034c65696 update logger and metrics 2019-06-21 11:52:15 +01:00
Timothée Alby
ddd53dec6b update Git URL in Jenkinsfile 2019-05-07 17:45:10 +01:00
Timothée Alby
d8ada98704 Update README.md 2019-05-07 16:40:11 +01:00
Henry Oswald
b9c3bf3f58 add missing aspell-sl lang 2019-04-23 13:47:11 +01:00
Henry Oswald
4445b390af add sentry into settings.defaults 2019-03-05 17:33:23 +00:00
Christopher Hoskin
67f3cc7f31 Fix aspell-ta 2019-02-23 01:40:28 +00:00
Christopher Hoskin
49c9108788 Fix aspell or, te and no. Still need to fix ta 2019-02-21 10:15:23 +00:00
Christopher Hoskin
59c18c470d Clarify which dicts are from Ubuntu 2019-02-21 09:09:07 +00:00
Christopher Hoskin
9869be319e Merge branch 'master' into cmg-csh-ho-docker-spelling 2019-02-21 08:56:17 +00:00
Henry Oswald
54d16bcab9 remove redis from config, it doesn't use redis 2019-02-06 15:20:30 +00:00
Christopher Hoskin
bb9b0ba6bd Merge branch 'ho-docker' into cmg-csh-ho-docker-spelling 2019-02-04 19:47:36 +00:00
Henry Oswald
b38b5989db bulk upgrade to 1.1.12, moved to npm rather than git 2019-01-31 16:44:24 +00:00
Christopher Hoskin
a708c347d4 Run gpg with no tty 2019-01-25 11:33:23 +00:00
Chrystal Griffiths
6eccaf30a3 Bump build scripts to 1.11 and node to 6.16.0 2019-01-25 09:41:33 +00:00
Henry Oswald
37458ef655 add ss lang 2019-01-15 17:28:37 +00:00
Henry Oswald
4fb31e54c4 add pt dic 2019-01-15 17:07:32 +00:00
Henry Oswald
e81ca6a5a3 add missing dictionarys 2019-01-15 16:48:07 +00:00
Henry Oswald
f94deb2cf2 improve metrics of aspool 2019-01-14 10:35:32 +00:00
Henry Oswald
186f321391 change metrics a bit for promethious 2019-01-14 10:18:12 +00:00
Henry Oswald
5eaf4c8551 increase mongo cache size 2019-01-14 10:10:32 +00:00
Henry Oswald
74ceea14dd set lru cache to 10 hours 2019-01-13 21:43:12 +00:00
Henry Oswald
72fdadf84c Merge pull request #14 from sharelatex/csh-ho-docker-issue-1338-grunt
Additional issue 1338 for spelling
2019-01-11 14:31:03 +00:00
Henry Oswald
b89db17ea6 reduce logging 2019-01-09 15:41:52 +00:00
Christopher Hoskin
f0086b7a26 Add **/*.map to .gitignore 2019-01-05 07:47:26 +00:00
Christopher Hoskin
202ad40fb0 Bump settings to v1.1.0 2019-01-05 07:46:03 +00:00
Christopher Hoskin
f94754d041 Remove grunt 2019-01-05 07:44:30 +00:00
Christopher Hoskin
e3e99a6214 Bump logger to v1.5.9 2019-01-03 16:30:36 +00:00
Christopher Hoskin
2c154d93b0 Add app.js.map to .gitignore 2019-01-03 15:28:33 +00:00
Christopher Hoskin
0f74fc5a1f Add dev to npm-shrinkwrap 2019-01-03 15:19:14 +00:00
Christopher Hoskin
2f15f5d6f0 Bump logger to v1.5.8 2019-01-03 10:09:43 +00:00
Christopher Hoskin
3e9d2b9656 Bump build scripts to 1.1.10 2019-01-03 10:06:42 +00:00
Christopher Hoskin
f73856064b Switch to v2 metrics 2019-01-03 10:03:49 +00:00
Christopher Hoskin
d5017f41fe Fix npm-shrinkwrap 2019-01-03 09:45:27 +00:00
Henry Oswald
a4eda59189 add getDic 2019-01-02 15:23:40 +00:00
Henry Oswald
de051ceebc make cache read and writeable 2018-10-04 10:42:43 +01:00
Henry Oswald
6d1f4db12e make cache dir 2018-10-04 10:15:32 +01:00
Henry Oswald
493e4fe693 bump mocha 2018-10-03 15:32:50 +01:00
Henry Oswald
836c77616f update build scripts to 1.1.9 2018-10-03 15:19:45 +01:00
Henry Oswald
faedd31957 update config to use more env vars 2018-10-03 15:18:53 +01:00
Henry Oswald
3dd8513015 try pointing it to gcr.io/csh-gcdm-test 2018-05-22 12:31:16 +01:00
Henry Oswald
aada9417ea dockerised for k8, update build scripts to 1.1.3 2018-05-22 12:26:36 +01:00
James Allen
b2ca5c993f Add custom Dockerfile with aspell packages 2017-12-29 08:16:19 +00:00
James Allen
4ab7f7212d Provide hosts as environment settings and add npm run start script 2017-12-29 08:16:04 +00:00
Henry Oswald
8da92907b1 fix unit test 2017-11-02 11:24:01 +00:00
Henry Oswald
31d62c3359 added delete dic endpoint 2017-10-30 16:57:34 +00:00
Joe Green
84ff55cf14 Update Jenkinsfile 2017-10-16 14:11:57 +01:00
Joe Green
225b265e34 only alert on master 2017-10-12 16:58:19 +01:00
Joe Green
a483976b35 build.txt 2017-09-04 14:54:54 +01:00
Joe Green
b1b0acc4b3 use aspell utility image 2017-08-14 09:14:13 +01:00
Joe Green
094f3b0168 use node 6.9.5 2017-08-11 14:33:57 +01:00
Joe Green
266fbd0e6d Create Jenkinsfile 2017-08-11 14:28:45 +01:00
Shane Kilkelly
ca293bdd8c upgrade to node 6.9.5 2017-06-27 13:29:27 +01:00
Shane Kilkelly
a03bfbc020 Use post-filtering for whitelist, like learnedWords 2017-06-23 10:00:47 +01:00
Shane Kilkelly
407283ee3c Fix a daft mistake, blank out whitelisted words, rather than remove
This had caused an issue whereby spelling-mistakes would be highlighted
on the wrong word in the client. This was a function of how many whitelisted
words had already occured in the sequence. An off-by-n error.
2017-06-23 09:14:39 +01:00
Shane Kilkelly
00358aa14b Use more robust checking of error values 2017-06-22 10:09:30 +01:00
Shane Kilkelly
b7f79699fc Pin sinon version 2017-06-22 10:09:20 +01:00
Shane Kilkelly
e19806cf8b Mock out metrics in test 2017-06-22 09:24:08 +01:00
Shane Kilkelly
7842bcd24f Add a whitelist of words which should not be spellchecked 2017-06-22 09:23:47 +01:00
Shane Kilkelly
0229794616 Add a .nvmrc file 2017-03-27 14:50:56 +01:00
Shane Kilkelly
8fead43fbe Update to metrics 1.7.1 2017-03-24 15:26:08 +00:00
Shane Kilkelly
6b3e2371c0 Update metrics version to 1.7.0 2017-03-21 13:47:49 +00:00
Shane Kilkelly
31128a2580 update to new api 2017-03-17 15:19:25 +00:00
Shane Kilkelly
54af5fec96 Upgrade metrics 2017-03-16 16:35:51 +00:00
Henry Oswald
33df3346f8 Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex 2016-12-13 09:14:31 +00:00
Henry Oswald
a695fd33b2 write cache into cache dir 2016-12-13 09:14:09 +00:00
Henry Oswald
e56c4b189a remove a bit of logging which is filling disk up 2016-11-24 18:54:32 +00:00
Brian Gough
f5c31cffd1 added npm shrinkwrap file 2016-03-24 15:44:49 +00:00
Brian Gough
bf2e1dfbfe add sentry logging 2016-03-23 13:47:28 +00:00
Brian Gough
0a94d1e475 avoid null callback 2016-03-23 13:44:29 +00:00
Brian Gough
8239bcd0b5 dump the cache every 30 minutes and load at startup 2016-03-04 11:58:37 +00:00
Brian Gough
fdd9357a42 upgrade lru-cache module to avoid performance regression with node 4.2
Fix performance regression on Node 4x #55
https://github.com/isaacs/node-lru-cache/pull/55
2016-03-04 11:33:35 +00:00
Henry Oswald
ef133cbf9a fix bad res.send 2016-03-01 13:22:51 +00:00
Henry Oswald
b872fbee32 add error check into health check 2016-03-01 13:20:20 +00:00
Henry Oswald
872612a8d3 added null check to health check controller 2016-02-29 12:50:37 +00:00
Henry Oswald
a427634cbb lock down metrics and spelling 2015-09-17 10:42:36 +01:00
Brian Gough
af21e0aec6 add metrics for memory and gc 2015-08-18 12:31:35 +01:00
Brian Gough
518dc17fdc upgrade to mongojs 1.3.0 (use mongodb-core driver)
also add garbage collection
2015-08-18 09:56:05 +01:00
Henry Oswald
b32064e2d5 bump logger-sharelatex 2015-06-08 13:10:53 +01:00
Henry Oswald
d0b6a4157f Merge branch 'master' of https://github.com/sharelatex/spelling-sharelatex 2015-06-07 11:43:51 +01:00
Henry Oswald
c3c5d8720a update mongojs driver 2015-06-07 11:43:43 +01:00
Brian
9a41def921 increase time allowed for exiting ASpellWorker test from 100ms to 1s 2015-05-20 20:42:49 +01:00
Brian
81fb8de1db allow mocha timeout to be specified on grunt command line 2015-05-20 20:41:51 +01:00
Brian Gough
f70476284b move callback _.once down to Worker, add handler for process close event
should fix timeout errors in tests
2015-05-20 11:53:28 +01:00
Brian Gough
6a241cba28 add grep option to grunt test:unit 2015-05-20 11:45:32 +01:00
Brian Gough
6e0d72a3b1 timeout does not need async test here 2015-05-20 11:45:17 +01:00
Brian Gough
da7250c6f2 disable logger in tests 2015-05-20 11:44:54 +01:00
Henry Oswald
800666fcb5 make startup message consistent 2015-04-30 15:05:49 +01:00
James Allen
f3338f621e Release version 0.1.4 2015-03-20 15:25:59 +00:00
James Allen
f7e0f0c54b Add comment about tests on OS X 2015-03-20 15:02:26 +00:00
Brian Gough
01d5322ef3 fix end of stream marker to handle languages like en_GB
when using language like 'en_GB' aspell reports it as 'en' in response
to $$l
2015-03-12 14:41:23 +00:00
Brian Gough
a91faaf55c use the language code $$l as the end of stream marker
cannot use a custom word in the session dictionary due to language
restrictions on allowed characters, e.g. armenian 'hy' does not allow
latin characters
2015-03-12 12:33:45 +00:00
Brian Gough
86d1092f85 include log line for each spell check 2015-03-12 11:43:09 +00:00
Brian Gough
e4a3e63ff7 remove unused parameter 2015-03-12 11:42:59 +00:00
Brian Gough
c9771272df include log message for process timeout 2015-03-12 11:24:04 +00:00
Brian Gough
821f4b9a24 clean up timers when Aspell process exits 2015-03-12 11:13:58 +00:00
Brian Gough
00153e61ad trim output when error occurs 2015-03-12 11:12:46 +00:00
Brian Gough
3bbd0d49a9 don't let error events overwrite exit event
(not sure if this can happen but it would be bad if it did)
2015-03-12 10:27:50 +00:00
Brian Gough
c8103a4f35 don't run the idle shutdown timer if the process has errored 2015-03-12 10:27:11 +00:00
Brian Gough
3da42df92c log when a worker is removed from the pool 2015-03-12 10:26:52 +00:00
Brian Gough
3542918941 add logging for ASpell worker errors 2015-03-12 09:55:15 +00:00
Brian Gough
7936269804 add metrics for ASpell workers 2015-03-12 09:54:57 +00:00
Brian Gough
ed33cd59b7 show hit rate to 2dp only 2015-03-12 09:53:58 +00:00
Brian Gough
b684ed0837 put a unique end of stream marker in the session dictionary 2015-03-11 16:58:22 +00:00
Brian Gough
a655041bdd fix typo in iterator for cache object 2015-03-11 15:57:33 +00:00
Brian
31f6013172 increase delay for timeout in test 2015-03-11 15:38:19 +00:00
Brian
080f33335a added stress test example 2015-03-11 15:37:18 +00:00
Brian
c3a70b6184 fix bug in worker cleanup 2015-03-11 14:53:06 +00:00
Brian
220f82a395 store suggestions as language:word instead of word
avoid words like 'constructor' from accessing properties of
suggestions object.
2015-03-11 14:52:06 +00:00
Brian
9bb534707f shutdown workers when idle 2015-03-10 13:33:05 +00:00
Brian
9c0272445f extend worker to include request count 2015-03-10 13:32:42 +00:00
Brian
5ba5fd5533 fix caching logic to include valid words, as well as mispellings
include logging of cache hits
2015-03-10 13:31:06 +00:00