github/overleaf
1
0
Fork 0
mirror of https://github.com/overleaf/overleaf.git synced 2024-11-30 04:25:17 -05:00
Code Issues Projects Releases Packages Wiki Activity
23053 commits 3 branches 7 tags 206 MiB
Commit graph

754 commits

Author SHA1 Message Date
Alasdair Smith
4642d55b7b Add basic example script 2018-01-15 16:23:10 +00:00
Alasdair Smith
9fbd7f2818 Install webpack and babel 2018-01-15 16:23:10 +00:00
James Allen
662122bb1c CI and local dev environment improvements 
The need for this became very noticeable due to the slowness of filesystem access in docker-in-mac, with a full compile taking over a minute for me in docker. Using make to introduce incremental compile makes this near instantaneous outside of docker (if only a few files have changed), and quick enough inside docker.

With incremental compile via make, it compiles quickly enough that re-compiling and restarting the web service automatically when backend files change is quick enough now. This is how the service is run via docker-compose in https://github.com/sharelatex/sharelatex-dev-environment, so it shouldn't be necessary to manually restart the container each time a coffee file changes.

At the moment Jenkins pull web modules in via the GitSCM plugin, but I believe this is creating a dependency in Jenkins, where any commits to any of the modules causes all of the web branches to rebuild. By doing it via our own scripts we can hopefully avoid this. It also creates a build process which is reproducible locally.

**Note that at the moment in this PR all modules pull from `ja-dockerize-dev` branches, but these should be merged first, and this PR updated to point to the master branches before merging**. This is necessary for other changes to build process/docker-compose workflow.

As well as a Makefile for web, there is now a `Makefile.module`. This is copied into each module directory by the top-level Makefile, and is written in a way to be flexible and support unit tests, acceptance tests, front-end js for the ide and main, and the modules `app/coffee` directory, while allowing modules to have some of these missing (not all modules have e.g. acceptance tests, or front-end JS). This will allows us to refine the build process in future, without needing to update the Makefile in each module repo separately (I found this to be a painful part of this development).

This makes web compatible with the docker-compose workflow at https://github.com/sharelatex/sharelatex-dev-environment, where each service is running in its own docker container, with networking managed by docker.

Previously the Makefile was set up to run unit tests in docker with `make unit_tests`. This now just runs them natively. In the CI, they are run in docker anyway (all steps in Jenkins are), and locally, they run fine natively with `npm run test:unit`, or can be run in docker via https://github.com/sharelatex/sharelatex-dev-environment with `bin/run web_sl npm run test:unit`.

Previously we did a lot of juggling with only mounting source files (coffee, less, etc) into the docker container for acceptance tests. This was to avoid creating root owned files if the whole directory was mounted. Now instead the whole web directory is mounted read-only, with the compilation step done outside of the container before running the tests.

This allows the host and container to share the `node_modules` folder as well, which avoids needing to `npm install` twice on the CI box, and should speed up the build by a few minutes.

On macOS, this would cause a problem with compiled modules if you tried to use the same `node_modules` to run the app natively. However, if running via docker-compose in https://github.com/sharelatex/sharelatex-dev-environment, this is no longer a problem.
 2018-01-15 09:36:41 +00:00
Tim Alby
08b74c95f5 proxy requests to analytics service 2018-01-10 15:03:14 +02:00
James Allen
d7a26e27e5 Run front end tests in CI 2017-12-19 13:58:47 +00:00
James Allen
8ea779af58 Add some front end tests for HistoryManager 2017-12-19 13:58:47 +00:00
Henry Oswald
bd7e2d956d add mandrill as email option 2017-12-11 11:05:04 +00:00
James Allen
e62ec77161 Merge pull request #180 from sharelatex/ja-quiet-npm 
Run npm with -q flag for less verbose test output
 2017-12-01 08:32:46 +00:00
Hayden Faulds
e916fc906a add mkdirp dev dependency 2017-11-30 13:15:39 +00:00
James Allen
870e87ebe1 Run npm with -q flag for less verbose test output 2017-11-30 11:00:28 +00:00
James Allen
50b3045548 Tidy up docker-compose and makefile 2017-11-29 13:49:36 +00:00
James Allen
4c504ad8eb Remove debugging command 2017-11-27 17:10:58 +00:00
James Allen
5e0fc24c1a Allow modules to specific their own acceptance tests 2017-11-27 17:10:58 +00:00
James Allen
d9d7c96958 Get module unit tests running inside Docker as well as main tests 2017-11-27 17:10:58 +00:00
James Allen
fbf8cc2d03 Run acceptance tests via docker compose 2017-11-27 17:10:58 +00:00
Brian Gough
41819db7c5 remove unnecessary redis package 2017-10-30 15:41:32 +00:00
Brian Gough
e474344204 remove unnecessary ioredis package 2017-10-30 15:41:09 +00:00
Brian Gough
ebd28a8353 upgrade ioredis vis redis sharelatex 2017-10-30 15:40:56 +00:00
Brian Gough
d6d76f132e replace unzip with yauzl 2017-10-16 14:15:38 +01:00
James Allen
38b8450cee Add jsonwebtoken package 2017-10-03 10:29:49 +01:00
James Allen
1502da85cf Set up acceptance tests to run in docker container 2017-09-27 10:37:20 +02:00
Shane Kilkelly
54070c7734 pin chai 2017-09-12 11:21:34 +01:00
Tim Alby
d6834ff417 add security headers using Helmet 
- use all Helmet's default headers except `X-DNS-Prefetch-Control`
- use `Referrer-Policy`
- use cache headers when:
  - a user is logged in, OR
  - a project is displayed
 2017-09-12 11:17:59 +02:00
James Allen
b4254f06ef Update Project schema for overleaf imports 2017-08-21 17:49:08 +02:00
James Allen
eac0ce8353 Initial spike of Overleaf based logins 2017-08-08 14:00:21 +02:00
Paulo Reis
2fcbafa72d Add HTML encoder lib. 2017-07-28 17:30:57 +01:00
Joe Green
10683cbd8c upgraded mongoose package 2017-07-27 10:58:20 +01:00
James Allen
e19f5a1a5e Update redis-sharelatex and shrinkwrap 2017-05-09 17:18:04 +01:00
James Allen
3f51911513 Update to latest redis-sharelatex 2017-05-04 15:25:58 +01:00
Shane Kilkelly
bb65da88fe Merge branch 'master' into node-6.9 2017-04-05 10:15:51 +01:00
Shane Kilkelly
60b298d9ee upgrade to latest metrics 2017-03-31 14:43:19 +01:00
Shane Kilkelly
ca3497b6f6 Update metrics version to 1.7.0 2017-03-21 13:46:42 +00:00
Shane Kilkelly
98d7dc6f88 Make work on both 0.10 and 6.9 2017-02-27 13:54:57 +00:00
Shane Kilkelly
8d7c39ff42 Merge branch 'master' into node-6.9 2017-02-27 11:25:39 +00:00
Shane Kilkelly
bd997fc574 pin sinon js to 1.17, version 2 betas cause breakage 2017-02-27 11:01:25 +00:00
James Allen
2df8479db3 Move translations back to devDependencies so it's not missed by shrinkwrap 2017-02-21 15:25:28 +01:00
James Allen
f180b25850 Convert track changes text to translation strings 2017-02-17 16:28:53 +01:00
Shane Kilkelly
621a07aff2 Merge branch 'master' into node-6.9 2017-02-14 11:01:14 +00:00
Shane Kilkelly
4e9426e6bf Merge branch 'master' into sk-pug 2017-01-30 14:36:10 +00:00
Shane Kilkelly
3ed85dad42 Merge branch 'master' into sk-upgrade-uuid 2017-01-30 11:09:50 +00:00
James Allen
32b0c6a4fb Merge pull request #398 from sharelatex/ja-track-changes 
Fix style issues in IE 10
 2017-01-25 15:55:15 +01:00
Shane Kilkelly
abbffb8e4b Remove deprecated node-uuid package, replace with uuid. 2017-01-23 10:03:16 +00:00
Shane Kilkelly
57cd54bf55 WIP: migrate from jade to pug 2017-01-20 12:03:02 +00:00
Paulo Reis
e0f3593bff Add autoprefixer to Grunt tasks. 2017-01-18 15:38:18 +00:00
Shane Kilkelly
1ef1912cf8 Point to fork of rolling-rate-limiter that supports ioredis 2017-01-13 15:21:05 +00:00
Shane Kilkelly
5c25d15a18 WIP: try switch to rolling rate limiter 2017-01-12 09:25:18 +00:00
Shane Kilkelly
64f69069b2 Experimental: upgrade to node 6.9.2 (latest LTS release) 2016-12-21 10:23:42 +00:00
Henry Oswald
bcf9a17fb3 Merge branch 'master' into node-4.2 2016-12-20 15:23:02 +00:00
Shane Kilkelly
ef0a5801d5 Create a RedisWrapper, and use it for rate limiting. 2016-12-19 12:17:02 +00:00
Henry Oswald
d87067bc2f Merge branch 'announcments' 2016-11-15 10:38:01 +00:00
Henry Oswald
47ed17aab3 remove unneeded package and comma in jade 2016-11-14 10:50:49 +00:00
Henry Oswald
5a13ee1077 use anlaytis api 
- don’t talk to postgres
- show recent blog post announcments
- proxy all events to analytics api
 2016-11-11 17:03:09 +00:00
Shane Kilkelly
8726a8fb4d Add passport-saml dependency 2016-11-11 09:09:00 +00:00
Shane Kilkelly
bfa0e7cf89 WIP: start moving web sessions to cluster 2016-11-08 15:32:36 +00:00
Shane Kilkelly
9cb3d8c4b8 Enable hook from module into passport init. 2016-11-01 14:06:54 +00:00
James Allen
49fecc9ef4 Use v1.6.0 of metrics 2016-10-24 10:51:20 +01:00
Henry Oswald
7b83a941ee Merge branch 'master' into node-4.2 2016-10-19 13:04:26 +01:00
Shane Kilkelly
e4f4325150 Basic passport integration 2016-09-02 16:17:37 +01:00
James Allen
93cd511211 Send events to custom DB backend 2016-08-10 16:42:56 +01:00
Henry Oswald
23cb6a9419 Merge branch 'master' into node-4.2 2016-07-28 13:54:06 +01:00
Paulo Reis
8eae4e4044 Revert "Use custom shrinkwrap to ignore the translations package." 
This reverts commit 25a8a7cd9a59f738277ce893318c69db539384d6.
 2016-07-12 13:42:46 +01:00
Paulo Reis
112a64ce84 Use custom shrinkwrap to ignore the translations package. 2016-07-12 13:37:26 +01:00
Henry Oswald
a9f3a29b72 moved translations to dev dependency so its not included in shrinkwrap. 2016-07-12 10:17:58 +01:00
Henry Oswald
85936a1391 moved css min to exec, import was not working via grunt 2016-07-10 11:04:51 +01:00
Henry Oswald
7cb266d904 removed imagemin 2016-06-30 14:59:05 +01:00
Brian Gough
afc89d8d27 added missing package grunt-execute 2016-06-28 10:42:36 +01:00
Henry Oswald
d35a48e683 minfiy css as well 2016-06-18 21:49:32 +01:00
Henry Oswald
1d26be30a9 added grunt imagemin used to compress images 2016-06-18 16:50:56 +01:00
Henry Oswald
560b7f7177 grunt will auto recompile client and less now, run concurrently 2016-06-15 12:08:11 +01:00
Henry Oswald
79929eae73 Merge branch 'clsichecks' 2016-06-06 14:34:22 +01:00
Henry Oswald
2339cda318 added contentful uni pages as fallback 2016-06-06 09:28:53 +01:00
Henry Oswald
bc59b15bd8 mark grunt at 0.4.1. in package.json 2016-06-02 15:24:10 +01:00
Henry Oswald
1dd4ea176a Merge branch 'master' into node-4.2 2016-06-02 15:20:57 +01:00
Henry Oswald
734b5613a5 fix package.json 2016-06-02 15:20:18 +01:00
Henry Oswald
8529cb50b6 rolled back underscore and added lodash in 2016-06-02 13:18:07 +01:00
Henry Oswald
66ad587c9c bump underscore to 1.8.3 2016-06-01 16:46:11 +01:00
Henry Oswald
2abebd850c Merge branch 'project_url_query' into clsi-dynamic-load 2016-05-19 13:08:20 +01:00
Shane Kilkelly
30a778c8e8 add temp module 2016-05-13 13:30:00 +01:00
Henry Oswald
b37595acf9 persist cookie in redis for compiles. 2016-04-19 16:48:51 +01:00
Henrique Dias
38c8eb868a Update package.json 2016-04-06 11:30:26 -03:00
Henry Oswald
bd54218cc9 added grunt as depenency 2016-04-05 14:17:36 +01:00
Henry Oswald
1a651b38f4 added sendgrid as email option 2016-03-29 14:15:33 +01:00
Henry Oswald
f4cbcc22ba Merge branch 'master' into node-4.2 2016-03-14 16:20:39 +00:00
James Allen
e1fa77dd72 Add beginnings of acceptance tests 2016-03-08 15:59:04 +00:00
Henry Oswald
05bf048885 upgrade to nodemailer 2.0 and dynamically use either SES or SMTP depending 
on what is in settings file
 2016-02-12 17:13:45 +00:00
Brian Gough
5316451f90 update logger-sharelatex to v1.3.1 to improve sentry logging 2016-01-26 16:53:54 +00:00
Brian Gough
d3971e4d4f upgrade logger-sharelatex to v1.3.0 to fix sentry reporting bugs 2016-01-08 14:19:40 +00:00
Brian Gough
91a047ea7a added sentry error reporting 2015-12-08 12:16:00 +00:00
James Allen
50112a59d4 Monitor memory usage and do periodic GC 2015-12-03 10:52:06 +00:00
Henry Oswald
1d0228ce0c updated packages to work with node 4.2 
still needs a deep test
 2015-12-01 21:28:35 +00:00
Henry Oswald
9383977ca5 remove socket.io as a dependency 2015-12-01 21:18:00 +00:00
Henry Oswald
69734c20c0 added heapdump endpoint 2015-11-30 16:16:16 +00:00
Henry Oswald
49e6f4db87 set NODE_TLS_REJECT_UNAUTHORIZED to 0 for testing 
allows us to talk to staging sixpack
 2015-11-12 12:38:35 +00:00
Henry Oswald
377cc11c3b added sixpack to server side 2015-11-12 09:29:44 +00:00
Henry Oswald
f5162d424f if a user is inactive for 12 hours disconect them. 2015-10-14 14:28:24 +01:00
Henry Oswald
e593b3f717 append string to ide.js min which we can use for testing via status cake 2015-10-09 10:11:38 +01:00
Henry Oswald
011f628de8 lock down translations version 2015-09-17 10:26:29 +01:00
Brian Gough
a25373d53e update metric-sharelatex to v1.2.0 for mongodb-core support 2015-08-06 09:44:47 +01:00
Brian Gough
2bc003894b use latest version of metrics with commit id until ready to tag 2015-08-02 15:55:26 +01:00
Brian Gough
c5cc639bff upgrade mongoose from 3.8.28 to 4.1.0 2015-08-02 15:24:17 +01:00
Henry Oswald
56346ad88c remove analytics router and fixed bad package.json 2015-07-01 15:48:23 +01:00
Henry Oswald
665bdcf538 v1 of express4 conversion 2015-07-01 15:17:43 +01:00
Brian Gough
893de9d8ac updated metrics package version 2015-06-23 13:54:05 +01:00
Henry Oswald
2ec925b45e fairy removed from web, makes http request to tpds worker now 2015-06-22 22:33:04 +01:00
Henry Oswald
706c1824f0 changed package.json to use our fairy fork 2015-06-18 15:43:42 +01:00
Henry Oswald
fc72ca601e update package.json 2015-06-09 10:19:24 +01:00
Henry Oswald
eeead86fba updated mongoose 2015-06-02 16:24:40 +01:00
Diego Giovane Pasqualin
7c6ed0ff77 Update bcrypt to 0.8.3 
This new version compiles successfully on nodejs newer than 0.10.
 2015-05-11 16:43:29 -03:00
James Allen
f82f5e5479 Release version 0.1.4 2015-03-20 19:08:48 +00:00
Brian Gough
5d788ca7c5 add grunt version target to report version to sentry 
it writes the git commit id and Jenkins build number into the sentry
configuration
 2015-03-17 16:59:17 +00:00
James Allen
0f69ee0f22 Add in proxy for /socket.io so that we don't need to faff with real-time service location 2015-03-09 14:09:09 +00:00
James Allen
c495e5c492 Release version 0.1.3 2015-02-26 11:48:42 +00:00
Henry Oswald
d112ad22a8 added ldapjs to package.json 2015-02-20 15:23:24 +00:00
James Allen
000f01fbeb Remove unneeded uid module 2015-02-17 11:21:50 +00:00
James Allen
8e13ded360 Regenerate the session id after logging in or registering 2015-02-13 11:18:17 +00:00
James Allen
18723c2e26 Bump version to 0.1.2 2015-02-10 14:05:51 +00:00
James Allen
2aa229d145 Add in profiling end point 2015-02-03 11:05:23 +00:00
Henry Oswald
ee83ed6e81 started using underscore.string to check domain emails 2015-02-02 11:15:04 +00:00
Henry Oswald
3360b3c35a added basic domain allocation feature 2015-01-27 18:09:56 +00:00
Henry Oswald
24b3226fcf bump redis version 2014-11-20 12:50:55 +00:00
Henry Oswald
851764f269 bump package.json 2014-11-20 11:10:22 +00:00
Henry Oswald
6c746d9aec added redis health check in 2014-11-19 23:18:20 +00:00
Henry Oswald
57abc2cb24 lock down the version of redis 2014-11-19 16:45:10 +00:00
Henry Oswald
9e63b6c3a1 use redis 0.0.6 2014-11-19 16:41:12 +00:00
Henry Oswald
cd8c233c05 Revert robust redis connection code 2014-11-19 15:06:05 +00:00
James Allen
34e20e99f5 Pull redis from github master temporarily 2014-11-19 11:09:59 +00:00
James Allen
22346f5532 Revert "Pull redis from github master temporarily" 
This reverts commit 919fbdf8945bdd2cdb5ddda5a7ac8c5b7395597b.
 2014-11-18 18:01:58 +00:00
James Allen
f8cbc5d51a Pull redis from github master temporarily 2014-11-18 15:55:08 +00:00
James Allen
941f550d6c Remove all traces of soa-req-id 2014-10-15 14:11:02 +01:00
Henry Oswald
e35a32d7d7 take minor versions of redis-sharelatex 2014-09-29 12:48:26 +01:00
Henry Oswald
49e7777b6d bumped redis-sharelatex 2014-09-29 11:42:28 +01:00
Henry Oswald
f73629f8d9 v1 of sentinal support 2014-09-26 14:52:00 +01:00
Henry Oswald
30a25297a0 changed translations to be back on master branch, want them to auto update. need to talk about it 2014-08-20 13:48:07 +01:00
James Allen
3d25018aa1 Release version 0.1.0 2014-08-19 14:45:24 +01:00
James Allen
00829f0fbd Lock down module versions 2014-08-19 14:44:48 +01:00
Henry Oswald
39173fe583 Merge branch 'i18n' 
Conflicts:
	app/coffee/infrastructure/Server.coffee
	app/views/project/list.jade
	package.json
 2014-07-29 13:44:10 +01:00
James Allen
024e21e0ae Upgrade Jade 2014-06-04 16:28:20 +01:00
Henry Oswald
ce0fb75224 removed grunt-nodemon from package.json as its not used atm 2014-05-20 13:34:04 +01:00
James Allen
b29e94b4d5 Use new metrics package 2014-05-07 15:29:04 +01:00
Henry Oswald
a0fb170878 updated archive module to latest version 2014-04-28 16:27:15 +01:00
Henry Oswald
abbbdf463f Merge branch 'master' into i18n 
Conflicts:
	package.json
 2014-04-07 09:53:03 +01:00
Henry Oswald
6c700b1b6b updated more modules, mongojs and redis are the big ones 2014-04-01 16:23:13 +01:00
Henry Oswald
9cec91172c bumped up a lot of libs 2014-03-31 17:24:41 +01:00
Henry Oswald
78db95b539 removed dead packages 2014-03-31 17:00:16 +01:00
Henry Oswald
f0aeff2904 updated mongodb drivers 2014-03-31 16:59:35 +01:00
Henry Oswald
8ce13a6b1e changed xss lib to sanitize not validator 2014-03-31 16:46:28 +01:00
Henry Oswald
c718535068 use github translate-sharelatex module 2014-03-26 17:30:25 +00:00
Henry Oswald
ebacf86485 changed i18n to use seperate translate module which holds the translations 2014-03-26 16:35:13 +00:00
Henry Oswald
063a583ad3 got basic i18n working in express 2014-03-24 17:18:58 +00:00
Oliver Matthews
8989284e10 move from node-ses to nodemailer 2014-03-07 14:08:21 +00:00
Henry Oswald
ff8320bce0 added new rate limit file based on redback. converetd auto compile to 
use it.
 2014-02-28 17:59:54 +00:00
goodbest
b4482ab41f change repo URL from git+ssh:// to git+https:// 2014-02-21 23:08:19 +08:00
James Allen
51b7d8d837 Point settings and logger to github 2014-02-17 15:07:12 +00:00
James Allen
8715690ce9 Intial open source comment 2014-02-12 10:23:40 +00:00