Brian Gough
9d6101e365
Merge pull request #3 from sharelatex/bg-rate-limit
...
rate limit on logging
2017-03-29 16:26:16 +01:00
Brian Gough
9c7494eb67
fix off-by-one error in error count
2017-03-29 13:38:07 +01:00
Brian Gough
c7a6f44b11
add unit tests
2017-03-29 13:38:07 +01:00
Shane Kilkelly
7cf65d072d
Add a .nvmrc file
2017-03-27 15:28:36 +01:00
Shane Kilkelly
bd1d6aa9c3
Add a .nvmrc file
2017-03-27 14:59:09 +01:00
Shane Kilkelly
d0eaa235a3
bump package version
2017-03-23 15:32:12 +00:00
Shane Kilkelly
6dbcc34df6
reduce UV thread-pool size to 16
2017-03-23 15:31:05 +00:00
Brian Gough
013c2a693c
rate limit on logging v1.5.6
2017-03-23 13:54:44 +00:00
Shane Kilkelly
c930f6c680
bump to version 1.5.5
2017-03-22 14:59:40 +00:00
Shane Kilkelly
27c6390f4c
upgrade to coffee-script 1.12.4
2017-03-22 14:46:42 +00:00
Shane Kilkelly
7bdba3756b
Don't bother checking for error properties on error object
2017-03-21 14:19:12 +00:00
Shane Kilkelly
f2ebdd1662
Increment stats for success/failure of wrapped async calls
2017-03-20 16:54:40 +00:00
Shane Kilkelly
1f77cc0fd3
If function is called without callback, apply with original args
2017-03-20 16:37:53 +00:00
Shane Kilkelly
fbe19cd97d
Don't return early in case where last arg is not a function
2017-03-20 16:25:10 +00:00
Shane Kilkelly
31235beee5
Don't throw error if the function is not invoked with callback.
...
Instead, log the error and return early.
2017-03-20 16:17:22 +00:00
Shane Kilkelly
9846703be5
Bump version
2017-03-20 10:17:09 +00:00
Shane Kilkelly
be2c6a96af
Log args and their indexes, if they look like object ids
2017-03-17 14:20:13 +00:00
Shane Kilkelly
e7f71a25d8
Use an explicit prefix
2017-03-17 11:47:38 +00:00
Shane Kilkelly
f397678589
Clean up, don't allocate an extra date
2017-03-16 15:07:25 +00:00
Shane Kilkelly
5ea83947dd
remove stray compiled js file
2017-03-16 10:10:40 +00:00
Shane Kilkelly
1f9d4950a2
Update gitignore
2017-03-16 10:09:16 +00:00
Shane Kilkelly
772f950d7c
Test failure when wrapped method is not async/callback
2017-03-16 10:07:52 +00:00
Shane Kilkelly
a5aec5b812
Test failure to wrap method
2017-03-16 10:02:19 +00:00
Shane Kilkelly
40b238271d
Add tests for methods producing errors, and logger
2017-03-16 09:55:07 +00:00
Shane Kilkelly
c3b18618bf
Add unit tests
2017-03-16 09:49:45 +00:00
Shane Kilkelly
e99a7f6a87
refactor
2017-03-15 16:07:36 +00:00
Shane Kilkelly
3cb0ab2784
Add a 'timeAsyncMethod' helper
2017-03-15 15:06:54 +00:00
James Allen
aebaff829b
Update package.json
2017-03-06 12:09:37 +00:00
Brian Gough
dfb2a069c0
use try catch around sentry logging
2017-03-03 16:05:56 +00:00
Brian Gough
5fc5a86b31
upgrade to latest raven
2017-03-03 14:43:41 +00:00
Brian Gough
68b941357e
avoid uninitialised last error timestamp
2017-02-23 09:42:01 +00:00
Brian Gough
6e3f102fb2
rate limit on sentry reporting
2017-02-23 09:29:52 +00:00
James Allen
caeac717fc
Set UV_THREADPOOL_SIZE to 128 for all processes
2016-10-24 10:50:44 +01:00
Brian Gough
cf0e106153
release 1.5.1
2016-04-01 15:52:42 +01:00
Brian Gough
24e097d263
don't force message over exception but include it as description
2016-04-01 15:52:28 +01:00
Brian Gough
7bdf2ef26b
release 1.5
2016-04-01 15:35:54 +01:00
Brian Gough
fdc1ad2898
use logger.error message as title of sentry report
2016-04-01 15:35:14 +01:00
Brian Gough
04529c0019
release 1.4
2016-03-30 14:30:05 +01:00
Brian Gough
e04e6332e8
add fatal exception reporting
...
split out capture exception code into separate method
2016-03-29 12:53:16 +01:00
Shane Kilkelly
9c6df30031
remove deps
2016-03-25 14:51:52 +00:00
Shane Kilkelly
e6e3fb6948
change to be a class, with settings passed in
2016-03-25 14:33:38 +00:00
Shane Kilkelly
7786ef9ed8
set package to private
2016-03-25 11:06:11 +00:00
Shane Kilkelly
fc3c0d1384
init (copied from thirdpartydatastore-sharelatex)
2016-03-25 11:04:46 +00:00
Brian Gough
2df5845444
updated version to 1.5.0
2016-03-17 09:40:40 +00:00
Brian Gough
622bbe3123
return timeSpan from timers
...
to allow additional calculation
2016-03-15 13:52:40 +00:00
Brian Gough
29177f8de8
add support for statsd count method
2016-03-15 13:52:32 +00:00
Brian Gough
e8b8cfd9e0
release version 1.3.1
2016-01-26 16:42:08 +00:00
Brian Gough
17cf288e4c
recreate Error objects from plain objects when logging to sentry
2016-01-26 16:41:52 +00:00
Brian Gough
2e21da050c
add logging of request parameters to sentry
2016-01-05 13:34:50 +00:00
Brian Gough
fd70f23e5c
updated version to 1.2.1
2015-12-18 10:58:03 +00:00
Brian Gough
06662f869f
capture id's as tags, and pass attributes to sentry
2015-12-17 16:41:32 +00:00
Brian Gough
f1abe1e03b
allow passing options to sentry
2015-12-08 10:30:18 +00:00
James Allen
8db30020ae
Monitor event loop by looking for skew
...
If we monitor with setImmediate, we miss big blocking loops. For example,
suppose we have 1000 1ms loops then a single bad 1000ms loop. setImmediate
will only be called at the right time 1/1000 of the time (it has to be the
loop just before the bad one). So this monitoring method gives a good average
if the std dev is low, but doesn't pick up spikes.
Instead, we can monitor the skew from the expected time between setIntervals.
In the case above, with a setInterval for 1000ms, we will pick up a skew
proportional to the amount of time that it overlaps the bad loop. So 50%
change of picking up skew > 500ms, and thus getting a good sense of any
spikes.
2015-12-03 16:32:20 +00:00
Henry Oswald
30bfae5b35
upgraded bunyan
2015-12-01 20:51:08 +00:00
James Allen
738363a6de
Set maxSockets to Infinity for all services
2015-08-31 14:02:03 +01:00
Brian Gough
0215b12a5f
log memory usage every minute
2015-08-20 17:03:58 +01:00
Brian Gough
f237f7c3cc
remove bug in optional argument handling
2015-08-18 11:23:10 +01:00
Brian Gough
27c382416a
fix whitespace
2015-08-17 15:19:13 +01:00
Brian Gough
e3e8d80466
remove non-working metrics from graphite
2015-08-17 15:19:07 +01:00
Brian Gough
d2af7b24a0
remove randomisation to avoid shutdown problems
2015-08-17 15:18:18 +01:00
Brian Gough
577a3759c0
bugfix for memory chunk size
2015-08-14 15:44:24 +01:00
Brian Gough
46ec20ef9c
add memory check and periodic gc
2015-08-14 14:38:24 +01:00
Brian Gough
175e3efd5f
update package version to 1.2.0
2015-08-06 09:40:58 +01:00
Brian Gough
349b499f85
add compatibility with v2 mongo driver
2015-07-30 08:57:43 +01:00
Brian Gough
ffa523bced
added monitoring of event loop time
...
should indicate if node is blocking on libuv threads
as described in https://nodejs.org/api/dns.html#dns_dns_lookup
2015-06-23 10:51:48 +01:00
James Allen
90e6c85e54
Send errors to Sentry if configured
2015-06-16 16:50:18 +01:00
Henry Oswald
5637678b48
bumped bunyan version to work with node 0.12
2015-06-08 10:01:45 +01:00
Henry Oswald
9329249bc9
Revert "reduce memory capture in http logger"
...
This reverts commit fc2e043b20204e04f240814d4efc05762db7df96.
Had to revert this because req.route.path is not set until a matching
route has been hit, so it was always null inside res.end meaning
statsd data was never sent over.
This commit did not actually stop the memory leak so reverting it
has not short term repocusion
2015-05-14 16:14:24 +01:00
Brian Gough
1e0a991fcd
reduce memory capture in http logger
...
only capture the properties of 'req' that we need, to avoid leaking
the whole req object for responses that never call res.end()
2015-05-05 10:50:59 +01:00
Brian Gough
fa7e068ebb
update minor version, due to addition of new close() method
2015-01-05 16:46:44 +00:00
Brian Gough
30070f23b8
add a close() method to terminate the module cleanly
...
closes the statsd connection and cancels registered interval timers
prevents express from hanging when trying to shutdown
2015-01-05 16:45:32 +00:00
Henry Oswald
3334a55944
bump package
2014-11-20 12:50:31 +00:00
Henry Oswald
917ce27a2c
add a double message check
2014-11-20 12:50:19 +00:00
Henry Oswald
119ae80853
bump package.json
2014-11-20 11:09:57 +00:00
Henry Oswald
ef0ea2ace2
if redis fails once mark it to always fail
2014-11-20 11:09:44 +00:00
Henry Oswald
e133c7101e
incremented version and added basic health check function in
2014-11-19 23:18:56 +00:00
Henry Oswald
6da4f3eef5
bump package
2014-11-19 16:41:28 +00:00
Henry Oswald
4cd3c249ec
removed reconnect stuff
2014-11-19 16:39:06 +00:00
James Allen
1ee287ed98
add createMonitoredSubscriptionClient method
2014-11-19 14:05:16 +00:00
James Allen
42cbaecbe0
Let the client take care of reconnecting only when the stream is actually ended
2014-11-19 12:30:10 +00:00
James Allen
861eafd88d
Handle reconnect logic better to (hopefully) avoid duplicate connections
2014-11-19 11:52:40 +00:00
James Allen
db3537a8eb
Reset heartbeat timer after triggering a reconnect
2014-11-19 11:25:09 +00:00
James Allen
b67b49564d
Revert "Use own fork of node-redis-sentinel"
...
This reverts commit a351534a5f0e50656430ff37d2f6c42f701096d0.
2014-11-19 11:21:36 +00:00
James Allen
e988dc8586
Don't need secure random bytes which can error if not enough entropy
2014-11-19 11:18:31 +00:00
James Allen
68c428545d
Don't hash because Henry is hashist!
2014-11-19 11:16:43 +00:00
James Allen
c90cc61570
Set retry_max_delay to 5 seconds so that reconnects don't slow down exponentially
2014-11-19 11:02:27 +00:00
James Allen
230203eadf
Add in robust heartbeat driven subscription model
2014-11-19 11:01:02 +00:00
James Allen
79afad5409
Use own fork of node-redis-sentinel
2014-11-18 15:49:27 +00:00
James Allen
8808097f2c
Add javascript wrapper so it can be loaded directly
2014-11-07 15:02:45 +00:00
Henry Oswald
4fd5191528
bump package
2014-09-29 12:02:38 +01:00
Henry Oswald
c63f3c9da9
added readme
2014-09-29 12:00:03 +01:00
Henry Oswald
8f31ac60ca
if password is passed rename it to auth_pass
2014-09-29 11:40:40 +01:00
Henry Oswald
a33f537cb1
increment package
2014-09-28 20:34:20 +01:00
Henry Oswald
f554ea8bd5
change underscore dep
2014-09-28 20:33:29 +01:00
Henry Oswald
a0c861cf5d
pass entire redis object though with all opts in one go
2014-09-26 14:46:23 +01:00
Henry Oswald
629241611b
v1 of the redis driver wrapper
2014-09-25 17:33:27 +01:00
James Allen
60857982b6
Create LICENSE
2014-09-08 09:19:39 +01:00
James Allen
5f50672342
Create LICENSE
2014-09-08 09:17:55 +01:00
James Allen
1dc82ef624
Release version 1.0.0
2014-08-19 13:35:15 +01:00
James Allen
9acca85843
Release version 1.0.0
2014-08-19 13:32:41 +01:00
James Allen
c1e10e7ec4
Release version 1.0.0
2014-08-19 13:30:16 +01:00
Henry Oswald
c8fae26995
changed type to query_type as it conflicts with logstash
2014-05-13 15:24:23 +01:00
James Allen
1dea55d8f2
Check that req.route.path is set
2014-05-12 15:28:09 +01:00
James Allen
284d8fb588
Namespace gauge keys correctly
2014-05-09 13:54:33 +01:00
James Allen
00c0036ca5
Add open socket monitoring
2014-05-09 13:30:12 +01:00
James Allen
86f220a2d2
Add collection into graphite key
2014-05-07 11:50:09 +01:00
James Allen
45ec60d8a6
Fix broken key building in timer
2014-05-07 11:43:46 +01:00
James Allen
873297b02e
Namespace http request keys
2014-05-07 11:13:21 +01:00
James Allen
befb48a20f
Use correct key in Metrics.timing
2014-05-07 11:08:46 +01:00
James Allen
f4895fb04f
Add in http monitoring
2014-05-07 10:58:52 +01:00
James Allen
4da7fa43fa
Scope name argument properly
2014-05-06 17:33:09 +01:00
James Allen
125790b604
Ignore all queries
2014-05-06 17:19:04 +01:00
James Allen
00c12ccab6
Remove redundant count
2014-05-06 17:06:34 +01:00
James Allen
15f85494b7
Sort out initialization and ignore noisy mongo requests
2014-05-06 17:02:51 +01:00
James Allen
42b500263a
Create metrics module
2014-05-06 16:52:03 +01:00
James Allen
0da921311c
Preserve arrays
2014-04-03 11:14:28 +01:00
James Allen
4f377c5fa2
Remove unnecessary logging
2014-04-02 21:27:27 +01:00
James Allen
89d09340f5
Don't log out the settings
2014-04-02 17:43:11 +01:00
James Allen
c06e237e31
Load and merge defaults if available
...
Load and merge defaults if available
2014-04-02 17:39:14 +01:00
James Allen
6baf4ebe85
Take config from SHARELATEX_CONFIG env variable
2014-02-19 13:21:32 +00:00
James Allen
58cd9ced1a
Initial open source commit
2014-02-17 14:54:20 +00:00
James Allen
3133f85164
Initial open source commit
2014-02-17 14:51:21 +00:00