[ovs-discuss] openvswitch not fault tolerant or contain failover mechanism

Ben Pfaff blp at ovn.org
Fri Jan 25 00:38:43 UTC 2019


It's hard for me to connect this information up with an OVS bug.

Greg, our kernel expert, is already following up with you.  He can
probably lead you down the best path, if you suspect a kernel module
bug.

On Fri, Jan 25, 2019 at 03:22:55AM +0300, Amer Hwitat wrote:
> OK .. good ... like I left my VM running and came back found it powered off
> .. due to this Error I copied earlier ... the thing is I connect my laptop
> to tethered connection (bridged the wireless) on my Huwayi phone ... got
> something to do .. left the place for about half an hour .. then found a
> message on the VMware workstation saying the Machine was powered off due to
> CPU failure .. I was running openstack on this VM ... and troubleshooting
> it .. the watchdog message was earlier to this ... then I connected events
> ... if the connection is down .. for the vBridge .. with no fail mechanism
> it will loop the CPU causing it to fail .. I have 4 cores VM .. i7 laptop
> .. the processor utilization is low Moderate usually on my laptop ... I
> will check the log for the server ..
> 
> ken pipe
> 2019-01-24T18:41:15.055Z|01776|reconnect|WARN|tcp:127.0.0.1:52700:
> connection dropped (Broken pipe)
> 2019-01-24T18:41:15.055Z|01777|jsonrpc|WARN|tcp:127.0.0.1:52706: send
> error: Broken pipe
> 2019-01-24T18:41:15.059Z|01778|reconnect|WARN|tcp:127.0.0.1:52706:
> connection dropped (Broken pipe)
> 2019-01-24T18:41:15.059Z|01779|jsonrpc|WARN|tcp:127.0.0.1:52708: send
> error: Broken pipe
> 2019-01-24T18:41:15.062Z|01780|reconnect|WARN|tcp:127.0.0.1:52708:
> connection dropped (Broken pipe)
> 2019-01-24T18:41:26.008Z|01781|timeval|WARN|Unreasonably long 5958ms poll
> interval (14ms user, 1ms system)
> 2019-01-24T18:41:26.505Z|01782|timeval|WARN|faults: 47 minor, 20 major
> 2019-01-24T18:41:26.505Z|01783|timeval|WARN|disk: 3344 reads, 0 writes
> 2019-01-24T18:41:26.505Z|01784|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T18:41:36.359Z|01785|timeval|WARN|Unreasonably long 8395ms poll
> interval (10ms user, 8ms system)
> 2019-01-24T18:41:38.662Z|01786|timeval|WARN|faults: 75 minor, 26 major
> 2019-01-24T18:41:41.183Z|01787|timeval|WARN|disk: 4768 reads, 0 writes
> 2019-01-24T18:41:41.183Z|01788|timeval|WARN|context switches: 31 voluntary,
> 0 involuntary
> 2019-01-24T18:41:41.184Z|01789|coverage|INFO|Dropped 1 log messages in last
> 15 seconds (most recently, 15 seconds ago) due to excessive rate
> 2019-01-24T18:41:42.128Z|01790|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:41:43.884Z|01791|timeval|WARN|Unreasonably long 1628ms poll
> interval (2ms user, 2ms system)
> 2019-01-24T18:41:43.884Z|01792|timeval|WARN|faults: 80 minor, 7 major
> 2019-01-24T18:41:43.884Z|01793|timeval|WARN|disk: 2064 reads, 0 writes
> 2019-01-24T18:41:43.884Z|01794|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T18:42:02.737Z|01795|timeval|WARN|Unreasonably long 1149ms poll
> interval (2ms user, 0ms system)
> 2019-01-24T18:42:03.933Z|01796|timeval|WARN|faults: 2 minor, 4 major
> 2019-01-24T18:42:03.933Z|01797|timeval|WARN|disk: 864 reads, 0 writes
> 2019-01-24T18:42:03.933Z|01798|timeval|WARN|context switches: 4 voluntary,
> 0 involuntary
> 2019-01-24T18:42:08.594Z|01799|timeval|WARN|Unreasonably long 4364ms poll
> interval (9ms user, 5ms system)
> 2019-01-24T18:42:08.702Z|01800|timeval|WARN|faults: 43 minor, 18 major
> 2019-01-24T18:42:08.702Z|01801|timeval|WARN|disk: 3256 reads, 0 writes
> 2019-01-24T18:42:08.702Z|01802|timeval|WARN|context switches: 23 voluntary,
> 0 involuntary
> 2019-01-24T18:42:32.451Z|01803|jsonrpc|WARN|tcp:127.0.0.1:52714: send
> error: Broken pipe
> 2019-01-24T18:42:32.614Z|01804|jsonrpc|WARN|tcp:127.0.0.1:52902: send
> error: Broken pipe
> 2019-01-24T18:42:34.335Z|01805|timeval|WARN|Unreasonably long 23807ms poll
> interval (14ms user, 23ms system)
> 2019-01-24T18:42:34.335Z|01806|timeval|WARN|faults: 160 minor, 64 major
> 2019-01-24T18:42:34.335Z|01807|timeval|WARN|disk: 14392 reads, 16 writes
> 2019-01-24T18:42:34.335Z|01808|timeval|WARN|context switches: 82 voluntary,
> 0 involuntary
> 2019-01-24T18:42:34.419Z|01809|reconnect|WARN|tcp:127.0.0.1:52714:
> connection dropped (Broken pipe)
> 2019-01-24T18:42:34.420Z|01810|reconnect|WARN|tcp:127.0.0.1:52902:
> connection dropped (Broken pipe)
> 2019-01-24T18:42:34.420Z|01811|jsonrpc|WARN|tcp:127.0.0.1:53258: send
> error: Broken pipe
> 2019-01-24T18:42:34.429Z|01812|reconnect|WARN|tcp:127.0.0.1:53258:
> connection dropped (Broken pipe)
> 2019-01-24T18:42:34.429Z|01813|jsonrpc|WARN|tcp:127.0.0.1:53260: send
> error: Broken pipe
> 2019-01-24T18:42:34.440Z|01814|reconnect|WARN|tcp:127.0.0.1:53260:
> connection dropped (Broken pipe)
> 2019-01-24T18:42:44.017Z|01815|timeval|WARN|Unreasonably long 1306ms poll
> interval (4ms user, 5ms system)
> 2019-01-24T18:42:44.104Z|01816|timeval|WARN|faults: 50 minor, 5 major
> 2019-01-24T18:42:44.104Z|01817|timeval|WARN|disk: 1304 reads, 0 writes
> 2019-01-24T18:42:44.104Z|01818|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T18:42:44.104Z|01819|coverage|INFO|Dropped 4 log messages in last
> 60 seconds (most recently, 10 seconds ago) due to excessive rate
> 2019-01-24T18:42:44.104Z|01820|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:42:54.469Z|01821|timeval|WARN|Unreasonably long 3314ms poll
> interval (3ms user, 4ms system)
> 2019-01-24T18:42:54.720Z|01822|timeval|WARN|faults: 11 minor, 12 major
> 2019-01-24T18:42:54.720Z|01823|timeval|WARN|disk: 2360 reads, 0 writes
> 2019-01-24T18:42:54.720Z|01824|timeval|WARN|context switches: 15 voluntary,
> 0 involuntary
> 2019-01-24T18:42:58.259Z|01825|reconnect|ERR|tcp:127.0.0.1:53262: no
> response to inactivity probe after 6.7 seconds, disconnecting
> 2019-01-24T18:42:58.259Z|01826|reconnect|ERR|tcp:127.0.0.1:53268: no
> response to inactivity probe after 6.57 seconds, disconnecting
> 2019-01-24T18:42:59.072Z|01827|timeval|WARN|Unreasonably long 4352ms poll
> interval (1ms user, 10ms system)
> 2019-01-24T18:42:59.072Z|01828|timeval|WARN|faults: 129 minor, 19 major
> 2019-01-24T18:42:59.072Z|01829|timeval|WARN|disk: 4440 reads, 8 writes
> 2019-01-24T18:42:59.072Z|01830|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T18:43:06.733Z|01831|timeval|WARN|Unreasonably long 7096ms poll
> interval (7ms user, 3ms system)
> 2019-01-24T18:43:07.296Z|01832|timeval|WARN|faults: 116 minor, 20 major
> 2019-01-24T18:43:07.296Z|01833|timeval|WARN|disk: 5032 reads, 0 writes
> 2019-01-24T18:43:07.296Z|01834|timeval|WARN|context switches: 27 voluntary,
> 0 involuntary
> 2019-01-24T18:43:55.208Z|01835|timeval|WARN|Unreasonably long 4231ms poll
> interval (8ms user, 4ms system)
> 2019-01-24T18:43:55.362Z|01836|timeval|WARN|faults: 104 minor, 9 major
> 2019-01-24T18:43:55.362Z|01837|timeval|WARN|disk: 2936 reads, 0 writes
> 2019-01-24T18:43:55.362Z|01838|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T18:43:55.362Z|01839|coverage|INFO|Dropped 3 log messages in last
> 61 seconds (most recently, 48 seconds ago) due to excessive rate
> 2019-01-24T18:43:55.362Z|01840|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:45:21.731Z|01841|timeval|WARN|Unreasonably long 2773ms poll
> interval (6ms user, 0ms system)
> 2019-01-24T18:45:22.361Z|01842|timeval|WARN|faults: 10 minor, 2 major
> 2019-01-24T18:45:22.361Z|01843|timeval|WARN|disk: 384 reads, 0 writes
> 2019-01-24T18:45:22.361Z|01844|timeval|WARN|context switches: 2 voluntary,
> 0 involuntary
> 2019-01-24T18:45:22.587Z|01845|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:45:30.966Z|01846|timeval|WARN|Unreasonably long 5539ms poll
> interval (3ms user, 5ms system)
> 2019-01-24T18:45:34.387Z|01847|timeval|WARN|faults: 9 minor, 21 major
> 2019-01-24T18:45:41.234Z|01848|timeval|WARN|disk: 4744 reads, 0 writes
> 2019-01-24T18:45:41.418Z|01849|timeval|WARN|context switches: 23 voluntary,
> 0 involuntary
> 2019-01-24T18:45:42.006Z|01850|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:45:42.199Z|01851|jsonrpc|WARN|tcp:127.0.0.1:53780: send
> error: Broken pipe
> 2019-01-24T18:45:42.200Z|01852|jsonrpc|WARN|tcp:127.0.0.1:53782: send
> error: Broken pipe
> 2019-01-24T18:45:43.498Z|01853|timeval|WARN|Unreasonably long 1492ms poll
> interval (91ms user, 66ms system)
> 2019-01-24T18:45:43.498Z|01854|timeval|WARN|faults: 99 minor, 4 major
> 2019-01-24T18:45:43.498Z|01855|timeval|WARN|disk: 1704 reads, 0 writes
> 2019-01-24T18:45:43.498Z|01856|timeval|WARN|context switches: 7 voluntary,
> 0 involuntary
> 2019-01-24T18:45:43.499Z|01857|reconnect|WARN|tcp:127.0.0.1:53780:
> connection dropped (Broken pipe)
> 2019-01-24T18:45:43.499Z|01858|reconnect|WARN|tcp:127.0.0.1:53782:
> connection dropped (Broken pipe)
> 2019-01-24T18:47:00.365Z|01859|timeval|WARN|Unreasonably long 1334ms poll
> interval (2ms user, 11ms system)
> 2019-01-24T18:47:03.423Z|01860|timeval|WARN|faults: 103 minor, 8 major
> 2019-01-24T18:47:06.509Z|01861|timeval|WARN|disk: 2808 reads, 0 writes
> 2019-01-24T18:47:06.988Z|01862|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T18:47:07.307Z|01863|coverage|INFO|Dropped 1 log messages in last
> 84 seconds (most recently, 84 seconds ago) due to excessive rate
> 2019-01-24T18:47:07.953Z|01864|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:47:12.746Z|01865|timeval|WARN|Unreasonably long 1036ms poll
> interval (0ms user, 3ms system)
> 2019-01-24T18:47:12.784Z|01866|timeval|WARN|faults: 59 minor, 6 major
> 2019-01-24T18:47:12.784Z|01867|timeval|WARN|disk: 1680 reads, 0 writes
> 2019-01-24T18:47:12.784Z|01868|timeval|WARN|context switches: 7 voluntary,
> 0 involuntary
> 2019-01-24T18:47:22.554Z|01869|timeval|WARN|Unreasonably long 1069ms poll
> interval (0ms user, 7ms system)
> 2019-01-24T18:47:22.681Z|01870|timeval|WARN|faults: 28 minor, 9 major
> 2019-01-24T18:47:22.681Z|01871|timeval|WARN|disk: 2088 reads, 0 writes
> 2019-01-24T18:47:22.681Z|01872|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T18:47:29.251Z|01873|timeval|WARN|Unreasonably long 1777ms poll
> interval (0ms user, 4ms system)
> 2019-01-24T18:47:29.356Z|01874|timeval|WARN|faults: 27 minor, 8 major
> 2019-01-24T18:47:29.356Z|01875|timeval|WARN|disk: 1832 reads, 0 writes
> 2019-01-24T18:47:29.356Z|01876|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T18:48:35.789Z|01877|timeval|WARN|Unreasonably long 1740ms poll
> interval (11ms user, 6ms system)
> 2019-01-24T18:48:35.809Z|01878|timeval|WARN|faults: 104 minor, 8 major
> 2019-01-24T18:48:35.809Z|01879|timeval|WARN|disk: 2560 reads, 0 writes
> 2019-01-24T18:48:35.809Z|01880|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T18:48:35.809Z|01881|coverage|INFO|Dropped 3 log messages in last
> 83 seconds (most recently, 67 seconds ago) due to excessive rate
> 2019-01-24T18:48:35.809Z|01882|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:48:49.828Z|01883|timeval|WARN|Unreasonably long 3779ms poll
> interval (2ms user, 8ms system)
> 2019-01-24T18:48:49.891Z|01884|timeval|WARN|faults: 105 minor, 13 major
> 2019-01-24T18:48:49.891Z|01885|timeval|WARN|disk: 3640 reads, 0 writes
> 2019-01-24T18:48:49.891Z|01886|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T18:48:50.082Z|01887|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:48:59.813Z|01888|timeval|WARN|Unreasonably long 8786ms poll
> interval (2ms user, 16ms system)
> 2019-01-24T18:49:01.529Z|01889|timeval|WARN|faults: 122 minor, 31 major
> 2019-01-24T18:49:02.836Z|01890|timeval|WARN|disk: 7384 reads, 0 writes
> 2019-01-24T18:49:02.836Z|01891|timeval|WARN|context switches: 34 voluntary,
> 0 involuntary
> 2019-01-24T18:49:07.028Z|01892|jsonrpc|WARN|tcp:127.0.0.1:54872: send
> error: Broken pipe
> 2019-01-24T18:49:11.755Z|01893|timeval|WARN|Unreasonably long 8919ms poll
> interval (14ms user, 22ms system)
> 2019-01-24T18:49:11.964Z|01894|timeval|WARN|faults: 224 minor, 42 major
> 2019-01-24T18:49:11.964Z|01895|timeval|WARN|disk: 7560 reads, 8 writes
> 2019-01-24T18:49:11.964Z|01896|timeval|WARN|context switches: 47 voluntary,
> 0 involuntary
> 2019-01-24T18:49:11.965Z|01897|reconnect|WARN|tcp:127.0.0.1:54872:
> connection dropped (Broken pipe)
> 2019-01-24T18:49:22.519Z|01898|reconnect|ERR|tcp:127.0.0.1:56992: no
> response to inactivity probe after 5 seconds, disconnecting
> 2019-01-24T18:49:23.146Z|01899|timeval|WARN|Unreasonably long 1179ms poll
> interval (2ms user, 1ms system)
> 2019-01-24T18:49:23.146Z|01900|timeval|WARN|faults: 4 minor, 5 major
> 2019-01-24T18:49:23.146Z|01901|timeval|WARN|disk: 848 reads, 8 writes
> 2019-01-24T18:49:23.146Z|01902|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T18:49:34.694Z|01903|timeval|WARN|Unreasonably long 2030ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T18:49:34.713Z|01904|timeval|WARN|faults: 62 minor, 8 major
> 2019-01-24T18:49:34.713Z|01905|timeval|WARN|disk: 2416 reads, 0 writes
> 2019-01-24T18:49:34.713Z|01906|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T18:49:53.888Z|01907|timeval|WARN|Unreasonably long 3001ms poll
> interval (0ms user, 13ms system)
> 2019-01-24T18:49:53.953Z|01908|timeval|WARN|faults: 96 minor, 13 major
> 2019-01-24T18:49:53.953Z|01909|timeval|WARN|disk: 3728 reads, 0 writes
> 2019-01-24T18:49:53.953Z|01910|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T18:49:53.953Z|01911|coverage|INFO|Dropped 4 log messages in last
> 51 seconds (most recently, 20 seconds ago) due to excessive rate
> 2019-01-24T18:49:54.178Z|01912|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:49:59.700Z|01913|timeval|WARN|Unreasonably long 1508ms poll
> interval (1ms user, 6ms system)
> 2019-01-24T18:49:59.809Z|01914|timeval|WARN|faults: 62 minor, 6 major
> 2019-01-24T18:49:59.809Z|01915|timeval|WARN|disk: 1840 reads, 0 writes
> 2019-01-24T18:49:59.809Z|01916|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T18:50:23.092Z|01917|timeval|WARN|Unreasonably long 8367ms poll
> interval (8ms user, 16ms system)
> 2019-01-24T18:50:23.155Z|01918|timeval|WARN|faults: 86 minor, 30 major
> 2019-01-24T18:50:23.155Z|01919|timeval|WARN|disk: 4648 reads, 0 writes
> 2019-01-24T18:50:23.155Z|01920|timeval|WARN|context switches: 32 voluntary,
> 0 involuntary
> 2019-01-24T18:50:33.278Z|01921|timeval|WARN|Unreasonably long 4577ms poll
> interval (0ms user, 13ms system)
> 2019-01-24T18:50:34.182Z|01922|timeval|WARN|faults: 16 minor, 20 major
> 2019-01-24T18:50:34.182Z|01923|timeval|WARN|disk: 4400 reads, 0 writes
> 2019-01-24T18:50:34.182Z|01924|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T18:50:46.336Z|01925|reconnect|ERR|tcp:127.0.0.1:54874: no
> response to inactivity probe after 17.5 seconds, disconnecting
> 2019-01-24T18:50:46.370Z|01926|jsonrpc|WARN|tcp:127.0.0.1:58038: send
> error: Broken pipe
> 2019-01-24T18:50:51.706Z|01927|timeval|WARN|Unreasonably long 16310ms poll
> interval (12ms user, 19ms system)
> 2019-01-24T18:50:52.221Z|01928|timeval|WARN|faults: 153 minor, 55 major
> 2019-01-24T18:50:52.221Z|01929|timeval|WARN|disk: 10488 reads, 8 writes
> 2019-01-24T18:50:52.221Z|01930|timeval|WARN|context switches: 68 voluntary,
> 0 involuntary
> 2019-01-24T18:50:52.221Z|01931|coverage|INFO|Dropped 3 log messages in last
> 52 seconds (most recently, 18 seconds ago) due to excessive rate
> 2019-01-24T18:50:52.221Z|01932|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:50:52.537Z|01933|reconnect|WARN|tcp:127.0.0.1:58038:
> connection dropped (Broken pipe)
> 2019-01-24T18:51:42.277Z|01934|timeval|WARN|Unreasonably long 1123ms poll
> interval (0ms user, 12ms system)
> 2019-01-24T18:51:42.362Z|01935|timeval|WARN|faults: 55 minor, 14 major
> 2019-01-24T18:51:42.362Z|01936|timeval|WARN|disk: 3576 reads, 0 writes
> 2019-01-24T18:51:42.362Z|01937|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T18:51:42.362Z|01938|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:51:46.538Z|01939|timeval|WARN|Unreasonably long 2916ms poll
> interval (0ms user, 15ms system)
> 2019-01-24T18:51:46.668Z|01940|timeval|WARN|faults: 86 minor, 15 major
> 2019-01-24T18:51:46.668Z|01941|timeval|WARN|disk: 3688 reads, 0 writes
> 2019-01-24T18:51:46.668Z|01942|timeval|WARN|context switches: 19 voluntary,
> 0 involuntary
> 2019-01-24T18:51:54.199Z|01943|timeval|WARN|Unreasonably long 1057ms poll
> interval (2ms user, 5ms system)
> 2019-01-24T18:51:54.395Z|01944|timeval|WARN|faults: 63 minor, 8 major
> 2019-01-24T18:51:54.395Z|01945|timeval|WARN|disk: 2376 reads, 0 writes
> 2019-01-24T18:51:54.395Z|01946|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T18:51:59.736Z|01947|timeval|WARN|Unreasonably long 1080ms poll
> interval (0ms user, 7ms system)
> 2019-01-24T18:52:00.063Z|01948|timeval|WARN|faults: 63 minor, 8 major
> 2019-01-24T18:52:00.063Z|01949|timeval|WARN|disk: 2312 reads, 0 writes
> 2019-01-24T18:52:00.063Z|01950|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T18:52:15.640Z|01951|timeval|WARN|Unreasonably long 4732ms poll
> interval (0ms user, 16ms system)
> 2019-01-24T18:52:15.715Z|01952|timeval|WARN|faults: 50 minor, 18 major
> 2019-01-24T18:52:15.715Z|01953|timeval|WARN|disk: 3128 reads, 0 writes
> 2019-01-24T18:52:15.716Z|01954|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T18:52:26.079Z|01955|timeval|WARN|Unreasonably long 4865ms poll
> interval (0ms user, 7ms system)
> 2019-01-24T18:52:28.967Z|01956|timeval|WARN|faults: 58 minor, 16 major
> 2019-01-24T18:52:28.967Z|01957|timeval|WARN|disk: 4072 reads, 0 writes
> 2019-01-24T18:52:28.967Z|01958|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T18:52:29.880Z|01959|jsonrpc|WARN|tcp:127.0.0.1:58046: send
> error: Broken pipe
> 2019-01-24T18:52:29.881Z|01960|jsonrpc|WARN|tcp:127.0.0.1:58048: send
> error: Broken pipe
> 2019-01-24T18:52:31.326Z|01961|timeval|WARN|Unreasonably long 2359ms poll
> interval (5ms user, 3ms system)
> 2019-01-24T18:52:31.326Z|01962|timeval|WARN|faults: 95 minor, 6 major
> 2019-01-24T18:52:31.326Z|01963|timeval|WARN|disk: 1864 reads, 8 writes
> 2019-01-24T18:52:31.326Z|01964|timeval|WARN|context switches: 7 voluntary,
> 0 involuntary
> 2019-01-24T18:52:31.326Z|01965|reconnect|WARN|tcp:127.0.0.1:58046:
> connection dropped (Broken pipe)
> 2019-01-24T18:52:31.326Z|01966|reconnect|WARN|tcp:127.0.0.1:58048:
> connection dropped (Broken pipe)
> 2019-01-24T18:53:19.414Z|01967|timeval|WARN|Unreasonably long 4490ms poll
> interval (0ms user, 13ms system)
> 2019-01-24T18:53:19.423Z|01968|timeval|WARN|faults: 98 minor, 17 major
> 2019-01-24T18:53:19.423Z|01969|timeval|WARN|disk: 3760 reads, 0 writes
> 2019-01-24T18:53:19.423Z|01970|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T18:53:19.423Z|01971|coverage|INFO|Dropped 6 log messages in last
> 93 seconds (most recently, 48 seconds ago) due to excessive rate
> 2019-01-24T18:53:19.423Z|01972|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:53:24.268Z|01973|timeval|WARN|Unreasonably long 1217ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T18:53:24.383Z|01974|timeval|WARN|faults: 56 minor, 6 major
> 2019-01-24T18:53:24.383Z|01975|timeval|WARN|disk: 1336 reads, 0 writes
> 2019-01-24T18:53:24.383Z|01976|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T18:53:44.399Z|01977|timeval|WARN|Unreasonably long 2072ms poll
> interval (1ms user, 5ms system)
> 2019-01-24T18:53:44.508Z|01978|timeval|WARN|faults: 65 minor, 7 major
> 2019-01-24T18:53:44.508Z|01979|timeval|WARN|disk: 2352 reads, 0 writes
> 2019-01-24T18:53:44.508Z|01980|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T18:53:44.508Z|01981|coverage|INFO|Dropped 1 log messages in last
> 20 seconds (most recently, 20 seconds ago) due to excessive rate
> 2019-01-24T18:53:44.508Z|01982|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:53:55.226Z|01983|timeval|WARN|Unreasonably long 5645ms poll
> interval (1ms user, 12ms system)
> 2019-01-24T18:53:55.269Z|01984|timeval|WARN|faults: 95 minor, 20 major
> 2019-01-24T18:53:55.269Z|01985|timeval|WARN|disk: 4288 reads, 0 writes
> 2019-01-24T18:53:55.269Z|01986|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T18:54:08.558Z|01987|timeval|WARN|Unreasonably long 9956ms poll
> interval (4ms user, 18ms system)
> 2019-01-24T18:54:08.973Z|01988|timeval|WARN|faults: 140 minor, 42 major
> 2019-01-24T18:54:08.973Z|01989|timeval|WARN|disk: 8568 reads, 0 writes
> 2019-01-24T18:54:08.973Z|01990|timeval|WARN|context switches: 48 voluntary,
> 0 involuntary
> 2019-01-24T18:54:59.528Z|01991|timeval|WARN|Unreasonably long 2679ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T18:54:59.607Z|01992|timeval|WARN|faults: 20 minor, 13 major
> 2019-01-24T18:54:59.607Z|01993|timeval|WARN|disk: 2920 reads, 0 writes
> 2019-01-24T18:54:59.607Z|01994|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T18:54:59.765Z|01995|coverage|INFO|Dropped 2 log messages in last
> 65 seconds (most recently, 51 seconds ago) due to excessive rate
> 2019-01-24T18:54:59.765Z|01996|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:55:03.961Z|01997|timeval|WARN|Unreasonably long 1416ms poll
> interval (25ms user, 26ms system)
> 2019-01-24T18:55:04.257Z|01998|timeval|WARN|faults: 27 minor, 7 major
> 2019-01-24T18:55:04.257Z|01999|timeval|WARN|disk: 1368 reads, 0 writes
> 2019-01-24T18:55:04.257Z|02000|timeval|WARN|context switches: 8 voluntary,
> 0 involuntary
> 2019-01-24T18:55:06.083Z|02001|timeval|WARN|Unreasonably long 1041ms poll
> interval (0ms user, 2ms system)
> 2019-01-24T18:55:06.083Z|02002|timeval|WARN|faults: 32 minor, 4 major
> 2019-01-24T18:55:06.083Z|02003|timeval|WARN|disk: 872 reads, 0 writes
> 2019-01-24T18:55:06.083Z|02004|timeval|WARN|context switches: 4 voluntary,
> 0 involuntary
> 2019-01-24T18:55:14.480Z|02005|timeval|WARN|Unreasonably long 5121ms poll
> interval (17ms user, 7ms system)
> 2019-01-24T18:55:15.847Z|02006|timeval|WARN|faults: 110 minor, 20 major
> 2019-01-24T18:55:16.184Z|02007|timeval|WARN|disk: 5144 reads, 0 writes
> 2019-01-24T18:55:16.184Z|02008|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T18:55:25.756Z|02009|timeval|WARN|Unreasonably long 9275ms poll
> interval (4ms user, 13ms system)
> 2019-01-24T18:55:26.674Z|02010|timeval|WARN|faults: 86 minor, 26 major
> 2019-01-24T18:55:26.674Z|02011|timeval|WARN|disk: 5256 reads, 0 writes
> 2019-01-24T18:55:26.674Z|02012|timeval|WARN|context switches: 32 voluntary,
> 0 involuntary
> 2019-01-24T18:55:31.635Z|02013|timeval|WARN|Unreasonably long 4278ms poll
> interval (14ms user, 2ms system)
> 2019-01-24T18:55:31.777Z|02014|timeval|WARN|faults: 33 minor, 18 major
> 2019-01-24T18:55:31.777Z|02015|timeval|WARN|disk: 3112 reads, 0 writes
> 2019-01-24T18:55:31.777Z|02016|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T18:55:39.252Z|02017|timeval|WARN|Unreasonably long 5594ms poll
> interval (3ms user, 6ms system)
> 2019-01-24T18:55:39.738Z|02018|timeval|WARN|faults: 27 minor, 20 major
> 2019-01-24T18:55:39.738Z|02019|timeval|WARN|disk: 3840 reads, 0 writes
> 2019-01-24T18:55:39.738Z|02020|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T18:55:56.141Z|02021|reconnect|ERR|tcp:127.0.0.1:58952: no
> response to inactivity probe after 23 seconds, disconnecting
> 2019-01-24T18:55:56.360Z|02022|reconnect|ERR|tcp:127.0.0.1:58974: no
> response to inactivity probe after 23.4 seconds, disconnecting
> 2019-01-24T18:55:57.726Z|02023|timeval|WARN|Unreasonably long 17988ms poll
> interval (15ms user, 15ms system)
> 2019-01-24T18:55:57.726Z|02024|timeval|WARN|faults: 173 minor, 48 major
> 2019-01-24T18:55:57.726Z|02025|timeval|WARN|disk: 9360 reads, 16 writes
> 2019-01-24T18:55:57.726Z|02026|timeval|WARN|context switches: 54 voluntary,
> 0 involuntary
> 2019-01-24T18:55:57.726Z|02027|coverage|INFO|Dropped 6 log messages in last
> 53 seconds (most recently, 17 seconds ago) due to excessive rate
> 2019-01-24T18:55:57.726Z|02028|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:55:57.727Z|02029|jsonrpc|WARN|tcp:127.0.0.1:60686: send
> error: Broken pipe
> 2019-01-24T18:55:57.730Z|02030|reconnect|WARN|tcp:127.0.0.1:60686:
> connection dropped (Broken pipe)
> 2019-01-24T18:55:57.731Z|02031|jsonrpc|WARN|tcp:127.0.0.1:60688: send
> error: Broken pipe
> 2019-01-24T18:55:57.734Z|02032|reconnect|WARN|tcp:127.0.0.1:60688:
> connection dropped (Broken pipe)
> 2019-01-24T18:56:07.789Z|02033|reconnect|ERR|tcp:127.0.0.1:60694: no
> response to inactivity probe after 5 seconds, disconnecting
> 2019-01-24T18:57:04.365Z|02034|timeval|WARN|Unreasonably long 7514ms poll
> interval (5ms user, 8ms system)
> 2019-01-24T18:57:06.327Z|02035|timeval|WARN|faults: 47 minor, 27 major
> 2019-01-24T18:57:08.397Z|02036|timeval|WARN|disk: 4184 reads, 0 writes
> 2019-01-24T18:57:10.068Z|02037|timeval|WARN|context switches: 32 voluntary,
> 0 involuntary
> 2019-01-24T18:57:11.645Z|02038|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:57:16.574Z|02039|jsonrpc|WARN|tcp:127.0.0.1:60696: send
> error: Broken pipe
> 2019-01-24T18:57:18.862Z|02040|timeval|WARN|Unreasonably long 4853ms poll
> interval (14ms user, 5ms system)
> 2019-01-24T18:57:18.862Z|02041|timeval|WARN|faults: 111 minor, 10 major
> 2019-01-24T18:57:18.862Z|02042|timeval|WARN|disk: 2904 reads, 8 writes
> 2019-01-24T18:57:18.965Z|02043|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T18:57:18.965Z|02044|reconnect|WARN|tcp:127.0.0.1:60696:
> connection dropped (Broken pipe)
> 2019-01-24T18:57:27.263Z|02045|timeval|WARN|Unreasonably long 2242ms poll
> interval (3ms user, 1ms system)
> 2019-01-24T18:57:29.618Z|02046|timeval|WARN|faults: 62 minor, 8 major
> 2019-01-24T18:57:29.618Z|02047|timeval|WARN|disk: 2392 reads, 0 writes
> 2019-01-24T18:57:29.618Z|02048|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T18:57:33.642Z|02049|jsonrpc|WARN|tcp:127.0.0.1:33028: send
> error: Broken pipe
> 2019-01-24T18:57:34.257Z|02050|timeval|WARN|Unreasonably long 4639ms poll
> interval (0ms user, 11ms system)
> 2019-01-24T18:57:34.257Z|02051|timeval|WARN|faults: 116 minor, 15 major
> 2019-01-24T18:57:34.257Z|02052|timeval|WARN|disk: 4384 reads, 8 writes
> 2019-01-24T18:57:34.257Z|02053|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T18:57:34.257Z|02054|reconnect|WARN|tcp:127.0.0.1:33028:
> connection dropped (Broken pipe)
> 2019-01-24T18:58:02.940Z|02055|timeval|WARN|Unreasonably long 3578ms poll
> interval (3ms user, 4ms system)
> 2019-01-24T18:58:02.960Z|02056|timeval|WARN|faults: 105 minor, 8 major
> 2019-01-24T18:58:02.960Z|02057|timeval|WARN|disk: 2560 reads, 0 writes
> 2019-01-24T18:58:02.960Z|02058|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T18:58:02.960Z|02059|coverage|INFO|Dropped 3 log messages in last
> 44 seconds (most recently, 29 seconds ago) due to excessive rate
> 2019-01-24T18:58:02.960Z|02060|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:58:08.311Z|02061|timeval|WARN|Unreasonably long 3814ms poll
> interval (2ms user, 3ms system)
> 2019-01-24T18:58:08.949Z|02062|timeval|WARN|faults: 50 minor, 9 major
> 2019-01-24T18:58:08.949Z|02063|timeval|WARN|disk: 2624 reads, 0 writes
> 2019-01-24T18:58:08.949Z|02064|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T18:58:13.260Z|02065|jsonrpc|WARN|tcp:127.0.0.1:33558: send
> error: Broken pipe
> 2019-01-24T18:58:15.209Z|02066|timeval|WARN|Unreasonably long 6260ms poll
> interval (2ms user, 7ms system)
> 2019-01-24T18:58:15.513Z|02067|timeval|WARN|faults: 61 minor, 17 major
> 2019-01-24T18:58:15.513Z|02068|timeval|WARN|disk: 2912 reads, 8 writes
> 2019-01-24T18:58:15.513Z|02069|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T18:58:15.649Z|02070|reconnect|WARN|tcp:127.0.0.1:33558:
> connection dropped (Broken pipe)
> 2019-01-24T18:59:00.662Z|02071|timeval|WARN|Unreasonably long 1124ms poll
> interval (1ms user, 5ms system)
> 2019-01-24T18:59:00.760Z|02072|timeval|WARN|faults: 5 minor, 4 major
> 2019-01-24T18:59:00.760Z|02073|timeval|WARN|disk: 496 reads, 0 writes
> 2019-01-24T18:59:00.760Z|02074|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T18:59:00.760Z|02075|coverage|INFO|Dropped 2 log messages in last
> 52 seconds (most recently, 46 seconds ago) due to excessive rate
> 2019-01-24T18:59:01.415Z|02076|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T18:59:06.573Z|02077|timeval|WARN|Unreasonably long 1100ms poll
> interval (3ms user, 0ms system)
> 2019-01-24T18:59:06.701Z|02078|timeval|WARN|faults: 20 minor, 5 major
> 2019-01-24T18:59:06.701Z|02079|timeval|WARN|disk: 640 reads, 0 writes
> 2019-01-24T18:59:06.701Z|02080|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T18:59:19.268Z|02081|timeval|WARN|Unreasonably long 9448ms poll
> interval (10ms user, 5ms system)
> 2019-01-24T18:59:19.908Z|02082|timeval|WARN|faults: 135 minor, 31 major
> 2019-01-24T18:59:19.908Z|02083|timeval|WARN|disk: 6864 reads, 0 writes
> 2019-01-24T18:59:19.908Z|02084|timeval|WARN|context switches: 35 voluntary,
> 0 involuntary
> 2019-01-24T18:59:26.551Z|02085|timeval|WARN|Unreasonably long 6587ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T18:59:26.552Z|02086|timeval|WARN|faults: 103 minor, 21 major
> 2019-01-24T18:59:26.552Z|02087|timeval|WARN|disk: 4800 reads, 0 writes
> 2019-01-24T18:59:26.552Z|02088|timeval|WARN|context switches: 25 voluntary,
> 0 involuntary
> 2019-01-24T18:59:32.289Z|02089|timeval|WARN|Unreasonably long 1099ms poll
> interval (1ms user, 3ms system)
> 2019-01-24T18:59:32.289Z|02090|timeval|WARN|faults: 35 minor, 3 major
> 2019-01-24T18:59:32.289Z|02091|timeval|WARN|disk: 760 reads, 0 writes
> 2019-01-24T18:59:32.289Z|02092|timeval|WARN|context switches: 4 voluntary,
> 0 involuntary
> 2019-01-24T18:59:49.760Z|02093|timeval|WARN|Unreasonably long 1942ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T18:59:50.062Z|02094|timeval|WARN|faults: 38 minor, 4 major
> 2019-01-24T18:59:50.063Z|02095|timeval|WARN|disk: 1064 reads, 0 writes
> 2019-01-24T18:59:50.063Z|02096|timeval|WARN|context switches: 7 voluntary,
> 0 involuntary
> 2019-01-24T18:59:50.063Z|02097|coverage|INFO|Dropped 4 log messages in last
> 44 seconds (most recently, 18 seconds ago) due to excessive rate
> 2019-01-24T18:59:50.212Z|02098|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:00:02.009Z|02099|timeval|WARN|Unreasonably long 7245ms poll
> interval (2ms user, 14ms system)
> 2019-01-24T19:00:02.351Z|02100|timeval|WARN|faults: 56 minor, 27 major
> 2019-01-24T19:00:02.351Z|02101|timeval|WARN|disk: 4016 reads, 0 writes
> 2019-01-24T19:00:02.351Z|02102|timeval|WARN|context switches: 35 voluntary,
> 0 involuntary
> 2019-01-24T19:00:03.036Z|02103|jsonrpc|WARN|tcp:127.0.0.1:33596: receive
> error: Connection reset by peer
> 2019-01-24T19:00:05.012Z|02104|timeval|WARN|Unreasonably long 2661ms poll
> interval (10ms user, 4ms system)
> 2019-01-24T19:00:05.012Z|02105|timeval|WARN|faults: 35 minor, 8 major
> 2019-01-24T19:00:05.012Z|02106|timeval|WARN|disk: 1392 reads, 0 writes
> 2019-01-24T19:00:05.012Z|02107|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T19:00:05.012Z|02108|reconnect|WARN|tcp:127.0.0.1:33596:
> connection dropped (Connection reset by peer)
> 2019-01-24T19:00:06.664Z|02109|timeval|WARN|Unreasonably long 1289ms poll
> interval (0ms user, 4ms system)
> 2019-01-24T19:00:06.664Z|02110|timeval|WARN|faults: 4 minor, 5 major
> 2019-01-24T19:00:06.664Z|02111|timeval|WARN|disk: 456 reads, 0 writes
> 2019-01-24T19:00:06.664Z|02112|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T19:00:09.184Z|02113|timeval|WARN|Unreasonably long 1145ms poll
> interval (1ms user, 2ms system)
> 2019-01-24T19:00:09.184Z|02114|timeval|WARN|faults: 8 minor, 5 major
> 2019-01-24T19:00:09.185Z|02115|timeval|WARN|disk: 744 reads, 0 writes
> 2019-01-24T19:00:09.185Z|02116|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T19:01:38.561Z|02117|timeval|WARN|Unreasonably long 3789ms poll
> interval (0ms user, 11ms system)
> 2019-01-24T19:01:38.992Z|02118|timeval|WARN|faults: 65 minor, 21 major
> 2019-01-24T19:01:38.992Z|02119|timeval|WARN|disk: 4040 reads, 0 writes
> 2019-01-24T19:01:38.992Z|02120|timeval|WARN|context switches: 23 voluntary,
> 0 involuntary
> 2019-01-24T19:01:38.992Z|02121|coverage|INFO|Dropped 4 log messages in last
> 97 seconds (most recently, 90 seconds ago) due to excessive rate
> 2019-01-24T19:01:41.738Z|02122|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:01:43.882Z|02123|reconnect|ERR|tcp:127.0.0.1:34686: no
> response to inactivity probe after 7.9 seconds, disconnecting
> 2019-01-24T19:01:50.924Z|02124|timeval|WARN|Unreasonably long 8472ms poll
> interval (4ms user, 10ms system)
> 2019-01-24T19:01:51.169Z|02125|timeval|WARN|faults: 91 minor, 23 major
> 2019-01-24T19:01:51.169Z|02126|timeval|WARN|disk: 5424 reads, 8 writes
> 2019-01-24T19:01:51.169Z|02127|timeval|WARN|context switches: 26 voluntary,
> 0 involuntary
> 2019-01-24T19:01:51.169Z|02128|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:01:52.664Z|02129|timeval|WARN|Unreasonably long 1496ms poll
> interval (14ms user, 1ms system)
> 2019-01-24T19:01:52.665Z|02130|timeval|WARN|faults: 103 minor, 6 major
> 2019-01-24T19:01:52.665Z|02131|timeval|WARN|disk: 1792 reads, 0 writes
> 2019-01-24T19:01:52.665Z|02132|timeval|WARN|context switches: 8 voluntary,
> 0 involuntary
> 2019-01-24T19:02:05.450Z|02133|timeval|WARN|Unreasonably long 3667ms poll
> interval (2ms user, 4ms system)
> 2019-01-24T19:02:05.526Z|02134|timeval|WARN|faults: 43 minor, 8 major
> 2019-01-24T19:02:05.527Z|02135|timeval|WARN|disk: 1904 reads, 0 writes
> 2019-01-24T19:02:05.527Z|02136|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T19:02:12.159Z|02137|timeval|WARN|Unreasonably long 3371ms poll
> interval (4ms user, 6ms system)
> 2019-01-24T19:02:12.301Z|02138|timeval|WARN|faults: 41 minor, 15 major
> 2019-01-24T19:02:12.301Z|02139|timeval|WARN|disk: 2656 reads, 0 writes
> 2019-01-24T19:02:12.301Z|02140|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T19:02:26.928Z|02141|timeval|WARN|Unreasonably long 4522ms poll
> interval (5ms user, 3ms system)
> 2019-01-24T19:02:27.312Z|02142|timeval|WARN|faults: 98 minor, 15 major
> 2019-01-24T19:02:27.312Z|02143|timeval|WARN|disk: 3488 reads, 0 writes
> 2019-01-24T19:02:27.312Z|02144|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T19:02:29.079Z|02145|timeval|WARN|Unreasonably long 1766ms poll
> interval (1ms user, 2ms system)
> 2019-01-24T19:02:29.079Z|02146|timeval|WARN|faults: 6 minor, 3 major
> 2019-01-24T19:02:29.079Z|02147|timeval|WARN|disk: 424 reads, 0 writes
> 2019-01-24T19:02:29.079Z|02148|timeval|WARN|context switches: 3 voluntary,
> 0 involuntary
> 2019-01-24T19:03:18.668Z|02149|timeval|WARN|Unreasonably long 2669ms poll
> interval (6ms user, 0ms system)
> 2019-01-24T19:03:18.799Z|02150|timeval|WARN|faults: 103 minor, 8 major
> 2019-01-24T19:03:18.799Z|02151|timeval|WARN|disk: 2560 reads, 0 writes
> 2019-01-24T19:03:18.799Z|02152|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T19:03:18.799Z|02153|coverage|INFO|Dropped 5 log messages in last
> 87 seconds (most recently, 50 seconds ago) due to excessive rate
> 2019-01-24T19:03:19.092Z|02154|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:05:50.017Z|02155|timeval|WARN|Unreasonably long 2216ms poll
> interval (0ms user, 14ms system)
> 2019-01-24T19:05:51.049Z|02156|timeval|WARN|faults: 103 minor, 15 major
> 2019-01-24T19:05:51.049Z|02157|timeval|WARN|disk: 3864 reads, 0 writes
> 2019-01-24T19:05:51.049Z|02158|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T19:05:51.161Z|02159|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:05:59.884Z|02160|timeval|WARN|Unreasonably long 1113ms poll
> interval (0ms user, 6ms system)
> 2019-01-24T19:05:59.901Z|02161|timeval|WARN|faults: 61 minor, 10 major
> 2019-01-24T19:05:59.901Z|02162|timeval|WARN|disk: 2576 reads, 0 writes
> 2019-01-24T19:05:59.901Z|02163|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T19:05:59.901Z|02164|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:06:21.248Z|02165|timeval|WARN|Unreasonably long 5059ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T19:06:21.931Z|02166|timeval|WARN|faults: 66 minor, 15 major
> 2019-01-24T19:06:21.931Z|02167|timeval|WARN|disk: 4680 reads, 0 writes
> 2019-01-24T19:06:21.931Z|02168|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T19:06:23.770Z|02169|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:06:28.943Z|02170|jsonrpc|WARN|tcp:127.0.0.1:35766: send
> error: Broken pipe
> 2019-01-24T19:06:28.944Z|02171|jsonrpc|WARN|tcp:127.0.0.1:36346: send
> error: Broken pipe
> 2019-01-24T19:06:29.836Z|02172|timeval|WARN|Unreasonably long 4717ms poll
> interval (0ms user, 15ms system)
> 2019-01-24T19:06:29.836Z|02173|timeval|WARN|faults: 121 minor, 23 major
> 2019-01-24T19:06:29.836Z|02174|timeval|WARN|disk: 4744 reads, 16 writes
> 2019-01-24T19:06:29.836Z|02175|timeval|WARN|context switches: 27 voluntary,
> 0 involuntary
> 2019-01-24T19:06:29.836Z|02176|reconnect|WARN|tcp:127.0.0.1:35766:
> connection dropped (Broken pipe)
> 2019-01-24T19:06:29.836Z|02177|reconnect|WARN|tcp:127.0.0.1:36346:
> connection dropped (Broken pipe)
> 2019-01-24T19:07:24.493Z|02178|timeval|WARN|Unreasonably long 2552ms poll
> interval (0ms user, 17ms system)
> 2019-01-24T19:07:24.598Z|02179|timeval|WARN|faults: 61 minor, 27 major
> 2019-01-24T19:07:24.598Z|02180|timeval|WARN|disk: 6208 reads, 0 writes
> 2019-01-24T19:07:24.598Z|02181|timeval|WARN|context switches: 31 voluntary,
> 0 involuntary
> 2019-01-24T19:07:24.598Z|02182|coverage|INFO|Dropped 1 log messages in last
> 54 seconds (most recently, 54 seconds ago) due to excessive rate
> 2019-01-24T19:07:24.598Z|02183|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:07:50.204Z|02184|timeval|WARN|Unreasonably long 5371ms poll
> interval (1ms user, 12ms system)
> 2019-01-24T19:07:50.236Z|02185|timeval|WARN|faults: 140 minor, 30 major
> 2019-01-24T19:07:50.236Z|02186|timeval|WARN|disk: 6448 reads, 0 writes
> 2019-01-24T19:07:50.236Z|02187|timeval|WARN|context switches: 35 voluntary,
> 0 involuntary
> 2019-01-24T19:07:59.890Z|02188|timeval|WARN|Unreasonably long 4597ms poll
> interval (1ms user, 33ms system)
> 2019-01-24T19:07:59.912Z|02189|timeval|WARN|faults: 108 minor, 52 major
> 2019-01-24T19:07:59.912Z|02190|timeval|WARN|disk: 10232 reads, 0 writes
> 2019-01-24T19:07:59.912Z|02191|timeval|WARN|context switches: 57 voluntary,
> 0 involuntary
> 2019-01-24T19:07:59.912Z|02192|coverage|INFO|Dropped 1 log messages in last
> 10 seconds (most recently, 10 seconds ago) due to excessive rate
> 2019-01-24T19:07:59.912Z|02193|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:09:12.122Z|02194|timeval|WARN|Unreasonably long 2206ms poll
> interval (0ms user, 14ms system)
> 2019-01-24T19:09:12.166Z|02195|timeval|WARN|faults: 43 minor, 17 major
> 2019-01-24T19:09:12.166Z|02196|timeval|WARN|disk: 3216 reads, 0 writes
> 2019-01-24T19:09:12.166Z|02197|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T19:09:12.166Z|02198|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:10:00.376Z|02199|timeval|WARN|Unreasonably long 5515ms poll
> interval (0ms user, 32ms system)
> 2019-01-24T19:10:00.387Z|02200|timeval|WARN|faults: 103 minor, 39 major
> 2019-01-24T19:10:00.387Z|02201|timeval|WARN|disk: 9488 reads, 0 writes
> 2019-01-24T19:10:00.387Z|02202|timeval|WARN|context switches: 41 voluntary,
> 0 involuntary
> 2019-01-24T19:10:00.387Z|02203|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:10:06.333Z|02204|timeval|WARN|Unreasonably long 1132ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T19:10:06.354Z|02205|timeval|WARN|faults: 100 minor, 8 major
> 2019-01-24T19:10:06.354Z|02206|timeval|WARN|disk: 2560 reads, 0 writes
> 2019-01-24T19:10:06.354Z|02207|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T19:10:21.905Z|02208|jsonrpc|WARN|tcp:127.0.0.1:38458: send
> error: Broken pipe
> 2019-01-24T19:10:22.350Z|02209|timeval|WARN|Unreasonably long 5802ms poll
> interval (1ms user, 15ms system)
> 2019-01-24T19:10:22.350Z|02210|timeval|WARN|faults: 99 minor, 25 major
> 2019-01-24T19:10:22.350Z|02211|timeval|WARN|disk: 5448 reads, 8 writes
> 2019-01-24T19:10:22.350Z|02212|timeval|WARN|context switches: 28 voluntary,
> 0 involuntary
> 2019-01-24T19:10:22.361Z|02213|reconnect|WARN|tcp:127.0.0.1:38458:
> connection dropped (Broken pipe)
> 2019-01-24T19:10:34.327Z|02214|timeval|WARN|Unreasonably long 3847ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T19:10:34.638Z|02215|timeval|WARN|faults: 94 minor, 19 major
> 2019-01-24T19:10:34.638Z|02216|timeval|WARN|disk: 4128 reads, 0 writes
> 2019-01-24T19:10:34.638Z|02217|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T19:10:40.096Z|02218|timeval|WARN|Unreasonably long 1641ms poll
> interval (3ms user, 5ms system)
> 2019-01-24T19:10:40.117Z|02219|timeval|WARN|faults: 101 minor, 10 major
> 2019-01-24T19:10:40.117Z|02220|timeval|WARN|disk: 3040 reads, 0 writes
> 2019-01-24T19:10:40.117Z|02221|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T19:10:45.586Z|02222|timeval|WARN|Unreasonably long 1112ms poll
> interval (7ms user, 7ms system)
> 2019-01-24T19:10:45.663Z|02223|timeval|WARN|faults: 89 minor, 11 major
> 2019-01-24T19:10:45.663Z|02224|timeval|WARN|disk: 2904 reads, 0 writes
> 2019-01-24T19:10:45.664Z|02225|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T19:10:51.264Z|02226|timeval|WARN|Unreasonably long 1358ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T19:10:51.287Z|02227|timeval|WARN|faults: 21 minor, 11 major
> 2019-01-24T19:10:51.287Z|02228|timeval|WARN|disk: 2232 reads, 0 writes
> 2019-01-24T19:10:51.287Z|02229|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T19:10:51.287Z|02230|coverage|INFO|Dropped 5 log messages in last
> 45 seconds (most recently, 6 seconds ago) due to excessive rate
> 2019-01-24T19:10:51.434Z|02231|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:10:55.906Z|02232|timeval|WARN|Unreasonably long 2408ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T19:10:55.925Z|02233|timeval|WARN|faults: 57 minor, 15 major
> 2019-01-24T19:10:55.925Z|02234|timeval|WARN|disk: 3528 reads, 0 writes
> 2019-01-24T19:10:55.925Z|02235|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T19:11:02.229Z|02236|timeval|WARN|Unreasonably long 1545ms poll
> interval (0ms user, 3ms system)
> 2019-01-24T19:11:02.268Z|02237|timeval|WARN|faults: 31 minor, 8 major
> 2019-01-24T19:11:02.268Z|02238|timeval|WARN|disk: 1880 reads, 0 writes
> 2019-01-24T19:11:02.268Z|02239|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T19:11:08.523Z|02240|timeval|WARN|Unreasonably long 4318ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T19:11:09.454Z|02241|timeval|WARN|faults: 61 minor, 17 major
> 2019-01-24T19:11:09.454Z|02242|timeval|WARN|disk: 3864 reads, 0 writes
> 2019-01-24T19:11:09.454Z|02243|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T19:11:14.216Z|02244|timeval|WARN|Unreasonably long 1568ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T19:11:14.257Z|02245|timeval|WARN|faults: 46 minor, 15 major
> 2019-01-24T19:11:14.257Z|02246|timeval|WARN|disk: 2840 reads, 0 writes
> 2019-01-24T19:11:14.257Z|02247|timeval|WARN|context switches: 16 voluntary,
> 0 involuntary
> 2019-01-24T19:11:21.333Z|02248|jsonrpc|WARN|tcp:127.0.0.1:38460: send
> error: Broken pipe
> 2019-01-24T19:11:21.597Z|02249|jsonrpc|WARN|tcp:127.0.0.1:40558: send
> error: Broken pipe
> 2019-01-24T19:11:22.719Z|02250|timeval|WARN|Unreasonably long 7788ms poll
> interval (4ms user, 10ms system)
> 2019-01-24T19:11:22.719Z|02251|timeval|WARN|faults: 114 minor, 31 major
> 2019-01-24T19:11:22.720Z|02252|timeval|WARN|disk: 6176 reads, 16 writes
> 2019-01-24T19:11:22.720Z|02253|timeval|WARN|context switches: 38 voluntary,
> 0 involuntary
> 2019-01-24T19:11:26.478Z|02254|reconnect|WARN|tcp:127.0.0.1:38460:
> connection dropped (Broken pipe)
> 2019-01-24T19:11:26.667Z|02255|reconnect|WARN|tcp:127.0.0.1:40558:
> connection dropped (Broken pipe)
> 2019-01-24T19:11:27.722Z|02256|timeval|WARN|Unreasonably long 5003ms poll
> interval (7ms user, 7ms system)
> 2019-01-24T19:11:27.723Z|02257|timeval|WARN|faults: 92 minor, 21 major
> 2019-01-24T19:11:27.723Z|02258|timeval|WARN|disk: 3832 reads, 8 writes
> 2019-01-24T19:11:27.723Z|02259|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T19:11:32.295Z|02260|timeval|WARN|Unreasonably long 2441ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T19:11:32.324Z|02261|timeval|WARN|faults: 67 minor, 8 major
> 2019-01-24T19:11:32.324Z|02262|timeval|WARN|disk: 2384 reads, 0 writes
> 2019-01-24T19:11:32.324Z|02263|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T19:11:34.732Z|02264|timeval|WARN|Unreasonably long 2387ms poll
> interval (2ms user, 7ms system)
> 2019-01-24T19:11:34.732Z|02265|timeval|WARN|faults: 66 minor, 9 major
> 2019-01-24T19:11:34.732Z|02266|timeval|WARN|disk: 1800 reads, 0 writes
> 2019-01-24T19:11:34.732Z|02267|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T19:11:40.200Z|02268|reconnect|ERR|tcp:127.0.0.1:40586: no
> response to inactivity probe after 5.92 seconds, disconnecting
> 2019-01-24T19:11:40.360Z|02269|timeval|WARN|Unreasonably long 1078ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T19:11:40.360Z|02270|timeval|WARN|faults: 31 minor, 5 major
> 2019-01-24T19:11:40.360Z|02271|timeval|WARN|disk: 688 reads, 8 writes
> 2019-01-24T19:11:40.360Z|02272|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T19:12:37.051Z|02273|timeval|WARN|Unreasonably long 1043ms poll
> interval (0ms user, 10ms system)
> 2019-01-24T19:12:37.839Z|02274|timeval|WARN|faults: 99 minor, 14 major
> 2019-01-24T19:12:37.875Z|02275|timeval|WARN|disk: 3640 reads, 0 writes
> 2019-01-24T19:12:37.875Z|02276|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T19:12:37.875Z|02277|coverage|INFO|Dropped 9 log messages in last
> 102 seconds (most recently, 58 seconds ago) due to excessive rate
> 2019-01-24T19:12:38.269Z|02278|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:12:39.607Z|02279|timeval|WARN|Unreasonably long 1008ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T19:12:39.607Z|02280|timeval|WARN|faults: 47 minor, 15 major
> 2019-01-24T19:12:39.607Z|02281|timeval|WARN|disk: 2744 reads, 0 writes
> 2019-01-24T19:12:39.608Z|02282|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T19:13:11.257Z|02283|timeval|WARN|Unreasonably long 3534ms poll
> interval (6ms user, 9ms system)
> 2019-01-24T19:13:11.267Z|02284|timeval|WARN|faults: 140 minor, 19 major
> 2019-01-24T19:13:11.267Z|02285|timeval|WARN|disk: 4576 reads, 0 writes
> 2019-01-24T19:13:11.267Z|02286|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T19:13:11.267Z|02287|coverage|INFO|Dropped 1 log messages in last
> 32 seconds (most recently, 32 seconds ago) due to excessive rate
> 2019-01-24T19:13:11.267Z|02288|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:13:19.407Z|02289|timeval|WARN|Unreasonably long 7499ms poll
> interval (3ms user, 9ms system)
> 2019-01-24T19:13:20.066Z|02290|timeval|WARN|faults: 84 minor, 27 major
> 2019-01-24T19:13:20.067Z|02291|timeval|WARN|disk: 5976 reads, 0 writes
> 2019-01-24T19:13:20.067Z|02292|timeval|WARN|context switches: 33 voluntary,
> 0 involuntary
> 2019-01-24T19:13:21.955Z|02293|jsonrpc|WARN|tcp:127.0.0.1:41624: send
> error: Broken pipe
> 2019-01-24T19:13:27.311Z|02294|timeval|WARN|Unreasonably long 7244ms poll
> interval (17ms user, 10ms system)
> 2019-01-24T19:13:28.067Z|02295|timeval|WARN|faults: 87 minor, 17 major
> 2019-01-24T19:13:28.067Z|02296|timeval|WARN|disk: 3984 reads, 8 writes
> 2019-01-24T19:13:28.067Z|02297|timeval|WARN|context switches: 85 voluntary,
> 0 involuntary
> 2019-01-24T19:13:29.089Z|02298|jsonrpc|WARN|tcp:127.0.0.1:40584: send
> error: Broken pipe
> 2019-01-24T19:13:29.089Z|02299|reconnect|WARN|tcp:127.0.0.1:41624:
> connection dropped (Broken pipe)
> 2019-01-24T19:13:29.553Z|02300|timeval|WARN|Unreasonably long 1081ms poll
> interval (21ms user, 1ms system)
> 2019-01-24T19:13:29.553Z|02301|timeval|WARN|faults: 105 minor, 1 major
> 2019-01-24T19:13:29.553Z|02302|timeval|WARN|disk: 920 reads, 0 writes
> 2019-01-24T19:13:29.553Z|02303|timeval|WARN|context switches: 2 voluntary,
> 0 involuntary
> 2019-01-24T19:13:29.553Z|02304|reconnect|WARN|tcp:127.0.0.1:40584:
> connection dropped (Broken pipe)
> 2019-01-24T19:16:45.398Z|02305|timeval|WARN|Unreasonably long 5971ms poll
> interval (0ms user, 31ms system)
> 2019-01-24T19:16:47.344Z|02306|timeval|WARN|faults: 87 minor, 62 major
> 2019-01-24T19:16:47.668Z|02307|timeval|WARN|disk: 12624 reads, 0 writes
> 2019-01-24T19:16:47.668Z|02308|timeval|WARN|context switches: 67 voluntary,
> 1 involuntary
> 2019-01-24T19:16:47.668Z|02309|coverage|INFO|Dropped 3 log messages in last
> 207 seconds (most recently, 198 seconds ago) due to excessive rate
> 2019-01-24T19:16:48.290Z|02310|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:16:48.474Z|02311|jsonrpc|WARN|tcp:127.0.0.1:41634: send
> error: Broken pipe
> 2019-01-24T19:16:48.475Z|02312|jsonrpc|WARN|tcp:127.0.0.1:43858: send
> error: Broken pipe
> 2019-01-24T19:16:48.894Z|02313|reconnect|WARN|tcp:127.0.0.1:41634:
> connection dropped (Broken pipe)
> 2019-01-24T19:16:48.894Z|02314|reconnect|WARN|tcp:127.0.0.1:43858:
> connection dropped (Broken pipe)
> 2019-01-24T19:17:05.676Z|02315|timeval|WARN|Unreasonably long 1334ms poll
> interval (0ms user, 12ms system)
> 2019-01-24T19:17:05.852Z|02316|timeval|WARN|faults: 59 minor, 8 major
> 2019-01-24T19:17:05.852Z|02317|timeval|WARN|disk: 2304 reads, 0 writes
> 2019-01-24T19:17:05.852Z|02318|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T19:17:06.311Z|02319|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:17:14.589Z|02320|timeval|WARN|Unreasonably long 4483ms poll
> interval (0ms user, 19ms system)
> 2019-01-24T19:17:15.051Z|02321|timeval|WARN|faults: 98 minor, 23 major
> 2019-01-24T19:17:15.052Z|02322|timeval|WARN|disk: 5592 reads, 0 writes
> 2019-01-24T19:17:15.052Z|02323|timeval|WARN|context switches: 26 voluntary,
> 0 involuntary
> 2019-01-24T19:17:15.179Z|02324|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:17:17.885Z|02325|timeval|WARN|Unreasonably long 2384ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T19:17:18.948Z|02326|timeval|WARN|faults: 58 minor, 8 major
> 2019-01-24T19:17:18.948Z|02327|timeval|WARN|disk: 2320 reads, 0 writes
> 2019-01-24T19:17:18.948Z|02328|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T19:17:31.315Z|02329|reconnect|ERR|tcp:127.0.0.1:43876: no
> response to inactivity probe after 16.1 seconds, disconnecting
> 2019-01-24T19:17:31.788Z|02330|reconnect|ERR|tcp:127.0.0.1:43878: no
> response to inactivity probe after 16.6 seconds, disconnecting
> 2019-01-24T19:17:34.782Z|02331|timeval|WARN|Unreasonably long 15675ms poll
> interval (1ms user, 31ms system)
> 2019-01-24T19:17:34.782Z|02332|timeval|WARN|faults: 160 minor, 75 major
> 2019-01-24T19:17:34.782Z|02333|timeval|WARN|disk: 13896 reads, 8 writes
> 2019-01-24T19:17:34.782Z|02334|timeval|WARN|context switches: 84 voluntary,
> 0 involuntary
> 2019-01-24T19:17:37.335Z|02335|timeval|WARN|Unreasonably long 1018ms poll
> interval (3ms user, 4ms system)
> 2019-01-24T19:17:37.360Z|02336|timeval|WARN|faults: 11 minor, 6 major
> 2019-01-24T19:17:37.361Z|02337|timeval|WARN|disk: 1088 reads, 0 writes
> 2019-01-24T19:17:37.361Z|02338|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T19:17:55.900Z|02339|jsonrpc|WARN|tcp:127.0.0.1:43894: send
> error: Broken pipe
> 2019-01-24T19:17:55.967Z|02340|jsonrpc|WARN|tcp:127.0.0.1:43896: send
> error: Broken pipe
> 2019-01-24T19:17:57.670Z|02341|timeval|WARN|Unreasonably long 16960ms poll
> interval (18ms user, 36ms system)
> 2019-01-24T19:17:57.670Z|02342|timeval|WARN|faults: 187 minor, 83 major
> 2019-01-24T19:17:57.670Z|02343|timeval|WARN|disk: 15240 reads, 8 writes
> 2019-01-24T19:17:57.670Z|02344|timeval|WARN|context switches: 89 voluntary,
> 0 involuntary
> 2019-01-24T19:17:57.670Z|02345|coverage|INFO|Dropped 3 log messages in last
> 38 seconds (most recently, 20 seconds ago) due to excessive rate
> 2019-01-24T19:17:57.711Z|02346|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:17:57.849Z|02347|reconnect|WARN|tcp:127.0.0.1:43894:
> connection dropped (Broken pipe)
> 2019-01-24T19:17:57.849Z|02348|reconnect|WARN|tcp:127.0.0.1:43896:
> connection dropped (Broken pipe)
> 2019-01-24T19:25:46.733Z|02349|timeval|WARN|Unreasonably long 3425ms poll
> interval (1ms user, 16ms system)
> 2019-01-24T19:25:46.763Z|02350|timeval|WARN|faults: 69 minor, 30 major
> 2019-01-24T19:25:46.763Z|02351|timeval|WARN|disk: 5856 reads, 0 writes
> 2019-01-24T19:25:46.763Z|02352|timeval|WARN|context switches: 32 voluntary,
> 0 involuntary
> 2019-01-24T19:25:46.763Z|02353|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:25:58.309Z|02354|timeval|WARN|Unreasonably long 3355ms poll
> interval (1ms user, 11ms system)
> 2019-01-24T19:25:59.538Z|02355|timeval|WARN|faults: 59 minor, 25 major
> 2019-01-24T19:25:59.553Z|02356|timeval|WARN|disk: 5648 reads, 0 writes
> 2019-01-24T19:25:59.553Z|02357|timeval|WARN|context switches: 26 voluntary,
> 0 involuntary
> 2019-01-24T19:26:00.646Z|02358|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:26:35.153Z|02359|jsonrpc|WARN|tcp:127.0.0.1:44410: send
> error: Broken pipe
> 2019-01-24T19:26:35.516Z|02360|jsonrpc|WARN|tcp:127.0.0.1:44412: send
> error: Broken pipe
> 2019-01-24T19:26:36.811Z|02361|timeval|WARN|Unreasonably long 33076ms poll
> interval (23ms user, 36ms system)
> 2019-01-24T19:26:36.811Z|02362|timeval|WARN|faults: 168 minor, 137 major
> 2019-01-24T19:26:36.811Z|02363|timeval|WARN|disk: 30280 reads, 24 writes
> 2019-01-24T19:26:36.811Z|02364|timeval|WARN|context switches: 156
> voluntary, 0 involuntary
> 2019-01-24T19:26:36.811Z|02365|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:26:36.811Z|02366|reconnect|WARN|tcp:127.0.0.1:44410:
> connection dropped (Broken pipe)
> 2019-01-24T19:26:36.811Z|02367|reconnect|WARN|tcp:127.0.0.1:44412:
> connection dropped (Broken pipe)
> 2019-01-24T19:26:36.812Z|02368|jsonrpc|WARN|tcp:127.0.0.1:48626: send
> error: Broken pipe
> 2019-01-24T19:26:36.815Z|02369|reconnect|WARN|tcp:127.0.0.1:48626:
> connection dropped (Broken pipe)
> 2019-01-24T19:26:36.815Z|02370|jsonrpc|WARN|tcp:127.0.0.1:48628: send
> error: Broken pipe
> 2019-01-24T19:26:36.819Z|02371|reconnect|WARN|tcp:127.0.0.1:48628:
> connection dropped (Broken pipe)
> 2019-01-24T19:26:36.819Z|02372|jsonrpc|WARN|tcp:127.0.0.1:48634: send
> error: Broken pipe
> 2019-01-24T19:26:36.822Z|02373|reconnect|WARN|tcp:127.0.0.1:48634:
> connection dropped (Broken pipe)
> 2019-01-24T19:26:36.827Z|02374|reconnect|WARN|tcp:127.0.0.1:48636:
> connection dropped (Broken pipe)
> 2019-01-24T19:27:00.592Z|02375|timeval|WARN|Unreasonably long 1046ms poll
> interval (2ms user, 6ms system)
> 2019-01-24T19:27:00.622Z|02376|timeval|WARN|faults: 63 minor, 8 major
> 2019-01-24T19:27:00.622Z|02377|timeval|WARN|disk: 2384 reads, 0 writes
> 2019-01-24T19:27:00.622Z|02378|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T19:27:00.622Z|02379|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:27:04.808Z|02380|timeval|WARN|Unreasonably long 2428ms poll
> interval (0ms user, 15ms system)
> 2019-01-24T19:27:04.851Z|02381|timeval|WARN|faults: 105 minor, 20 major
> 2019-01-24T19:27:04.851Z|02382|timeval|WARN|disk: 4696 reads, 0 writes
> 2019-01-24T19:27:04.851Z|02383|timeval|WARN|context switches: 23 voluntary,
> 0 involuntary
> 2019-01-24T19:27:13.169Z|02384|timeval|WARN|Unreasonably long 4489ms poll
> interval (0ms user, 12ms system)
> 2019-01-24T19:27:13.220Z|02385|timeval|WARN|faults: 75 minor, 28 major
> 2019-01-24T19:27:13.220Z|02386|timeval|WARN|disk: 5384 reads, 0 writes
> 2019-01-24T19:27:13.220Z|02387|timeval|WARN|context switches: 31 voluntary,
> 0 involuntary
> 2019-01-24T19:27:19.562Z|02388|timeval|WARN|Unreasonably long 1239ms poll
> interval (0ms user, 7ms system)
> 2019-01-24T19:27:19.696Z|02389|timeval|WARN|faults: 65 minor, 5 major
> 2019-01-24T19:27:19.696Z|02390|timeval|WARN|disk: 1064 reads, 0 writes
> 2019-01-24T19:27:19.696Z|02391|timeval|WARN|context switches: 7 voluntary,
> 0 involuntary
> 2019-01-24T19:27:22.209Z|02392|timeval|WARN|Unreasonably long 1415ms poll
> interval (0ms user, 3ms system)
> 2019-01-24T19:27:22.209Z|02393|timeval|WARN|faults: 6 minor, 5 major
> 2019-01-24T19:27:22.209Z|02394|timeval|WARN|disk: 1384 reads, 0 writes
> 2019-01-24T19:27:22.209Z|02395|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T19:27:28.368Z|02396|timeval|WARN|Unreasonably long 1157ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T19:27:28.430Z|02397|timeval|WARN|faults: 7 minor, 12 major
> 2019-01-24T19:27:28.430Z|02398|timeval|WARN|disk: 1760 reads, 0 writes
> 2019-01-24T19:27:28.430Z|02399|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T19:27:31.309Z|02400|timeval|WARN|Unreasonably long 1242ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T19:27:31.309Z|02401|timeval|WARN|faults: 92 minor, 7 major
> 2019-01-24T19:27:31.309Z|02402|timeval|WARN|disk: 2152 reads, 0 writes
> 2019-01-24T19:27:31.309Z|02403|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T19:27:40.696Z|02404|timeval|WARN|Unreasonably long 2051ms poll
> interval (0ms user, 11ms system)
> 2019-01-24T19:27:40.740Z|02405|timeval|WARN|faults: 82 minor, 14 major
> 2019-01-24T19:27:40.741Z|02406|timeval|WARN|disk: 3448 reads, 0 writes
> 2019-01-24T19:27:40.741Z|02407|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T19:27:43.213Z|02408|timeval|WARN|Unreasonably long 1113ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T19:27:43.266Z|02409|timeval|WARN|faults: 102 minor, 11 major
> 2019-01-24T19:27:43.266Z|02410|timeval|WARN|disk: 3312 reads, 0 writes
> 2019-01-24T19:27:43.266Z|02411|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T19:27:47.350Z|02412|timeval|WARN|Unreasonably long 1007ms poll
> interval (0ms user, 6ms system)
> 2019-01-24T19:27:47.661Z|02413|timeval|WARN|faults: 74 minor, 9 major
> 2019-01-24T19:27:47.661Z|02414|timeval|WARN|disk: 2456 reads, 0 writes
> 2019-01-24T19:27:47.661Z|02415|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T19:27:47.661Z|02416|coverage|INFO|Dropped 8 log messages in last
> 42 seconds (most recently, 4 seconds ago) due to excessive rate
> 2019-01-24T19:27:47.717Z|02417|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:27:53.008Z|02418|timeval|WARN|Unreasonably long 3479ms poll
> interval (4ms user, 2ms system)
> 2019-01-24T19:27:53.061Z|02419|timeval|WARN|faults: 70 minor, 16 major
> 2019-01-24T19:27:53.061Z|02420|timeval|WARN|disk: 4096 reads, 0 writes
> 2019-01-24T19:27:53.061Z|02421|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T19:27:56.405Z|02422|timeval|WARN|Unreasonably long 3127ms poll
> interval (1ms user, 8ms system)
> 2019-01-24T19:27:56.493Z|02423|timeval|WARN|faults: 96 minor, 18 major
> 2019-01-24T19:27:56.493Z|02424|timeval|WARN|disk: 4152 reads, 0 writes
> 2019-01-24T19:27:56.493Z|02425|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T19:28:00.955Z|02426|timeval|WARN|Unreasonably long 2403ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T19:28:01.031Z|02427|timeval|WARN|faults: 45 minor, 14 major
> 2019-01-24T19:28:01.031Z|02428|timeval|WARN|disk: 3160 reads, 0 writes
> 2019-01-24T19:28:01.031Z|02429|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T19:28:23.660Z|02430|jsonrpc|WARN|Dropped 1 log messages in last
> 106 seconds (most recently, 106 seconds ago) due to excessive rate
> 2019-01-24T19:28:24.002Z|02431|jsonrpc|WARN|tcp:127.0.0.1:48640: send
> error: Broken pipe
> 2019-01-24T19:28:24.002Z|02432|jsonrpc|WARN|tcp:127.0.0.1:48642: send
> error: Broken pipe
> 2019-01-24T19:28:26.200Z|02433|timeval|WARN|Unreasonably long 24362ms poll
> interval (15ms user, 65ms system)
> 2019-01-24T19:28:26.200Z|02434|timeval|WARN|faults: 163 minor, 121 major
> 2019-01-24T19:28:26.200Z|02435|timeval|WARN|disk: 25960 reads, 8 writes
> 2019-01-24T19:28:26.200Z|02436|timeval|WARN|context switches: 171
> voluntary, 0 involuntary
> 2019-01-24T19:28:26.200Z|02437|reconnect|WARN|tcp:127.0.0.1:48640:
> connection dropped (Broken pipe)
> 2019-01-24T19:28:26.200Z|02438|reconnect|WARN|tcp:127.0.0.1:48642:
> connection dropped (Broken pipe)
> 2019-01-24T19:28:26.200Z|02439|jsonrpc|WARN|tcp:127.0.0.1:49698: send
> error: Broken pipe
> 2019-01-24T19:28:26.205Z|02440|reconnect|WARN|tcp:127.0.0.1:49698:
> connection dropped (Broken pipe)
> 2019-01-24T19:28:36.205Z|02441|reconnect|ERR|tcp:127.0.0.1:49700: no
> response to inactivity probe after 5 seconds, disconnecting
> 2019-01-24T19:33:25.609Z|02442|timeval|WARN|Unreasonably long 1205ms poll
> interval (0ms user, 14ms system)
> 2019-01-24T19:33:25.671Z|02443|timeval|WARN|faults: 45 minor, 11 major
> 2019-01-24T19:33:25.671Z|02444|timeval|WARN|disk: 2256 reads, 0 writes
> 2019-01-24T19:33:25.671Z|02445|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T19:33:25.671Z|02446|coverage|INFO|Dropped 4 log messages in last
> 332 seconds (most recently, 299 seconds ago) due to excessive rate
> 2019-01-24T19:33:25.785Z|02447|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:33:59.192Z|02448|timeval|WARN|Unreasonably long 3567ms poll
> interval (0ms user, 42ms system)
> 2019-01-24T19:33:59.224Z|02449|timeval|WARN|faults: 169 minor, 52 major
> 2019-01-24T19:33:59.224Z|02450|timeval|WARN|disk: 11256 reads, 0 writes
> 2019-01-24T19:33:59.224Z|02451|timeval|WARN|context switches: 55 voluntary,
> 0 involuntary
> 2019-01-24T19:33:59.224Z|02452|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:35:36.054Z|02453|timeval|WARN|Unreasonably long 3459ms poll
> interval (1ms user, 12ms system)
> 2019-01-24T19:35:36.463Z|02454|timeval|WARN|faults: 70 minor, 32 major
> 2019-01-24T19:35:36.463Z|02455|timeval|WARN|disk: 6528 reads, 0 writes
> 2019-01-24T19:35:36.463Z|02456|timeval|WARN|context switches: 35 voluntary,
> 0 involuntary
> 2019-01-24T19:35:36.677Z|02457|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:36:29.958Z|02458|jsonrpc|WARN|tcp:127.0.0.1:50246: send
> error: Broken pipe
> 2019-01-24T19:36:33.109Z|02459|timeval|WARN|Unreasonably long 32869ms poll
> interval (25ms user, 39ms system)
> 2019-01-24T19:36:33.109Z|02460|timeval|WARN|faults: 201 minor, 128 major
> 2019-01-24T19:36:33.109Z|02461|timeval|WARN|disk: 27968 reads, 8 writes
> 2019-01-24T19:36:33.109Z|02462|timeval|WARN|context switches: 153
> voluntary, 0 involuntary
> 2019-01-24T19:36:33.109Z|02463|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:36:33.110Z|02464|reconnect|WARN|tcp:127.0.0.1:50246:
> connection dropped (Broken pipe)
> 2019-01-24T19:36:33.110Z|02465|jsonrpc|WARN|tcp:127.0.0.1:53952: send
> error: Broken pipe
> 2019-01-24T19:36:33.114Z|02466|reconnect|WARN|tcp:127.0.0.1:53952:
> connection dropped (Broken pipe)
> 2019-01-24T19:36:33.114Z|02467|jsonrpc|WARN|tcp:127.0.0.1:53954: send
> error: Broken pipe
> 2019-01-24T19:36:33.114Z|02468|reconnect|WARN|tcp:127.0.0.1:53954:
> connection dropped (Broken pipe)
> 2019-01-24T19:45:05.095Z|02469|timeval|WARN|Unreasonably long 2852ms poll
> interval (5ms user, 14ms system)
> 2019-01-24T19:45:05.130Z|02470|timeval|WARN|faults: 42 minor, 20 major
> 2019-01-24T19:45:05.131Z|02471|timeval|WARN|disk: 4112 reads, 0 writes
> 2019-01-24T19:45:05.131Z|02472|timeval|WARN|context switches: 25 voluntary,
> 0 involuntary
> 2019-01-24T19:45:05.131Z|02473|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:45:58.148Z|02474|timeval|WARN|Unreasonably long 1289ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T19:45:58.189Z|02475|timeval|WARN|faults: 78 minor, 13 major
> 2019-01-24T19:45:58.189Z|02476|timeval|WARN|disk: 3728 reads, 0 writes
> 2019-01-24T19:45:58.189Z|02477|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T19:45:58.313Z|02478|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:46:01.843Z|02479|timeval|WARN|Unreasonably long 2319ms poll
> interval (0ms user, 12ms system)
> 2019-01-24T19:46:01.853Z|02480|timeval|WARN|faults: 88 minor, 19 major
> 2019-01-24T19:46:01.853Z|02481|timeval|WARN|disk: 3968 reads, 0 writes
> 2019-01-24T19:46:01.853Z|02482|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T19:46:01.853Z|02483|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:46:07.013Z|02484|timeval|WARN|Unreasonably long 3592ms poll
> interval (1ms user, 7ms system)
> 2019-01-24T19:46:07.145Z|02485|timeval|WARN|faults: 60 minor, 24 major
> 2019-01-24T19:46:07.145Z|02486|timeval|WARN|disk: 4512 reads, 0 writes
> 2019-01-24T19:46:07.145Z|02487|timeval|WARN|context switches: 26 voluntary,
> 0 involuntary
> 2019-01-24T19:46:07.166Z|02488|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T19:46:10.338Z|02489|timeval|WARN|Unreasonably long 3146ms poll
> interval (5ms user, 9ms system)
> 2019-01-24T19:46:10.338Z|02490|timeval|WARN|faults: 91 minor, 22 major
> 2019-01-24T19:46:10.338Z|02491|timeval|WARN|disk: 4672 reads, 0 writes
> 2019-01-24T19:46:10.338Z|02492|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T19:46:10.757Z|02493|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:24:13.471Z|02494|timeval|WARN|Unreasonably long 2458ms poll
> interval (1ms user, 2ms system)
> 2019-01-24T20:24:13.689Z|02495|timeval|WARN|faults: 69 minor, 9 major
> 2019-01-24T20:24:13.689Z|02496|timeval|WARN|disk: 1528 reads, 0 writes
> 2019-01-24T20:24:13.689Z|02497|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T20:24:13.763Z|02498|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:28:12.342Z|02499|timeval|WARN|Unreasonably long 2471ms poll
> interval (0ms user, 17ms system)
> 2019-01-24T20:28:13.617Z|02500|timeval|WARN|faults: 128 minor, 17 major
> 2019-01-24T20:28:14.038Z|02501|timeval|WARN|disk: 4392 reads, 0 writes
> 2019-01-24T20:28:14.039Z|02502|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T20:28:14.462Z|02503|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:28:47.836Z|02504|timeval|WARN|Unreasonably long 1655ms poll
> interval (0ms user, 9ms system)
> 2019-01-24T20:28:48.208Z|02505|timeval|WARN|faults: 106 minor, 15 major
> 2019-01-24T20:28:48.208Z|02506|timeval|WARN|disk: 3944 reads, 0 writes
> 2019-01-24T20:28:48.208Z|02507|timeval|WARN|context switches: 17 voluntary,
> 0 involuntary
> 2019-01-24T20:28:48.510Z|02508|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:29:00.323Z|02509|timeval|WARN|Unreasonably long 10512ms poll
> interval (3ms user, 27ms system)
> 2019-01-24T20:29:00.374Z|02510|timeval|WARN|faults: 180 minor, 55 major
> 2019-01-24T20:29:00.374Z|02511|timeval|WARN|disk: 11736 reads, 0 writes
> 2019-01-24T20:29:00.374Z|02512|timeval|WARN|context switches: 60 voluntary,
> 0 involuntary
> 2019-01-24T20:29:00.374Z|02513|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:29:00.376Z|02514|reconnect|ERR|tcp:127.0.0.1:44948: no
> response to inactivity probe after 5.51 seconds, disconnecting
> 2019-01-24T20:29:00.376Z|02515|reconnect|ERR|tcp:127.0.0.1:44950: no
> response to inactivity probe after 5.51 seconds, disconnecting
> 2019-01-24T20:31:14.521Z|02516|timeval|WARN|Unreasonably long 1813ms poll
> interval (2ms user, 7ms system)
> 2019-01-24T20:31:14.532Z|02517|timeval|WARN|faults: 40 minor, 12 major
> 2019-01-24T20:31:14.532Z|02518|timeval|WARN|disk: 2640 reads, 0 writes
> 2019-01-24T20:31:14.532Z|02519|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T20:31:14.532Z|02520|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:31:24.341Z|02521|timeval|WARN|Unreasonably long 1688ms poll
> interval (3ms user, 10ms system)
> 2019-01-24T20:31:24.484Z|02522|timeval|WARN|faults: 100 minor, 11 major
> 2019-01-24T20:31:24.484Z|02523|timeval|WARN|disk: 2976 reads, 0 writes
> 2019-01-24T20:31:24.484Z|02524|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T20:31:24.484Z|02525|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:32:19.174Z|02526|timeval|WARN|Unreasonably long 1532ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T20:32:19.347Z|02527|timeval|WARN|faults: 45 minor, 8 major
> 2019-01-24T20:32:19.347Z|02528|timeval|WARN|disk: 2256 reads, 0 writes
> 2019-01-24T20:32:19.347Z|02529|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T20:32:19.347Z|02530|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:32:24.251Z|02531|timeval|WARN|Unreasonably long 3592ms poll
> interval (1ms user, 9ms system)
> 2019-01-24T20:32:24.395Z|02532|timeval|WARN|faults: 89 minor, 11 major
> 2019-01-24T20:32:24.395Z|02533|timeval|WARN|disk: 2944 reads, 0 writes
> 2019-01-24T20:32:24.395Z|02534|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T20:32:24.395Z|02535|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:32:29.355Z|02536|timeval|WARN|Unreasonably long 1964ms poll
> interval (8ms user, 10ms system)
> 2019-01-24T20:32:29.355Z|02537|timeval|WARN|faults: 104 minor, 8 major
> 2019-01-24T20:32:29.355Z|02538|timeval|WARN|disk: 2496 reads, 0 writes
> 2019-01-24T20:32:29.355Z|02539|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T20:32:29.733Z|02540|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T20:32:39.229Z|02541|timeval|WARN|Unreasonably long 1022ms poll
> interval (6ms user, 26ms system)
> 2019-01-24T20:32:39.251Z|02542|timeval|WARN|faults: 18 minor, 8 major
> 2019-01-24T20:32:39.325Z|02543|timeval|WARN|disk: 1072 reads, 0 writes
> 2019-01-24T20:32:39.325Z|02544|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T21:00:09.548Z|02545|timeval|WARN|Unreasonably long 2703ms poll
> interval (5ms user, 6ms system)
> 2019-01-24T21:00:09.592Z|02546|timeval|WARN|faults: 96 minor, 15 major
> 2019-01-24T21:00:09.592Z|02547|timeval|WARN|disk: 3456 reads, 0 writes
> 2019-01-24T21:00:09.592Z|02548|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T21:00:09.592Z|02549|coverage|INFO|Dropped 1 log messages in last
> 1650 seconds (most recently, 1650 seconds ago) due to excessive rate
> 2019-01-24T21:00:09.783Z|02550|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T21:28:47.783Z|02551|timeval|WARN|Unreasonably long 1025ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T21:28:47.794Z|02552|timeval|WARN|faults: 98 minor, 14 major
> 2019-01-24T21:28:47.794Z|02553|timeval|WARN|disk: 3344 reads, 0 writes
> 2019-01-24T21:28:47.794Z|02554|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T21:28:47.794Z|02555|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T21:28:57.239Z|02556|timeval|WARN|Unreasonably long 4066ms poll
> interval (0ms user, 29ms system)
> 2019-01-24T21:28:57.347Z|02557|timeval|WARN|faults: 82 minor, 29 major
> 2019-01-24T21:28:57.347Z|02558|timeval|WARN|disk: 5656 reads, 0 writes
> 2019-01-24T21:28:57.347Z|02559|timeval|WARN|context switches: 31 voluntary,
> 0 involuntary
> 2019-01-24T21:28:57.595Z|02560|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T21:28:59.085Z|02561|reconnect|ERR|tcp:127.0.0.1:54020: no
> response to inactivity probe after 5.2 seconds, disconnecting
> 2019-01-24T21:28:59.122Z|02562|reconnect|ERR|tcp:127.0.0.1:54021: no
> response to inactivity probe after 5.24 seconds, disconnecting
> 2019-01-24T21:29:00.794Z|02563|timeval|WARN|Unreasonably long 2627ms poll
> interval (1ms user, 15ms system)
> 2019-01-24T21:29:00.794Z|02564|timeval|WARN|faults: 77 minor, 17 major
> 2019-01-24T21:29:00.794Z|02565|timeval|WARN|disk: 3464 reads, 8 writes
> 2019-01-24T21:29:00.794Z|02566|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T21:29:00.794Z|02567|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T21:29:06.734Z|02568|timeval|WARN|Unreasonably long 2208ms poll
> interval (6ms user, 16ms system)
> 2019-01-24T21:29:06.810Z|02569|timeval|WARN|faults: 94 minor, 18 major
> 2019-01-24T21:29:06.810Z|02570|timeval|WARN|disk: 3928 reads, 0 writes
> 2019-01-24T21:29:06.810Z|02571|timeval|WARN|context switches: 25 voluntary,
> 0 involuntary
> 2019-01-24T21:29:07.020Z|02572|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T21:29:34.711Z|02573|jsonrpc|WARN|tcp:127.0.0.1:54334: send
> error: Broken pipe
> 2019-01-24T21:29:36.706Z|02574|jsonrpc|WARN|tcp:127.0.0.1:56778: send
> error: Broken pipe
> 2019-01-24T21:29:37.401Z|02575|timeval|WARN|Unreasonably long 25289ms poll
> interval (266ms user, 254ms system)
> 2019-01-24T21:29:37.401Z|02576|timeval|WARN|faults: 222 minor, 84 major
> 2019-01-24T21:29:37.401Z|02577|timeval|WARN|disk: 17072 reads, 8 writes
> 2019-01-24T21:29:37.402Z|02578|timeval|WARN|context switches: 90 voluntary,
> 2 involuntary
> 2019-01-24T21:29:37.402Z|02579|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T21:29:37.404Z|02580|reconnect|WARN|tcp:127.0.0.1:54334:
> connection dropped (Broken pipe)
> 2019-01-24T21:29:37.404Z|02581|reconnect|WARN|tcp:127.0.0.1:56778:
> connection dropped (Broken pipe)
> 2019-01-24T22:01:07.605Z|02582|timeval|WARN|Unreasonably long 1541ms poll
> interval (3ms user, 13ms system)
> 2019-01-24T22:01:07.649Z|02583|timeval|WARN|faults: 95 minor, 12 major
> 2019-01-24T22:01:07.649Z|02584|timeval|WARN|disk: 3440 reads, 0 writes
> 2019-01-24T22:01:07.649Z|02585|timeval|WARN|context switches: 15 voluntary,
> 0 involuntary
> 2019-01-24T22:01:07.649Z|02586|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:06:51.628Z|02587|timeval|WARN|Unreasonably long 4060ms poll
> interval (0ms user, 33ms system)
> 2019-01-24T22:06:51.664Z|02588|timeval|WARN|faults: 133 minor, 50 major
> 2019-01-24T22:06:51.664Z|02589|timeval|WARN|disk: 10832 reads, 0 writes
> 2019-01-24T22:06:51.664Z|02590|timeval|WARN|context switches: 53 voluntary,
> 0 involuntary
> 2019-01-24T22:06:51.664Z|02591|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:07:03.211Z|02592|timeval|WARN|Unreasonably long 1600ms poll
> interval (0ms user, 11ms system)
> 2019-01-24T22:07:03.251Z|02593|timeval|WARN|faults: 91 minor, 15 major
> 2019-01-24T22:07:03.252Z|02594|timeval|WARN|disk: 3360 reads, 0 writes
> 2019-01-24T22:07:03.252Z|02595|timeval|WARN|context switches: 19 voluntary,
> 0 involuntary
> 2019-01-24T22:07:03.321Z|02596|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:07:08.963Z|02597|timeval|WARN|Unreasonably long 1123ms poll
> interval (4ms user, 5ms system)
> 2019-01-24T22:07:08.977Z|02598|timeval|WARN|faults: 98 minor, 9 major
> 2019-01-24T22:07:08.977Z|02599|timeval|WARN|disk: 2752 reads, 0 writes
> 2019-01-24T22:07:08.977Z|02600|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T22:07:09.077Z|02601|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:20:26.015Z|02602|timeval|WARN|Unreasonably long 2364ms poll
> interval (5ms user, 11ms system)
> 2019-01-24T22:20:26.085Z|02603|timeval|WARN|faults: 94 minor, 13 major
> 2019-01-24T22:20:26.085Z|02604|timeval|WARN|disk: 3480 reads, 0 writes
> 2019-01-24T22:20:26.085Z|02605|timeval|WARN|context switches: 16 voluntary,
> 0 involuntary
> 2019-01-24T22:20:26.106Z|02606|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:20:29.841Z|02607|timeval|WARN|Unreasonably long 2356ms poll
> interval (0ms user, 14ms system)
> 2019-01-24T22:20:29.841Z|02608|timeval|WARN|faults: 85 minor, 17 major
> 2019-01-24T22:20:29.841Z|02609|timeval|WARN|disk: 3920 reads, 0 writes
> 2019-01-24T22:20:29.841Z|02610|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T22:20:29.842Z|02611|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:21:02.190Z|02612|jsonrpc|WARN|tcp:127.0.0.1:58436: send
> error: Broken pipe
> 2019-01-24T22:21:13.432Z|02613|timeval|WARN|Unreasonably long 28571ms poll
> interval (355ms user, 316ms system)
> 2019-01-24T22:21:14.095Z|02614|timeval|WARN|faults: 56 minor, 18 major
> 2019-01-24T22:21:14.095Z|02615|timeval|WARN|disk: 3192 reads, 8 writes
> 2019-01-24T22:21:14.095Z|02616|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T22:21:14.826Z|02617|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:21:23.990Z|02618|reconnect|WARN|tcp:127.0.0.1:58436:
> connection dropped (Broken pipe)
> 2019-01-24T22:21:24.196Z|02619|reconnect|ERR|tcp:127.0.0.1:58476: no
> response to inactivity probe after 21.2 seconds, disconnecting
> 2019-01-24T22:21:24.196Z|02620|reconnect|ERR|tcp:127.0.0.1:58480: no
> response to inactivity probe after 21.4 seconds, disconnecting
> 2019-01-24T22:21:24.196Z|02621|jsonrpc|WARN|tcp:127.0.0.1:55938: send
> error: Connection reset by peer
> 2019-01-24T22:21:24.208Z|02622|timeval|WARN|Unreasonably long 9382ms poll
> interval (18ms user, 1ms system)
> 2019-01-24T22:21:24.208Z|02623|timeval|WARN|faults: 44 minor, 7 major
> 2019-01-24T22:21:24.208Z|02624|timeval|WARN|disk: 848 reads, 16 writes
> 2019-01-24T22:21:24.208Z|02625|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T22:21:24.208Z|02626|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:21:24.208Z|02627|reconnect|WARN|tcp:127.0.0.1:55938:
> connection dropped (Connection reset by peer)
> 2019-01-24T22:21:24.208Z|02628|jsonrpc|WARN|tcp:127.0.0.1:55944: send
> error: Broken pipe
> 2019-01-24T22:21:24.214Z|02629|reconnect|WARN|tcp:127.0.0.1:55944:
> connection dropped (Broken pipe)
> 2019-01-24T22:21:58.520Z|02630|timeval|WARN|Unreasonably long 1158ms poll
> interval (0ms user, 13ms system)
> 2019-01-24T22:21:58.552Z|02631|timeval|WARN|faults: 77 minor, 13 major
> 2019-01-24T22:21:58.552Z|02632|timeval|WARN|disk: 3656 reads, 0 writes
> 2019-01-24T22:21:58.552Z|02633|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T22:21:58.553Z|02634|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:22:02.567Z|02635|timeval|WARN|Unreasonably long 2691ms poll
> interval (0ms user, 20ms system)
> 2019-01-24T22:22:02.692Z|02636|timeval|WARN|faults: 122 minor, 19 major
> 2019-01-24T22:22:02.693Z|02637|timeval|WARN|disk: 4952 reads, 0 writes
> 2019-01-24T22:22:02.693Z|02638|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T22:25:42.468Z|02639|timeval|WARN|Unreasonably long 2407ms poll
> interval (0ms user, 3ms system)
> 2019-01-24T22:25:42.703Z|02640|timeval|WARN|faults: 11 minor, 7 major
> 2019-01-24T22:25:42.703Z|02641|timeval|WARN|disk: 1656 reads, 0 writes
> 2019-01-24T22:25:42.703Z|02642|timeval|WARN|context switches: 8 voluntary,
> 0 involuntary
> 2019-01-24T22:25:42.703Z|02643|coverage|INFO|Dropped 1 log messages in last
> 220 seconds (most recently, 220 seconds ago) due to excessive rate
> 2019-01-24T22:25:42.994Z|02644|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:25:46.286Z|02645|reconnect|ERR|tcp:127.0.0.1:55950: no
> response to inactivity probe after 6.36 seconds, disconnecting
> 2019-01-24T22:25:48.891Z|02646|timeval|WARN|Unreasonably long 5897ms poll
> interval (28ms user, 46ms system)
> 2019-01-24T22:25:48.891Z|02647|timeval|WARN|faults: 66 minor, 15 major
> 2019-01-24T22:25:48.891Z|02648|timeval|WARN|disk: 2776 reads, 8 writes
> 2019-01-24T22:25:48.891Z|02649|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T22:25:48.891Z|02650|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:25:57.943Z|02651|timeval|WARN|Unreasonably long 1650ms poll
> interval (347ms user, 329ms system)
> 2019-01-24T22:25:58.384Z|02652|timeval|WARN|faults: 6 minor, 3 major
> 2019-01-24T22:25:58.384Z|02653|timeval|WARN|disk: 488 reads, 0 writes
> 2019-01-24T22:25:58.384Z|02654|timeval|WARN|context switches: 2 voluntary,
> 2 involuntary
> 2019-01-24T22:25:58.384Z|02655|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:29:01.613Z|02656|timeval|WARN|Unreasonably long 8057ms poll
> interval (98ms user, 126ms system)
> 2019-01-24T22:29:01.727Z|02657|timeval|WARN|faults: 96 minor, 27 major
> 2019-01-24T22:29:01.727Z|02658|timeval|WARN|disk: 5288 reads, 0 writes
> 2019-01-24T22:29:01.727Z|02659|timeval|WARN|context switches: 30 voluntary,
> 3 involuntary
> 2019-01-24T22:29:01.727Z|02660|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:29:01.761Z|02661|jsonrpc|WARN|tcp:127.0.0.1:58590: receive
> error: Connection reset by peer
> 2019-01-24T22:29:01.761Z|02662|reconnect|WARN|tcp:127.0.0.1:58590:
> connection dropped (Connection reset by peer)
> 2019-01-24T22:32:09.364Z|02663|jsonrpc|WARN|tcp:127.0.0.1:60182: send
> error: Broken pipe
> 2019-01-24T22:32:10.809Z|02664|timeval|WARN|Unreasonably long 6621ms poll
> interval (0ms user, 10ms system)
> 2019-01-24T22:32:10.809Z|02665|timeval|WARN|faults: 104 minor, 18 major
> 2019-01-24T22:32:10.809Z|02666|timeval|WARN|disk: 4224 reads, 8 writes
> 2019-01-24T22:32:10.809Z|02667|timeval|WARN|context switches: 22 voluntary,
> 0 involuntary
> 2019-01-24T22:32:10.809Z|02668|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:32:10.810Z|02669|reconnect|WARN|tcp:127.0.0.1:60182:
> connection dropped (Broken pipe)
> 2019-01-24T22:35:01.597Z|02670|timeval|WARN|Unreasonably long 4124ms poll
> interval (4ms user, 19ms system)
> 2019-01-24T22:35:01.766Z|02671|timeval|WARN|faults: 108 minor, 21 major
> 2019-01-24T22:35:01.766Z|02672|timeval|WARN|disk: 5376 reads, 0 writes
> 2019-01-24T22:35:01.766Z|02673|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T22:35:02.120Z|02674|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:35:18.883Z|02675|timeval|WARN|Unreasonably long 6622ms poll
> interval (8ms user, 14ms system)
> 2019-01-24T22:35:21.260Z|02676|timeval|WARN|faults: 104 minor, 31 major
> 2019-01-24T22:35:21.788Z|02677|timeval|WARN|disk: 6656 reads, 0 writes
> 2019-01-24T22:35:21.788Z|02678|timeval|WARN|context switches: 41 voluntary,
> 0 involuntary
> 2019-01-24T22:35:22.202Z|02679|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:35:22.279Z|02680|reconnect|ERR|tcp:127.0.0.1:56474: no
> response to inactivity probe after 8.4 seconds, disconnecting
> 2019-01-24T22:35:22.279Z|02681|reconnect|ERR|tcp:127.0.0.1:56476: no
> response to inactivity probe after 8.41 seconds, disconnecting
> 2019-01-24T22:35:23.328Z|02682|timeval|WARN|Unreasonably long 1126ms poll
> interval (2ms user, 9ms system)
> 2019-01-24T22:35:23.328Z|02683|timeval|WARN|faults: 79 minor, 6 major
> 2019-01-24T22:35:23.328Z|02684|timeval|WARN|disk: 1784 reads, 0 writes
> 2019-01-24T22:35:23.328Z|02685|timeval|WARN|context switches: 7 voluntary,
> 0 involuntary
> 2019-01-24T22:35:23.328Z|02686|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:35:28.452Z|02687|timeval|WARN|Unreasonably long 1170ms poll
> interval (1ms user, 8ms system)
> 2019-01-24T22:35:28.463Z|02688|timeval|WARN|faults: 46 minor, 7 major
> 2019-01-24T22:35:28.463Z|02689|timeval|WARN|disk: 1776 reads, 0 writes
> 2019-01-24T22:35:28.463Z|02690|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T22:35:28.463Z|02691|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:38:35.993Z|02692|timeval|WARN|Unreasonably long 1384ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T22:38:36.011Z|02693|timeval|WARN|faults: 21 minor, 6 major
> 2019-01-24T22:38:36.011Z|02694|timeval|WARN|disk: 728 reads, 0 writes
> 2019-01-24T22:38:36.011Z|02695|timeval|WARN|context switches: 8 voluntary,
> 0 involuntary
> 2019-01-24T22:38:36.011Z|02696|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:39:24.642Z|02697|timeval|WARN|Unreasonably long 15923ms poll
> interval (1ms user, 21ms system)
> 2019-01-24T22:39:25.029Z|02698|timeval|WARN|faults: 129 minor, 50 major
> 2019-01-24T22:39:25.029Z|02699|timeval|WARN|disk: 10176 reads, 0 writes
> 2019-01-24T22:39:25.029Z|02700|timeval|WARN|context switches: 64 voluntary,
> 0 involuntary
> 2019-01-24T22:39:25.121Z|02701|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:39:25.572Z|02702|jsonrpc|WARN|tcp:127.0.0.1:34524: send
> error: Broken pipe
> 2019-01-24T22:39:25.573Z|02703|reconnect|ERR|tcp:127.0.0.1:36810: no
> response to inactivity probe after 7.6 seconds, disconnecting
> 2019-01-24T22:39:25.582Z|02704|reconnect|WARN|tcp:127.0.0.1:34524:
> connection dropped (Broken pipe)
> 2019-01-24T22:40:03.110Z|02705|timeval|WARN|Unreasonably long 4745ms poll
> interval (24ms user, 37ms system)
> 2019-01-24T22:40:03.534Z|02706|timeval|WARN|faults: 106 minor, 7 major
> 2019-01-24T22:40:03.534Z|02707|timeval|WARN|disk: 2352 reads, 0 writes
> 2019-01-24T22:40:03.534Z|02708|timeval|WARN|context switches: 10 voluntary,
> 1 involuntary
> 2019-01-24T22:40:03.534Z|02709|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:42:07.399Z|02710|timeval|WARN|Unreasonably long 1482ms poll
> interval (2ms user, 3ms system)
> 2019-01-24T22:42:07.703Z|02711|timeval|WARN|faults: 54 minor, 8 major
> 2019-01-24T22:42:07.704Z|02712|timeval|WARN|disk: 1696 reads, 0 writes
> 2019-01-24T22:42:07.704Z|02713|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T22:42:07.704Z|02714|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:42:15.375Z|02715|timeval|WARN|Unreasonably long 1013ms poll
> interval (103ms user, 102ms system)
> 2019-01-24T22:42:15.618Z|02716|timeval|WARN|faults: 13 minor, 3 major
> 2019-01-24T22:42:15.618Z|02717|timeval|WARN|disk: 472 reads, 0 writes
> 2019-01-24T22:42:15.618Z|02718|timeval|WARN|context switches: 3 voluntary,
> 1 involuntary
> 2019-01-24T22:42:15.618Z|02719|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:42:59.467Z|02720|timeval|WARN|Unreasonably long 4143ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T22:42:59.488Z|02721|timeval|WARN|faults: 103 minor, 18 major
> 2019-01-24T22:42:59.488Z|02722|timeval|WARN|disk: 4304 reads, 0 writes
> 2019-01-24T22:42:59.488Z|02723|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T22:42:59.579Z|02724|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:44:59.953Z|02725|timeval|WARN|Unreasonably long 5671ms poll
> interval (2ms user, 12ms system)
> 2019-01-24T22:45:00.463Z|02726|timeval|WARN|faults: 130 minor, 24 major
> 2019-01-24T22:45:00.463Z|02727|timeval|WARN|disk: 5544 reads, 0 writes
> 2019-01-24T22:45:00.463Z|02728|timeval|WARN|context switches: 30 voluntary,
> 0 involuntary
> 2019-01-24T22:45:00.463Z|02729|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:47:37.114Z|02730|timeval|WARN|Unreasonably long 1170ms poll
> interval (0ms user, 32ms system)
> 2019-01-24T22:47:37.182Z|02731|timeval|WARN|context switches: 0 voluntary,
> 2 involuntary
> 2019-01-24T22:47:37.431Z|02732|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:51:13.899Z|02733|reconnect|ERR|tcp:127.0.0.1:38912: no
> response to inactivity probe after 21 seconds, disconnecting
> 2019-01-24T22:51:15.435Z|02734|timeval|WARN|Unreasonably long 21101ms poll
> interval (5ms user, 25ms system)
> 2019-01-24T22:51:15.435Z|02735|timeval|WARN|faults: 151 minor, 58 major
> 2019-01-24T22:51:15.435Z|02736|timeval|WARN|disk: 12656 reads, 8 writes
> 2019-01-24T22:51:15.435Z|02737|timeval|WARN|context switches: 92 voluntary,
> 0 involuntary
> 2019-01-24T22:51:15.435Z|02738|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:51:24.076Z|02739|reconnect|ERR|tcp:127.0.0.1:44742: no
> response to inactivity probe after 5 seconds, disconnecting
> 2019-01-24T22:52:06.922Z|02740|timeval|WARN|Unreasonably long 2158ms poll
> interval (0ms user, 8ms system)
> 2019-01-24T22:52:07.286Z|02741|timeval|WARN|faults: 46 minor, 13 major
> 2019-01-24T22:52:07.286Z|02742|timeval|WARN|disk: 2752 reads, 0 writes
> 2019-01-24T22:52:07.286Z|02743|timeval|WARN|context switches: 16 voluntary,
> 0 involuntary
> 2019-01-24T22:52:08.143Z|02744|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:52:10.301Z|02745|timeval|WARN|Unreasonably long 2141ms poll
> interval (1ms user, 5ms system)
> 2019-01-24T22:52:11.337Z|02746|timeval|WARN|faults: 53 minor, 9 major
> 2019-01-24T22:52:11.337Z|02747|timeval|WARN|disk: 2416 reads, 0 writes
> 2019-01-24T22:52:11.337Z|02748|timeval|WARN|context switches: 14 voluntary,
> 0 involuntary
> 2019-01-24T22:52:12.139Z|02749|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:52:15.413Z|02750|timeval|WARN|Unreasonably long 2956ms poll
> interval (0ms user, 11ms system)
> 2019-01-24T22:52:15.480Z|02751|timeval|WARN|faults: 65 minor, 18 major
> 2019-01-24T22:52:15.480Z|02752|timeval|WARN|disk: 3248 reads, 0 writes
> 2019-01-24T22:52:15.480Z|02753|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T22:52:15.682Z|02754|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:52:24.622Z|02755|timeval|WARN|Unreasonably long 4153ms poll
> interval (5ms user, 7ms system)
> 2019-01-24T22:52:24.887Z|02756|timeval|WARN|faults: 103 minor, 16 major
> 2019-01-24T22:52:24.887Z|02757|timeval|WARN|disk: 3648 reads, 0 writes
> 2019-01-24T22:52:24.888Z|02758|timeval|WARN|context switches: 20 voluntary,
> 0 involuntary
> 2019-01-24T22:55:12.886Z|02759|timeval|WARN|Unreasonably long 5318ms poll
> interval (0ms user, 14ms system)
> 2019-01-24T22:55:12.952Z|02760|timeval|WARN|faults: 99 minor, 16 major
> 2019-01-24T22:55:12.952Z|02761|timeval|WARN|disk: 4224 reads, 0 writes
> 2019-01-24T22:55:12.952Z|02762|timeval|WARN|context switches: 24 voluntary,
> 0 involuntary
> 2019-01-24T22:55:12.952Z|02763|coverage|INFO|Dropped 1 log messages in last
> 168 seconds (most recently, 168 seconds ago) due to excessive rate
> 2019-01-24T22:55:12.977Z|02764|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:57:22.345Z|02765|jsonrpc|WARN|tcp:127.0.0.1:46372: send
> error: Broken pipe
> 2019-01-24T22:57:23.500Z|02766|timeval|WARN|Unreasonably long 8913ms poll
> interval (279ms user, 268ms system)
> 2019-01-24T22:57:23.500Z|02767|timeval|WARN|faults: 29 minor, 12 major
> 2019-01-24T22:57:23.500Z|02768|timeval|WARN|disk: 2264 reads, 8 writes
> 2019-01-24T22:57:23.500Z|02769|timeval|WARN|context switches: 15 voluntary,
> 0 involuntary
> 2019-01-24T22:57:23.500Z|02770|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:57:23.502Z|02771|reconnect|ERR|tcp:127.0.0.1:39458: no
> response to inactivity probe after 8.91 seconds, disconnecting
> 2019-01-24T22:57:23.502Z|02772|reconnect|WARN|tcp:127.0.0.1:46372:
> connection dropped (Broken pipe)
> 2019-01-24T22:57:45.157Z|02773|timeval|WARN|Unreasonably long 6346ms poll
> interval (0ms user, 18ms system)
> 2019-01-24T22:57:46.016Z|02774|timeval|WARN|faults: 139 minor, 31 major
> 2019-01-24T22:57:46.016Z|02775|timeval|WARN|disk: 7016 reads, 0 writes
> 2019-01-24T22:57:46.016Z|02776|timeval|WARN|context switches: 39 voluntary,
> 0 involuntary
> 2019-01-24T22:57:46.454Z|02777|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:59:08.123Z|02778|timeval|WARN|Unreasonably long 1054ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T22:59:08.377Z|02779|timeval|WARN|faults: 76 minor, 7 major
> 2019-01-24T22:59:08.377Z|02780|timeval|WARN|disk: 2352 reads, 0 writes
> 2019-01-24T22:59:08.377Z|02781|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T22:59:08.377Z|02782|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T22:59:14.056Z|02783|timeval|WARN|Unreasonably long 1202ms poll
> interval (0ms user, 3ms system)
> 2019-01-24T22:59:14.210Z|02784|timeval|WARN|faults: 63 minor, 8 major
> 2019-01-24T22:59:14.211Z|02785|timeval|WARN|disk: 2384 reads, 0 writes
> 2019-01-24T22:59:14.211Z|02786|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T22:59:14.211Z|02787|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:00:34.699Z|02788|jsonrpc|WARN|tcp:127.0.0.1:48476: send
> error: Broken pipe
> 2019-01-24T23:00:35.141Z|02789|timeval|WARN|Unreasonably long 16006ms poll
> interval (10ms user, 21ms system)
> 2019-01-24T23:00:35.141Z|02790|timeval|WARN|faults: 138 minor, 53 major
> 2019-01-24T23:00:35.141Z|02791|timeval|WARN|disk: 12648 reads, 8 writes
> 2019-01-24T23:00:35.141Z|02792|timeval|WARN|context switches: 60 voluntary,
> 0 involuntary
> 2019-01-24T23:00:35.142Z|02793|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:00:35.142Z|02794|reconnect|WARN|tcp:127.0.0.1:48476:
> connection dropped (Broken pipe)
> 2019-01-24T23:01:03.784Z|02795|timeval|WARN|Unreasonably long 1226ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T23:01:03.881Z|02796|timeval|WARN|faults: 22 minor, 9 major
> 2019-01-24T23:01:03.881Z|02797|timeval|WARN|disk: 2216 reads, 0 writes
> 2019-01-24T23:01:03.881Z|02798|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T23:01:03.895Z|02799|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:01:28.431Z|02800|jsonrpc|WARN|tcp:127.0.0.1:50042: send
> error: Broken pipe
> 2019-01-24T23:01:29.287Z|02801|timeval|WARN|Unreasonably long 18832ms poll
> interval (12ms user, 18ms system)
> 2019-01-24T23:01:29.287Z|02802|timeval|WARN|faults: 158 minor, 58 major
> 2019-01-24T23:01:29.287Z|02803|timeval|WARN|disk: 13744 reads, 8 writes
> 2019-01-24T23:01:29.287Z|02804|timeval|WARN|context switches: 67 voluntary,
> 0 involuntary
> 2019-01-24T23:01:29.287Z|02805|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:01:29.287Z|02806|reconnect|WARN|tcp:127.0.0.1:50042:
> connection dropped (Broken pipe)
> 2019-01-24T23:01:29.287Z|02807|jsonrpc|WARN|tcp:127.0.0.1:50058: send
> error: Connection reset by peer
> 2019-01-24T23:01:29.287Z|02808|reconnect|WARN|tcp:127.0.0.1:50058:
> connection dropped (Connection reset by peer)
> 2019-01-24T23:02:05.311Z|02809|jsonrpc|WARN|tcp:127.0.0.1:50572: send
> error: Broken pipe
> 2019-01-24T23:02:09.118Z|02810|timeval|WARN|Unreasonably long 35684ms poll
> interval (17ms user, 27ms system)
> 2019-01-24T23:02:09.118Z|02811|timeval|WARN|faults: 148 minor, 90 major
> 2019-01-24T23:02:09.118Z|02812|timeval|WARN|disk: 19536 reads, 8 writes
> 2019-01-24T23:02:09.118Z|02813|timeval|WARN|context switches: 119
> voluntary, 0 involuntary
> 2019-01-24T23:02:09.118Z|02814|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:02:09.118Z|02815|reconnect|WARN|tcp:127.0.0.1:50572:
> connection dropped (Broken pipe)
> 2019-01-24T23:02:09.118Z|02816|jsonrpc|WARN|tcp:127.0.0.1:50574: send
> error: Broken pipe
> 2019-01-24T23:02:09.122Z|02817|reconnect|WARN|tcp:127.0.0.1:50574:
> connection dropped (Broken pipe)
> 2019-01-24T23:05:46.996Z|02818|timeval|WARN|Unreasonably long 1242ms poll
> interval (2ms user, 5ms system)
> 2019-01-24T23:05:47.019Z|02819|timeval|WARN|faults: 76 minor, 9 major
> 2019-01-24T23:05:47.019Z|02820|timeval|WARN|disk: 2456 reads, 0 writes
> 2019-01-24T23:05:47.019Z|02821|timeval|WARN|context switches: 12 voluntary,
> 0 involuntary
> 2019-01-24T23:05:47.019Z|02822|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:06:12.709Z|02823|timeval|WARN|Unreasonably long 1045ms poll
> interval (2ms user, 3ms system)
> 2019-01-24T23:06:13.099Z|02824|timeval|WARN|faults: 36 minor, 4 major
> 2019-01-24T23:06:13.099Z|02825|timeval|WARN|disk: 1024 reads, 0 writes
> 2019-01-24T23:06:13.099Z|02826|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T23:06:13.099Z|02827|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:06:16.797Z|02828|timeval|WARN|Unreasonably long 1387ms poll
> interval (2ms user, 1ms system)
> 2019-01-24T23:06:16.818Z|02829|timeval|WARN|faults: 31 minor, 5 major
> 2019-01-24T23:06:16.818Z|02830|timeval|WARN|disk: 1376 reads, 0 writes
> 2019-01-24T23:06:16.818Z|02831|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T23:06:16.978Z|02832|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:07:09.973Z|02833|timeval|WARN|Unreasonably long 1380ms poll
> interval (2ms user, 5ms system)
> 2019-01-24T23:07:09.998Z|02834|timeval|WARN|faults: 37 minor, 9 major
> 2019-01-24T23:07:09.998Z|02835|timeval|WARN|disk: 1120 reads, 0 writes
> 2019-01-24T23:07:09.998Z|02836|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T23:07:09.998Z|02837|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:09:18.323Z|02838|timeval|WARN|Unreasonably long 2720ms poll
> interval (0ms user, 7ms system)
> 2019-01-24T23:09:18.366Z|02839|timeval|WARN|faults: 97 minor, 15 major
> 2019-01-24T23:09:18.366Z|02840|timeval|WARN|disk: 3800 reads, 0 writes
> 2019-01-24T23:09:18.366Z|02841|timeval|WARN|context switches: 18 voluntary,
> 0 involuntary
> 2019-01-24T23:09:18.367Z|02842|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:10:38.738Z|02843|timeval|WARN|Unreasonably long 3913ms poll
> interval (2ms user, 11ms system)
> 2019-01-24T23:10:38.779Z|02844|timeval|WARN|faults: 105 minor, 16 major
> 2019-01-24T23:10:38.779Z|02845|timeval|WARN|disk: 4272 reads, 0 writes
> 2019-01-24T23:10:38.779Z|02846|timeval|WARN|context switches: 19 voluntary,
> 0 involuntary
> 2019-01-24T23:10:38.779Z|02847|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:11:29.447Z|02848|timeval|WARN|Unreasonably long 1984ms poll
> interval (1ms user, 8ms system)
> 2019-01-24T23:11:29.468Z|02849|timeval|WARN|faults: 65 minor, 15 major
> 2019-01-24T23:11:29.469Z|02850|timeval|WARN|disk: 4128 reads, 0 writes
> 2019-01-24T23:11:29.469Z|02851|timeval|WARN|context switches: 21 voluntary,
> 0 involuntary
> 2019-01-24T23:11:29.469Z|02852|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:15:08.161Z|02853|timeval|WARN|Unreasonably long 6272ms poll
> interval (1ms user, 13ms system)
> 2019-01-24T23:15:08.245Z|02854|timeval|WARN|faults: 44 minor, 28 major
> 2019-01-24T23:15:08.245Z|02855|timeval|WARN|disk: 5888 reads, 0 writes
> 2019-01-24T23:15:08.245Z|02856|timeval|WARN|context switches: 34 voluntary,
> 0 involuntary
> 2019-01-24T23:15:08.245Z|02857|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:15:23.834Z|02858|timeval|WARN|Unreasonably long 5510ms poll
> interval (3ms user, 15ms system)
> 2019-01-24T23:15:25.833Z|02859|timeval|WARN|faults: 75 minor, 28 major
> 2019-01-24T23:15:26.701Z|02860|timeval|WARN|disk: 5744 reads, 0 writes
> 2019-01-24T23:15:26.701Z|02861|timeval|WARN|context switches: 34 voluntary,
> 0 involuntary
> 2019-01-24T23:15:27.456Z|02862|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:15:28.656Z|02863|reconnect|ERR|tcp:127.0.0.1:36812: no
> response to inactivity probe after 7.66 seconds, disconnecting
> 2019-01-24T23:15:28.656Z|02864|reconnect|ERR|tcp:127.0.0.1:48486: no
> response to inactivity probe after 7.66 seconds, disconnecting
> 2019-01-24T23:15:34.636Z|02865|timeval|WARN|Unreasonably long 5556ms poll
> interval (3ms user, 12ms system)
> 2019-01-24T23:15:39.143Z|02866|timeval|WARN|faults: 73 minor, 22 major
> 2019-01-24T23:15:39.143Z|02867|timeval|WARN|disk: 4536 reads, 8 writes
> 2019-01-24T23:15:39.143Z|02868|timeval|WARN|context switches: 30 voluntary,
> 0 involuntary
> 2019-01-24T23:15:39.622Z|02869|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:17:10.144Z|02870|jsonrpc|WARN|tcp:127.0.0.1:50582: send
> error: Broken pipe
> 2019-01-24T23:17:12.272Z|02871|timeval|WARN|Unreasonably long 14181ms poll
> interval (6ms user, 13ms system)
> 2019-01-24T23:17:12.272Z|02872|timeval|WARN|faults: 103 minor, 30 major
> 2019-01-24T23:17:12.272Z|02873|timeval|WARN|disk: 7000 reads, 8 writes
> 2019-01-24T23:17:12.272Z|02874|timeval|WARN|context switches: 36 voluntary,
> 0 involuntary
> 2019-01-24T23:17:12.273Z|02875|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:17:12.273Z|02876|reconnect|WARN|tcp:127.0.0.1:50582:
> connection dropped (Broken pipe)
> 2019-01-24T23:22:26.064Z|02877|timeval|WARN|Unreasonably long 2460ms poll
> interval (1ms user, 2ms system)
> 2019-01-24T23:22:26.442Z|02878|timeval|WARN|faults: 58 minor, 6 major
> 2019-01-24T23:22:26.442Z|02879|timeval|WARN|disk: 1688 reads, 0 writes
> 2019-01-24T23:22:26.442Z|02880|timeval|WARN|context switches: 11 voluntary,
> 0 involuntary
> 2019-01-24T23:22:26.565Z|02881|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:22:37.922Z|02882|timeval|WARN|Unreasonably long 4917ms poll
> interval (2ms user, 3ms system)
> 2019-01-24T23:22:39.159Z|02883|timeval|WARN|faults: 91 minor, 18 major
> 2019-01-24T23:22:39.159Z|02884|timeval|WARN|disk: 4176 reads, 0 writes
> 2019-01-24T23:22:39.159Z|02885|timeval|WARN|context switches: 23 voluntary,
> 0 involuntary
> 2019-01-24T23:22:39.273Z|02886|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:22:42.957Z|02887|timeval|WARN|Unreasonably long 3684ms poll
> interval (3ms user, 3ms system)
> 2019-01-24T23:22:42.957Z|02888|timeval|WARN|faults: 74 minor, 7 major
> 2019-01-24T23:22:42.957Z|02889|timeval|WARN|disk: 2440 reads, 0 writes
> 2019-01-24T23:22:42.957Z|02890|timeval|WARN|context switches: 9 voluntary,
> 0 involuntary
> 2019-01-24T23:22:42.957Z|02891|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:22:53.531Z|02892|timeval|WARN|Unreasonably long 4310ms poll
> interval (6ms user, 4ms system)
> 2019-01-24T23:22:53.884Z|02893|timeval|WARN|faults: 96 minor, 27 major
> 2019-01-24T23:22:53.884Z|02894|timeval|WARN|disk: 5736 reads, 0 writes
> 2019-01-24T23:22:53.884Z|02895|timeval|WARN|context switches: 33 voluntary,
> 0 involuntary
> 2019-01-24T23:22:58.054Z|02896|timeval|WARN|Unreasonably long 1578ms poll
> interval (0ms user, 3ms system)
> 2019-01-24T23:22:58.124Z|02897|timeval|WARN|faults: 30 minor, 8 major
> 2019-01-24T23:22:58.124Z|02898|timeval|WARN|disk: 1416 reads, 0 writes
> 2019-01-24T23:22:58.124Z|02899|timeval|WARN|context switches: 8 voluntary,
> 0 involuntary
> 2019-01-24T23:23:23.495Z|02900|timeval|WARN|Unreasonably long 9553ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T23:23:23.545Z|02901|timeval|WARN|faults: 33 minor, 11 major
> 2019-01-24T23:23:23.546Z|02902|timeval|WARN|disk: 2272 reads, 0 writes
> 2019-01-24T23:23:23.546Z|02903|timeval|WARN|context switches: 13 voluntary,
> 0 involuntary
> 2019-01-24T23:23:39.219Z|02904|timeval|WARN|Unreasonably long 1022ms poll
> interval (0ms user, 1ms system)
> 2019-01-24T23:23:39.420Z|02905|timeval|WARN|faults: 8 minor, 2 major
> 2019-01-24T23:23:39.420Z|02906|timeval|WARN|disk: 192 reads, 0 writes
> 2019-01-24T23:23:39.420Z|02907|timeval|WARN|context switches: 2 voluntary,
> 0 involuntary
> 2019-01-24T23:23:39.420Z|02908|coverage|INFO|Dropped 3 log messages in last
> 45 seconds (most recently, 16 seconds ago) due to excessive rate
> 2019-01-24T23:23:39.420Z|02909|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:23:52.223Z|02910|timeval|WARN|Unreasonably long 2542ms poll
> interval (0ms user, 2ms system)
> 2019-01-24T23:23:53.701Z|02911|timeval|WARN|faults: 0 minor, 2 major
> 2019-01-24T23:23:53.701Z|02912|timeval|WARN|disk: 264 reads, 16 writes
> 2019-01-24T23:23:53.701Z|02913|timeval|WARN|context switches: 2 voluntary,
> 0 involuntary
> 2019-01-24T23:24:06.370Z|02914|timeval|WARN|Unreasonably long 2271ms poll
> interval (2ms user, 4ms system)
> 2019-01-24T23:24:06.486Z|02915|timeval|WARN|faults: 12 minor, 7 major
> 2019-01-24T23:24:06.486Z|02916|timeval|WARN|disk: 712 reads, 0 writes
> 2019-01-24T23:24:06.486Z|02917|timeval|WARN|context switches: 8 voluntary,
> 0 involuntary
> 2019-01-24T23:24:32.738Z|02918|jsonrpc|WARN|tcp:127.0.0.1:34242: send
> error: Broken pipe
> 2019-01-24T23:24:44.360Z|02919|timeval|WARN|Unreasonably long 20428ms poll
> interval (122ms user, 102ms system)
> 2019-01-24T23:24:44.490Z|02920|timeval|WARN|faults: 163 minor, 38 major
> 2019-01-24T23:24:44.490Z|02921|timeval|WARN|disk: 6376 reads, 8 writes
> 2019-01-24T23:24:44.490Z|02922|timeval|WARN|context switches: 55 voluntary,
> 1 involuntary
> 2019-01-24T23:24:44.490Z|02923|coverage|INFO|Dropped 2 log messages in last
> 51 seconds (most recently, 38 seconds ago) due to excessive rate
> 2019-01-24T23:24:47.554Z|02924|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:24:54.159Z|02925|reconnect|WARN|tcp:127.0.0.1:34242:
> connection dropped (Broken pipe)
> 2019-01-24T23:24:54.242Z|02926|jsonrpc|WARN|tcp:127.0.0.1:34780: send
> error: Connection reset by peer
> 2019-01-24T23:24:56.343Z|02927|timeval|WARN|Unreasonably long 8317ms poll
> interval (10ms user, 15ms system)
> 2019-01-24T23:24:56.343Z|02928|timeval|WARN|faults: 99 minor, 20 major
> 2019-01-24T23:24:56.343Z|02929|timeval|WARN|disk: 4440 reads, 8 writes
> 2019-01-24T23:24:56.343Z|02930|timeval|WARN|context switches: 32 voluntary,
> 0 involuntary
> 2019-01-24T23:24:56.343Z|02931|reconnect|WARN|tcp:127.0.0.1:34780:
> connection dropped (Connection reset by peer)
> 2019-01-24T23:24:56.343Z|02932|jsonrpc|WARN|tcp:127.0.0.1:34784: send
> error: Broken pipe
> 2019-01-24T23:24:56.343Z|02933|reconnect|WARN|tcp:127.0.0.1:34784:
> connection dropped (Broken pipe)
> 2019-01-24T23:25:27.604Z|02934|timeval|WARN|Unreasonably long 1750ms poll
> interval (2ms user, 0ms system)
> 2019-01-24T23:25:27.868Z|02935|timeval|WARN|faults: 14 minor, 5 major
> 2019-01-24T23:25:27.868Z|02936|timeval|WARN|disk: 584 reads, 0 writes
> 2019-01-24T23:25:27.868Z|02937|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T23:25:27.868Z|02938|coverage|INFO|Dropped 1 log messages in last
> 32 seconds (most recently, 32 seconds ago) due to excessive rate
> 2019-01-24T23:25:27.868Z|02939|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:26:06.362Z|02940|jsonrpc|WARN|tcp:127.0.0.1:34790: send
> error: Broken pipe
> 2019-01-24T23:26:09.014Z|02941|timeval|WARN|Unreasonably long 21933ms poll
> interval (24ms user, 6ms system)
> 2019-01-24T23:26:09.014Z|02942|timeval|WARN|faults: 138 minor, 29 major
> 2019-01-24T23:26:09.014Z|02943|timeval|WARN|disk: 5920 reads, 8 writes
> 2019-01-24T23:26:09.014Z|02944|timeval|WARN|context switches: 67 voluntary,
> 0 involuntary
> 2019-01-24T23:26:09.789Z|02945|reconnect|WARN|tcp:127.0.0.1:34790:
> connection dropped (Broken pipe)
> 2019-01-24T23:26:09.790Z|02946|jsonrpc|WARN|tcp:127.0.0.1:35358: send
> error: Broken pipe
> 2019-01-24T23:26:09.797Z|02947|reconnect|WARN|tcp:127.0.0.1:35358:
> connection dropped (Broken pipe)
> 2019-01-24T23:26:43.785Z|02948|jsonrpc|WARN|tcp:127.0.0.1:35376: send
> error: Broken pipe
> 2019-01-24T23:26:47.140Z|02949|timeval|WARN|Unreasonably long 16705ms poll
> interval (66ms user, 79ms system)
> 2019-01-24T23:26:47.720Z|02950|timeval|WARN|faults: 121 minor, 25 major
> 2019-01-24T23:26:47.720Z|02951|timeval|WARN|disk: 4632 reads, 8 writes
> 2019-01-24T23:26:47.720Z|02952|timeval|WARN|context switches: 39 voluntary,
> 0 involuntary
> 2019-01-24T23:26:47.720Z|02953|coverage|INFO|Dropped 1 log messages in last
> 38 seconds (most recently, 38 seconds ago) due to excessive rate
> 2019-01-24T23:26:47.950Z|02954|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:26:49.966Z|02955|reconnect|WARN|tcp:127.0.0.1:35376:
> connection dropped (Broken pipe)
> 2019-01-24T23:26:49.967Z|02956|timeval|WARN|Unreasonably long 2017ms poll
> interval (3ms user, 1ms system)
> 2019-01-24T23:26:49.967Z|02957|timeval|WARN|faults: 20 minor, 5 major
> 2019-01-24T23:26:49.967Z|02958|timeval|WARN|disk: 456 reads, 8 writes
> 2019-01-24T23:26:49.967Z|02959|timeval|WARN|context switches: 6 voluntary,
> 0 involuntary
> 2019-01-24T23:29:43.719Z|02960|timeval|WARN|Unreasonably long 22346ms poll
> interval (10ms user, 30ms system)
> 2019-01-24T23:29:44.553Z|02961|timeval|WARN|faults: 61 minor, 32 major
> 2019-01-24T23:29:44.553Z|02962|timeval|WARN|disk: 6136 reads, 0 writes
> 2019-01-24T23:29:44.553Z|02963|timeval|WARN|context switches: 79 voluntary,
> 0 involuntary
> 2019-01-24T23:29:44.553Z|02964|coverage|INFO|Dropped 1 log messages in last
> 174 seconds (most recently, 174 seconds ago) due to excessive rate
> 2019-01-24T23:29:44.553Z|02965|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:30:21.410Z|02966|reconnect|ERR|tcp:127.0.0.1:35926: no
> response to inactivity probe after 5 seconds, disconnecting
> 2019-01-24T23:30:45.039Z|02967|reconnect|ERR|tcp:127.0.0.1:38084: no
> response to inactivity probe after 5.16 seconds, disconnecting
> 2019-01-24T23:30:45.128Z|02968|timeval|WARN|Unreasonably long 3817ms poll
> interval (0ms user, 26ms system)
> 2019-01-24T23:30:45.128Z|02969|timeval|WARN|faults: 1 minor, 1 major
> 2019-01-24T23:30:45.128Z|02970|timeval|WARN|disk: 112 reads, 8 writes
> 2019-01-24T23:30:45.128Z|02971|timeval|WARN|context switches: 6 voluntary,
> 1 involuntary
> 2019-01-24T23:30:47.954Z|02972|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:31:27.996Z|02973|timeval|WARN|Unreasonably long 1562ms poll
> interval (0ms user, 5ms system)
> 2019-01-24T23:31:28.047Z|02974|timeval|WARN|faults: 13 minor, 2 major
> 2019-01-24T23:31:28.047Z|02975|timeval|WARN|disk: 608 reads, 0 writes
> 2019-01-24T23:31:28.047Z|02976|timeval|WARN|context switches: 4 voluntary,
> 0 involuntary
> 2019-01-24T23:31:28.432Z|02977|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:31:39.195Z|02978|timeval|WARN|Unreasonably long 1455ms poll
> interval (0ms user, 15ms system)
> 2019-01-24T23:31:40.146Z|02979|timeval|WARN|faults: 5 minor, 4 major
> 2019-01-24T23:31:40.146Z|02980|timeval|WARN|disk: 600 reads, 0 writes
> 2019-01-24T23:31:40.146Z|02981|timeval|WARN|context switches: 5 voluntary,
> 0 involuntary
> 2019-01-24T23:31:40.146Z|02982|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:31:56.885Z|02983|reconnect|ERR|tcp:127.0.0.1:38682: no
> response to inactivity probe after 5 seconds, disconnecting
> 2019-01-24T23:31:57.216Z|02984|timeval|WARN|Unreasonably long 1681ms poll
> interval (1ms user, 1ms system)
> 2019-01-24T23:31:57.216Z|02985|timeval|WARN|faults: 1 minor, 2 major
> 2019-01-24T23:31:57.216Z|02986|timeval|WARN|disk: 304 reads, 8 writes
> 2019-01-24T23:31:57.216Z|02987|timeval|WARN|context switches: 3 voluntary,
> 0 involuntary
> 2019-01-24T23:31:57.390Z|02988|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:35:23.537Z|02989|timeval|WARN|Unreasonably long 1164ms poll
> interval (2ms user, 1ms system)
> 2019-01-24T23:35:24.534Z|02990|timeval|WARN|faults: 1 minor, 2 major
> 2019-01-24T23:35:24.534Z|02991|timeval|WARN|disk: 296 reads, 0 writes
> 2019-01-24T23:35:24.534Z|02992|timeval|WARN|context switches: 2 voluntary,
> 0 involuntary
> 2019-01-24T23:35:24.534Z|02993|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:37:17.268Z|02994|timeval|WARN|Unreasonably long 1187ms poll
> interval (3ms user, 0ms system)
> 2019-01-24T23:37:17.398Z|02995|timeval|WARN|faults: 0 minor, 2 major
> 2019-01-24T23:37:17.398Z|02996|timeval|WARN|disk: 288 reads, 0 writes
> 2019-01-24T23:37:17.398Z|02997|timeval|WARN|context switches: 2 voluntary,
> 0 involuntary
> 2019-01-24T23:37:17.398Z|02998|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:37:58.170Z|02999|timeval|WARN|Unreasonably long 1373ms poll
> interval (0ms user, 1ms system)
> 2019-01-24T23:37:58.209Z|03000|timeval|WARN|faults: 6 minor, 3 major
> 2019-01-24T23:37:58.209Z|03001|timeval|WARN|disk: 448 reads, 0 writes
> 2019-01-24T23:37:58.209Z|03002|timeval|WARN|context switches: 4 voluntary,
> 0 involuntary
> 2019-01-24T23:37:58.373Z|03003|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:57:18.905Z|03004|reconnect|ERR|tcp:127.0.0.1:42086: no
> response to inactivity probe after 5.2 seconds, disconnecting
> 2019-01-24T23:57:19.298Z|03005|timeval|WARN|Unreasonably long 1376ms poll
> interval (3ms user, 3ms system)
> 2019-01-24T23:57:19.298Z|03006|timeval|WARN|faults: 2 minor, 2 major
> 2019-01-24T23:57:19.298Z|03007|timeval|WARN|disk: 296 reads, 8 writes
> 2019-01-24T23:57:19.298Z|03008|timeval|WARN|context switches: 3 voluntary,
> 0 involuntary
> 2019-01-24T23:57:19.792Z|03009|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:59:21.277Z|03010|timeval|WARN|Unreasonably long 1066ms poll
> interval (1ms user, 11ms system)
> 2019-01-24T23:59:21.422Z|03011|timeval|WARN|faults: 35 minor, 9 major
> 2019-01-24T23:59:21.422Z|03012|timeval|WARN|disk: 912 reads, 0 writes
> 2019-01-24T23:59:21.422Z|03013|timeval|WARN|context switches: 10 voluntary,
> 0 involuntary
> 2019-01-24T23:59:21.422Z|03014|coverage|INFO|Skipping details of duplicate
> event coverage for hash=590b645d
> 2019-01-24T23:59:30.652Z|03015|reconnect|ERR|tcp:127.0.0.1:54120: no
> response to inactivity probe after 5 seconds, disconnecting
> [root at localhost openvswitch]#
> 
> well it's all for the 24th of jan 2019 ... I think I refreshed the VM
> (copied it again to the same folder because after the failure I had trouble
> booting)
> 
> anyway .. the thing is if it affects CPU with this captured watchdog event
> log, does this mean that it has no fault-tolerance Mechanism for
> diconnectivity ... I mean ... like fail over core switches do .. one fails
> the other operates .. not even send to loopback .. instead of Utilizting
> the CPU ..
> 
> Best regards
> Amer Hwitat
> 
> On Fri, Jan 25, 2019 at 3:06 AM Ben Pfaff <blp at ovn.org> wrote:
> 
> > On Fri, Jan 25, 2019 at 02:01:54AM +0300, Amer Hwitat wrote:
> > > Hi,
> > >
> > > I have the following issue:
> > >
> > > [root at localhost neutron]# systemctl status network
> > > ● network.service - LSB: Bring up/down networking
> > >    Loaded: loaded (/etc/rc.d/init.d/network; bad; vendor preset:
> > disabled)
> > >    Active: active (exited) since Tue 2019-01-22 09:13:04 EST; 58min ago
> > >      Docs: man:systemd-sysv-generator(8)
> > >   Process: 10275 ExecStart=/etc/rc.d/init.d/network start (code=exited,
> > > status=0/SUCCESS)
> > >     Tasks: 0
> > >
> > > Jan 22 09:12:58 localhost.localdomain systemd[1]: Starting LSB: Bring
> > > up/down networking...
> > > Jan 22 09:12:59 localhost.localdomain network[10275]: Bringing up
> > loopback
> > > interface:  [  OK  ]
> > > Jan 22 09:12:59 localhost.localdomain ovs-vsctl[10407]:
> > > ovs|00001|vsctl|INFO|Called as ovs-vsctl -t 10 -- --may-exist add-br
> > br-ex
> > > Jan 22 09:13:04 localhost.localdomain network[10275]: Bringing up
> > interface
> > > br-ex:  [  OK  ]
> > > Jan 22 09:13:04 localhost.localdomain ovs-vsctl[10573]:
> > > ovs|00001|vsctl|INFO|Called as ovs-vsctl -t 10 -- --if-exists del-port
> > > br-ex eno16777736 -- add-port...o16777736
> > > Jan 22 09:13:04 localhost.localdomain network[10275]: Bringing up
> > interface
> > > eno16777736:  [  OK  ]
> > > Jan 22 09:13:04 localhost.localdomain systemd[1]: Started LSB: Bring
> > > up/down networking.
> > > Hint: Some lines were ellipsized, use -l to show in full.
> > > [root at localhost neutron]#
> > >
> > > casue by this configuration of eno16777736 interface on a VM:
> > > settings:
> > >
> > > HWADDR=00:0C:29:37:19:1F
> > > TYPE=OVSBridge
> > > DEVICE=br-ex
> > > DEVICETYPE=ovs
> > > DEFROUTE=yes
> > > IPV4_FAILURE_FATAL=no
> > > UUID=c0addf73-98fe-464c-804a-b40110fd6157
> > > ONBOOT=yes
> > > IPADDR=192.168.43.110
> > > PREFIX=24
> > > GATEWAY=192.168.43.1
> > > DNS=192.168.43.1
> > > BOOTPROTO=static
> > > NM_CONTROLLED=no
> > > IPV4_FAILURE_FATAL=no
> > > IPV6INIT=yes
> > > IPV6_AUTOCONF=yes
> > > IPV6_DEFROUTE=yes
> > > IPV6_FAILURE_FATAL=no
> > > PROXY_METHOD=none
> > > BROWSER_ONLY=no
> > >
> > > HWADDR=00:0C:29:37:19:1F
> > > TYPE=OVSPort
> > > DEVICE=eno16777736
> > > DEVICETYPE=ovs
> > > UUID=c0addf73-98fe-464c-804a-b40110fd6157
> > > OVS_BRIDGE=br-ex
> > > BOOTPROTO=none
> > > ONBOOT=yes
> > > PROMISC=yes
> > > PROXY_METHOD=none
> > > DEFROUTE=yes
> > > PEERDNS=yes
> > > PEERROUTES=yes
> > > NM_CONTROLLED=no
> > > IPV4_FAILURE_FATAL=no
> > > IPV6INIT=yes
> > > IPV6_AUTOCONF=yes
> > > IPV6_DEFROUTE=yes
> > > IPV6_FAILURE_FATAL=no
> > > NAME=eno16777736
> > > PROXY_METHOD=none
> > > BROWSER_ONLY=no
> > >
> > > which causes this bug:
> > >
> > > [root at localhost log]#
> > > Message from syslogd at localhost at Jan 23 02:23:31 ...
> > >  kernel:NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s!
> > > [ovsdb-server:10088]
> > >
> > > which crashes the VM or Server CPU to may cause critical situation, and
> > > repair , rescue and restore to the server...
> >
> > It's really not clear what you're trying to point out as the bug here.
> > Are you saying there's an OVS kernel module bug?  If so, then you'd need
> > to tell us a lot more about it.
> >


More information about the discuss mailing list