[Pgpool-general] pgpool read/write failed and other errors in our production server

Wed Nov 2 09:48:53 UTC 2011

Hi,

Our production server is running PostgreSQL 8.2.22 and pgpool-II-2.0.1 in
CentOS5.2 64-bit arch.  We're running all our application software stack
(Tomcat, PostgreSQL, pgpool, etc.) in the same server.

Yesterday, we faced a weird behavior in our production server.  Our
application was totally hung up and eventually application users were not
able to access the system completely.  This happened twice.  So we end up
restarting our complete application service.  On checking PostgreSQL log,
there were "unexpected EOF on client connection" errors.  But when I also
checked pgpool log at the same time as these exceptions in PostgreSQL log, I
could see new type of errors appearing in pgpool log.  I've pasted below
only pgpool log statements containing ERROR as its debug level.

>From the ERROR statements, I can see 4 types of exceptions being raised:
	1) pool_process_query: kind is 0!
	2) ProcessFrontendResponse: failed to read kind from frontend.
fronend abnormally exited
	3) pool_flush_it: write failed (Broken pipe) offset: 0 wlen: xxx
	4) pool_read: read failed (Connection reset by peer)

What are the root cause of these exceptions and what is the severity level
of it?  How do I prevent/fix these exceptions?

ERROR statements from pgpool log:
2011-11-01 13:39:21 ERROR: pid 3529: pool_process_query: kind is 0!
2011-11-01 13:41:03 ERROR: pid 14347: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 31
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 55
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 82
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 103
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 134
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 161
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 195
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 232
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 257
2011-11-01 13:41:03 ERROR: pid 4166: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 270
2011-11-01 13:41:48 ERROR: pid 3581: pool_process_query: kind is 0!
2011-11-01 13:41:48 ERROR: pid 4172: pool_process_query: kind is 0!
2011-11-01 13:43:38 ERROR: pid 5250: pool_process_query: kind is 0!
2011-11-01 13:44:07 ERROR: pid 5783: pool_process_query: kind is 0!
2011-11-01 13:46:42 ERROR: pid 7602: pool_process_query: kind is 0!
2011-11-01 13:46:42 ERROR: pid 8614: pool_process_query: kind is 0!
2011-11-01 13:55:43 ERROR: pid 10376: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 5427: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10740: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10282: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10419: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10124: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10615: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 4891: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10680: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10134: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 3597: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 9571: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10458: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10652: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10658: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 9325: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 4234: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10581: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10521: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10330: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10694: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10742: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10535: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 6020: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10508: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10409: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 7296: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10617: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10621: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10590: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 4280: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10494: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 9643: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10322: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10625: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10389: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10256: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10169: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10493: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 9447: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 7708: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 9824: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 3903: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10355: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10726: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 9747: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 8122: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10052: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10697: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10444: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 3776: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10090: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 5142: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 5716: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10136: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10603: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10386: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10181: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10688: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10662: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10454: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10659: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10602: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 7466: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10573: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10474: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 7413: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 6342: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 10696: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 6587: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:43 ERROR: pid 8860: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10718: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 3344: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10799: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 29
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 53
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 80
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 101
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 132
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 159
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 193
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 230
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 255
2011-11-01 13:55:44 ERROR: pid 11121: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 268
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 29
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 53
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 80
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 101
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 132
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 159
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 193
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 230
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 255
2011-11-01 13:55:44 ERROR: pid 11125: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 268
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 29
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 53
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 80
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 101
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 132
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 159
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 193
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 230
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 255
2011-11-01 13:55:44 ERROR: pid 11120: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 268
2011-11-01 13:55:44 ERROR: pid 10258: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10563: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 9739: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10560: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10007: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10311: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10719: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10700: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10306: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10517: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 4528: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10699: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 9920: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10320: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10031: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10582: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10146: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10524: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10214: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 4843: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10473: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 9707: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 9257: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 6087: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10743: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10608: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10618: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 9957: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10498: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10367: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10754: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 4062: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 6540: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 9821: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10586: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 7486: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10104: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10357: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10223: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 6737: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10482: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10656: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10507: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10580: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10298: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10082: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 6892: ProcessFrontendResponse: failed to read
kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10515: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10712: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10565: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10701: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10518: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10259: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10457: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10335: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10801: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10783: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 10782: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 11132: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 29
2011-11-01 13:55:44 ERROR: pid 11132: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 53
2011-11-01 13:55:44 ERROR: pid 11132: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 80
2011-11-01 13:55:44 ERROR: pid 11132: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 101
2011-11-01 13:55:44 ERROR: pid 11132: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 132
2011-11-01 13:55:44 ERROR: pid 11132: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 159
2011-11-01 13:2011-11-01 13:55:44 ERROR: pid 10605: ProcessFrontendResponse:
failed to read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 29
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 53
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 80
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 101
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 132
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 159
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 193
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 230
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 255
2011-11-01 13:55:44 ERROR: pid 11130: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 268
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 29
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 53
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 80
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 101
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 132
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 159
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 193
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 230
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 255
2011-11-01 13:55:44 ERROR: pid 11126: pool_flush_it: write failed (Broken
pipe) offset: 0 wlen: 268
2011-11-01 13:55:44 ERROR: pid 11134: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited
2011-11-01 13:55:44 ERROR: pid 11123: pool_read: read failed (Connection
reset by peer)
2011-11-01 13:55:44 ERROR: pid 11123: ProcessFrontendResponse: failed to
read kind from frontend. fronend abnormally exited

Regards,
Gnanam