[pgpool-general: 5210] PGPool connections taking a ridiculously long time...why?

[David Sisk -X (dsisk - TEKSYSTEMS INC at Cisco)]

Here's a connection directly to the database:
-bash-4.1$ time psql -h localhost -p 5493 -c 'select 1;'
?column?
----------
        1
(1 row)

real    0m0.010s
user    0m0.001s
sys     0m0.004s

Here's a connection thru PGPool:
-bash-4.1$ time psql -h localhost -c 'select 1;'
?column?
----------
        1
(1 row)

real    0m42.962s
user    0m0.005s
sys     0m0.003s

Here's a trace route from the PGPool host to the database primary host...doesn't appear to be network slowness:
-bash-4.1$ traceroute rtp-apl-psg1
traceroute to rtp-apl-psg1 (10.83.105.93), 30 hops max, 60 byte packets
1  rtp5-ae72-dci02n-gw2-vla310.cisco.com (10.83.92.3)  0.549 ms rtp5-aa72-dci02n-gw1-vla310.cisco.com (10.83.92.2)  1.632 ms rtp5-ae72-dci02n-gw2-vla310.cisco.com (10.83.92.3)  0.652 ms
2  rtp-apl-psg1.cisco.com (10.83.105.93)  0.158 ms  0.383 ms  0.246 ms

PGPool is holding 1024 sessions open...the database is configured to allow 1500, so PGPool is not queueing a connection request.  Load-balancing and caching are disabled in PGPool. Multiple queries on the same session return quickly, it's the process of connecting that is seeing the delay.

How do I troubleshoot this behavior?

Thanks in advance,

[banner2]



David Sisk
Engineer - Software
dsisk at cisco.com<mailto:dsisk at cisco.com>
Tel:

Cisco Systems, Inc.
7025-6 Kit Creek Road PO Box 14987
RESEARCH TRIANGLE PARK
27709-4987
United States
cisco.com


[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif]Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20170103/6b8afb2e/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 121724 bytes
Desc: image005.png
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20170103/6b8afb2e/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 1469 bytes
Desc: image006.png
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20170103/6b8afb2e/attachment-0003.png>