View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0000711Pgpool-IIBugpublic2021-05-18 16:282021-05-24 18:10
Reportermoin Assigned To 
PriorityimmediateSeveritymajorReproducibilityN/A
Status newResolutionopen 
OSLinuxOS Version7 
Product Version4.0.3 
Summary0000711: APPARENT DEADLOCK!!! Complete Status: Managed Threads: 3 Active Threads: 3
DescriptionWe are facing issue whenever application is connecting to pgpool 4th Node.

We have 4 Applications and 4 pgpool nodes, at any point of time Application can able to connect only 3 pgpool nodes, when we are starting application services on 4 pgpool node we are getting below error messages on application logs and also psql command on pgpool is getting hanged..

Application Logs:

APPARENT DEADLOCK!!! Complete Status:
    Managed Threads: 3
    Active Threads: 3

APPARENT DEADLOCK!!! Creating emergency threads for unassigned pending tasks !
[Timer-0] [WARN] [async.ThreadPoolAsynchronousRunner] – (in deadlocked PoolThread) failed to complete in maximum time 6000ms. Trying interrupt().
Steps To ReproduceNA
Additional InformationNA
TagsNo tags attached.

Activities

moin

2021-05-18 16:28

reporter  

image.png (8,436 bytes)   
image.png (8,436 bytes)   
image-2.png (46,925 bytes)   
image-2.png (46,925 bytes)   

moin

2021-05-18 19:54

reporter   ~0003832

pgpool version: 4.0.3

moin

2021-05-19 21:21

reporter   ~0003833

May 18 07:47:41 pgpool[22686]: [7-1] 2021-05-18 07:47:41: pid 22686: LOG: failed to connect to PostgreSQL server on "db02:5432" using INET socket
May 18 07:47:41 pgpool[22650]: 2021-05-18 07:47:41: pid 22686: LOG: failed to connect to PostgreSQL server on "db02:5432" using INET socket
May 18 07:47:41 pgpool[22650]: 2021-05-18 07:47:41: pid 22686: DETAIL: health check timer expired
May 18 07:47:41 pgpool[22650]: 2021-05-18 07:47:41: pid 22686: ERROR: failed to make persistent db connection
May 18 07:47:41 pgpool[22650]: 2021-05-18 07:47:41: pid 22686: DETAIL: connection to host:"db02:5432" failed
May 18 07:47:41 pgpool[22650]: 2021-05-18 07:47:41: pid 22686: LOG: health check retrying on DB node: 1 (round:1)
May 18 07:47:41 pgpool[22686]: [7-2] 2021-05-18 07:47:41: pid 22686: DETAIL: health check timer expired
May 18 07:47:41 pgpool[22686]: [8-1] 2021-05-18 07:47:41: pid 22686: ERROR: failed to make persistent db connection
May 18 07:47:41 pgpool[22686]: [8-2] 2021-05-18 07:47:41: pid 22686: DETAIL: connection to host:"db02:5432" failed
May 18 07:48:31 pgpool[22685]: [7-1] 2021-05-18 07:48:31: pid 22685: LOG: failed to connect to PostgreSQL server on "db01:5432" using INET socket
May 18 07:48:31 pgpool[22650]: 2021-05-18 07:48:31: pid 22685: LOG: failed to connect to PostgreSQL server on "db01:5432" using INET socket
May 18 07:48:31 pgpool[22650]: 2021-05-18 07:48:31: pid 22685: DETAIL: health check timer expired
May 18 07:48:31 pgpool[22650]: 2021-05-18 07:48:31: pid 22685: ERROR: failed to make persistent db connection
May 18 07:48:31 pgpool[22650]: 2021-05-18 07:48:31: pid 22685: DETAIL: connection to host:"db01:5432" failed
May 18 07:48:31 pgpool[22650]: 2021-05-18 07:48:31: pid 22685: LOG: health check retrying on DB node: 0 (round:1)
May 18 07:48:31 pgpool[22685]: [7-2] 2021-05-18 07:48:31: pid 22685: DETAIL: health check timer expired
May 18 07:48:31 pgpool[22685]: [8-1] 2021-05-18 07:48:31: pid 22685: ERROR: failed to make persistent db connection
May 18 07:48:31 pgpool[22685]: [8-2] 2021-05-18 07:48:31: pid 22685: DETAIL: connection to host:"db01:5432" failed

JockeTF

2021-05-20 18:47

reporter   ~0003835

Are you sure this isn't a networking issue? It looks like your PGPool instance can't connect to the database server at all.

What happens if you try connecting via netcat? Try something like this on your 4:th PGPool node:

postgres@pgpool4:~$ echo hello | nc -v db02 5432
db02 [X.X.X.X] 5432 (postgresql) open
postgres@pgpool4:~$

The important part there is that it says "open".

moin

2021-05-21 16:21

reporter   ~0003836

image-3.png (124,524 bytes)   
image-3.png (124,524 bytes)   

moin

2021-05-24 18:10

reporter   ~0003847

Team, any update or recommendation from your side.

Issue History

Date Modified Username Field Change
2021-05-18 16:28 moin New Issue
2021-05-18 16:28 moin File Added: image.png
2021-05-18 16:28 moin File Added: image-2.png
2021-05-18 19:54 moin Note Added: 0003832
2021-05-19 21:21 moin Note Added: 0003833
2021-05-20 18:47 JockeTF Note Added: 0003835
2021-05-21 16:21 moin Note Added: 0003836
2021-05-21 16:21 moin File Added: image-3.png
2021-05-24 18:10 moin Note Added: 0003847