View Issue Details

IDProjectCategoryView StatusLast Update
0000413Pgpool-IIEnhancementpublic2018-08-20 11:01
Reporterpio01 Assigned To 
PrioritynormalSeverityminorReproducibilityhave not tried
Status closedResolutionopen 
Product Version3.7.3 
Summary0000413: watchdog issues
DescriptionHello Guys'

I have implement a pgpool-II cluster and the standby service want not to add on the watchdog info..
Some issues for help?
Pgpool version is the same on both side.

[root@tes01 ~]# /usr/pgpool-10/bin/pcp_watchdog_info -p 9898 -U pgpool
Password:
2 YES test01.adm.test.ch:5432 Linux test01 test01.test.cacc.ch

test01.adm.test.ch:5432 Linux pgpool01 test01.test.cacc.ch 5432 9000 4 MASTER
Not_Set test02.test.cacc.ch 9999 9000 0 DEAD

-----
test01 active

├─12725 pgpool: wait for connection request
├─12784 pgpool: wait for connection request
└─14564 pgpool: wait for connection request

Jul 17 09:55:59 test01 pgpool[2925]: [431-1] 2018-07-17 09:55:59: pid 2925: LOG: new connection received
Jul 17 09:55:59 test01 pgpool[2925]: [431-2] 2018-07-17 09:55:59: pid 2925: DETAIL: connecting host=test01 port=59438
Jul 17 09:55:59 test01 pgpool[2925]: [432-1] 2018-07-17 09:55:59: pid 2925: ERROR: backend authentication failed
Jul 17 09:55:59 test01 pgpool[2925]: [432-2] 2018-07-17 09:55:59: pid 2925: DETAIL: backend response with kind 'E' when expecting 'R'
Jul 17 09:55:59 test01 pgpool[2925]: [432-3] 2018-07-17 09:55:59: pid 2925: HINT: This issue can be caused by version mismatch (current version 3)
Jul 17 09:55:59 test01 pgpool[2166]: [222-1] 2018-07-17 09:55:59: pid 2166: LOG: new connection received
Jul 17 09:55:59 test01 pgpool[2166]: [222-2] 2018-07-17 09:55:59: pid 2166: DETAIL: connecting host=test01 port=59442
Jul 17 09:55:59 test01 pgpool[2166]: [223-1] 2018-07-17 09:55:59: pid 2166: ERROR: backend authentication failed
Jul 17 09:55:59 test01 pgpool[2166]: [223-2] 2018-07-17 09:55:59: pid 2166: DETAIL: backend response with kind 'E' when expecting 'R'
Jul 17 09:55:59 test01 pgpool[2166]: [223-3] 2018-07-17 09:55:59: pid 2166: HINT: This issue can be caused by version mismatch (current version 2)
[root@test01 pgpool-II-10]#


-----
test02 standby

pgpool-log in my standby test02 :

Jul 13 11:38:08 test02 pgpool[824]: [7-1] 2018-07-13 11:38:08: pid 824: FATAL: Add to watchdog cluster request is rejected by node "pgpool01.adm.cacc.ch:9000"
Jul 13 11:38:08 test02 pgpool[824]: [7-2] 2018-07-13 11:38:08: pid 824: HINT: check the watchdog configurations.
Jul 13 11:38:08 test02 pgpool[824]: [8-1] 2018-07-13 11:38:08: pid 824: LOG: Watchdog is shutting down
Jul 13 11:38:08 test02 pgpool[776]: [2-1] 2018-07-13 11:38:08: pid 776: LOG: watchdog child process with pid: 824 exits with status 768
Jul 13 11:38:08 test02 pgpool[776]: [3-1] 2018-07-13 11:38:08: pid 776: FATAL: watchdog child process exit with fatal error. exiting pgpool-II
Jul 13 11:38:08 test02 systemd[1]: pgpool-II-10.service: main process exited, code=exited, status=3/NOTIMPLEMENTED
Jul 13 11:38:08 test02 pgpool[830]: [1-1] 2018-07-13 11:38:08: pid 830: FATAL: could not read pid file
Jul 13 11:38:08 test02 systemd[1]: pgpool-II-10.service: control process exited, code=exited status=3
Jul 13 11:38:08 test02 systemd[1]: Unit pgpool-II-10.service entered failed state.
Jul 13 11:38:08 test02 systemd[1]: pgpool-II-10.service failed
TagsNo tags attached.

Activities

pengbo

2018-07-23 11:03

developer   ~0002114

Last edited: 2018-07-23 11:04

It seems that pgpool server starting failed.
Which rpm packages do you use and how did you install pgpool?

And also could you share pgpool.conf?

pio01

2018-07-26 23:47

reporter   ~0002124

Thanks for your feedback.

Attach you can find pgpool.conf for both nodes

rpm packages installer :

783 rpm - Uvh https://yum.postgresql.org/10/redhat/rhel-7-x86_64/pgpool-II-10-extensions-3.7.3-1.rhel7.x86_64.rpm
784 rpm -Uvh https://yum.postgresql.org/10/redhat/rhel-7-x86_64/pgpool-II-10-extensions-3.7.3-1.rhel7.x86_64.rpm
785 yum install pgpool-II-10-extensions
786 yum install postgresql-contrib-10

pio01

2018-07-26 23:52

reporter   ~0002125

pgpool version :

[root@pgpool02 pgpool-II-10]# pgpool -v
pgpool-II version 3.7.3 (amefuriboshi)

pengbo

2018-07-27 10:34

developer   ~0002127

I checked your pgpool.conf.
Now you are setting parameters like below:

 - Primary
port = 5432
 heartbeat_destination0 = 'asa-pgpool02'
 other_pgpool_hostname0 = 'asa-pgpool02.adm.cacc.ch'
other_pgpool_port0 = 9999
                                        ~~~~~ <= 5432

- Standby
port = 5432
heartbeat_destination0 = 'asa-pgsql01'
                                               ~~~~~~~~~~ <= asa-pgpool01
other_pgpool_hostname0 = 'asa-pgpool01.adm.cacc.ch'
other_pgpool_port0 = 9999
                                        ~~~~~ <= 5432


I think you had a typo at standby's "heartbeat_destination0". You should set "asa-pgpool01".
And also if you set "port = 5432", then you have to "other_pgpool_port0 = 5432".

pio01

2018-08-01 01:27

reporter   ~0002128

Thanks for your feedback.

after make the change, I need to restart both service?
Like : "systemctl stop pgpool-II-10.service" and "systemctl start pgpool-II-10.service"

pengbo

2018-08-01 09:14

developer   ~0002129

Yes, you need to restart both Pgpool-II.
systemctl stop pgpool-II-10.service
systemctl start pgpool-II-10.service

pengbo

2018-08-13 09:40

developer   ~0002148

If issue is resovled, may I close this issue?

Issue History

Date Modified Username Field Change
2018-07-18 20:55 pio01 New Issue
2018-07-23 11:03 pengbo Note Added: 0002114
2018-07-23 11:04 pengbo Note Edited: 0002114
2018-07-26 23:47 pio01 File Added: pgpool.conf.bck.26JULY2018.primary
2018-07-26 23:47 pio01 File Added: pgpool.conf.bck.26JULY2018.standby
2018-07-26 23:47 pio01 Note Added: 0002124
2018-07-26 23:52 pio01 Note Added: 0002125
2018-07-27 10:34 pengbo Note Added: 0002127
2018-08-01 01:27 pio01 Note Added: 0002128
2018-08-01 09:14 pengbo Note Added: 0002129
2018-08-13 09:40 pengbo Note Added: 0002148
2018-08-20 11:01 administrator Status new => closed