Sep 14 14:13:51 proxy1 pgpool[25614]: [650-1] 2020-09-14 14:13:51: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = MASTER Sep 14 14:13:51 proxy1 pgpool[25614]: [650-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:13:51 proxy1 pgpool[25614]: [651-1] 2020-09-14 14:13:51: pid 25614: DEBUG: received packet, watchdog node:[pgpool2:5432 Linux proxy2] command id:[38] type:[NODE INFO] state:[MASTER] Sep 14 14:13:51 proxy1 pgpool[25614]: [651-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:13:51 proxy1 pgpool[25614]: [652-1] 2020-09-14 14:13:51: pid 25614: DEBUG: packet I with command ID 38 is reply to the command M Sep 14 14:13:51 proxy1 pgpool[25614]: [652-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:3669 Sep 14 14:13:51 proxy1 pgpool[25614]: [653-1] 2020-09-14 14:13:51: pid 25614: DEBUG: Watchdog node "pgpool2:5432 Linux proxy2" has replied for command id 38 Sep 14 14:13:51 proxy1 pgpool[25614]: [653-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:4579 Sep 14 14:13:51 proxy1 pgpool[25614]: [654-1] 2020-09-14 14:13:51: pid 25614: DEBUG: received watchdog packet type:I Sep 14 14:13:51 proxy1 pgpool[25614]: [654-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:3034 Sep 14 14:13:51 proxy1 pgpool[25614]: [655-1] 2020-09-14 14:13:51: pid 25614: DEBUG: reading packet type I of length 323 Sep 14 14:13:51 proxy1 pgpool[25614]: [655-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:3066 Sep 14 14:13:51 proxy1 pgpool[25614]: [656-1] 2020-09-14 14:13:51: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = MASTER Sep 14 14:13:51 proxy1 pgpool[25614]: [656-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:13:51 proxy1 pgpool[25614]: [657-1] 2020-09-14 14:13:51: pid 25614: DEBUG: received packet, watchdog node:[pgpool3:5432 Linux proxy3] command id:[38] type:[NODE INFO] state:[MASTER] Sep 14 14:13:51 proxy1 pgpool[25614]: [657-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:13:51 proxy1 pgpool[25614]: [658-1] 2020-09-14 14:13:51: pid 25614: DEBUG: packet I with command ID 38 is reply to the command M Sep 14 14:13:51 proxy1 pgpool[25614]: [658-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:3669 Sep 14 14:13:51 proxy1 pgpool[25614]: [659-1] 2020-09-14 14:13:51: pid 25614: DEBUG: Watchdog node "pgpool3:5432 Linux proxy3" has replied for command id 38 Sep 14 14:13:51 proxy1 pgpool[25614]: [659-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:4579 Sep 14 14:13:51 proxy1 pgpool[25614]: [660-1] 2020-09-14 14:13:51: pid 25614: DEBUG: command I with command id 38 is finished with COMMAND_FINISHED_ALL_REPLIED Sep 14 14:13:51 proxy1 pgpool[25614]: [660-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:4596 Sep 14 14:13:51 proxy1 pgpool[25614]: [661-1] 2020-09-14 14:13:51: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = COMMAND FINISHED Current State = MASTER Sep 14 14:13:51 proxy1 pgpool[25614]: [661-2] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:13:51 proxy1 pgpool[25614]: [662-1] 2020-09-14 14:13:51: pid 25614: DEBUG: I am the cluster leader node command finished with status:[ALL NODES REPLIED] Sep 14 14:13:51 proxy1 pgpool[25614]: [662-2] 2020-09-14 14:13:51: pid 25614: DETAIL: The command was sent to 2 nodes and 2 nodes replied to it Sep 14 14:13:51 proxy1 pgpool[25614]: [662-3] 2020-09-14 14:13:51: pid 25614: LOCATION: watchdog.c:5796 Sep 14 14:13:52 proxy1 pgpool[25646]: [152-1] 2020-09-14 14:13:52: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:13:52 proxy1 pgpool[25646]: [152-2] 2020-09-14 14:13:52: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:53 proxy1 pgpool[25647]: [154-1] 2020-09-14 14:13:53: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:13:53 proxy1 pgpool[25647]: [154-2] 2020-09-14 14:13:53: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:53 proxy1 pgpool[25649]: [154-1] 2020-09-14 14:13:53: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:13:53 proxy1 pgpool[25649]: [154-2] 2020-09-14 14:13:53: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:53 proxy1 pgpool[25648]: [153-1] 2020-09-14 14:13:53: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:13:53 proxy1 pgpool[25648]: [153-2] 2020-09-14 14:13:53: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:54 proxy1 pgpool[25646]: [153-1] 2020-09-14 14:13:54: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:13:54 proxy1 pgpool[25646]: [153-2] 2020-09-14 14:13:54: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:55 proxy1 pgpool[25647]: [155-1] 2020-09-14 14:13:55: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:13:55 proxy1 pgpool[25647]: [155-2] 2020-09-14 14:13:55: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:55 proxy1 pgpool[25649]: [155-1] 2020-09-14 14:13:55: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:13:55 proxy1 pgpool[25649]: [155-2] 2020-09-14 14:13:55: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:55 proxy1 pgpool[25648]: [154-1] 2020-09-14 14:13:55: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:13:55 proxy1 pgpool[25648]: [154-2] 2020-09-14 14:13:55: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:56 proxy1 pgpool[25646]: [154-1] 2020-09-14 14:13:56: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:13:56 proxy1 pgpool[25646]: [154-2] 2020-09-14 14:13:56: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:57 proxy1 pgpool[25647]: [156-1] 2020-09-14 14:13:57: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:13:57 proxy1 pgpool[25647]: [156-2] 2020-09-14 14:13:57: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:57 proxy1 pgpool[25649]: [156-1] 2020-09-14 14:13:57: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:13:57 proxy1 pgpool[25649]: [156-2] 2020-09-14 14:13:57: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:57 proxy1 pgpool[25648]: [155-1] 2020-09-14 14:13:57: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:13:57 proxy1 pgpool[25648]: [155-2] 2020-09-14 14:13:57: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:58 proxy1 pgpool[25646]: [155-1] 2020-09-14 14:13:58: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:13:58 proxy1 pgpool[25646]: [155-2] 2020-09-14 14:13:58: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:13:58 proxy1 pgpool[25615]: [164-1] 2020-09-14 14:13:58: pid 25615: DEBUG: Lifecheck child reaper handler Sep 14 14:13:58 proxy1 pgpool[25615]: [164-2] 2020-09-14 14:13:58: pid 25615: LOCATION: wd_lifecheck.c:157 Sep 14 14:13:58 proxy1 pgpool[25611]: ping: 1.1.1.1: Name or service not known Sep 14 14:13:58 proxy1 pgpool[25615]: [165-1] 2020-09-14 14:13:58: pid 25615: WARNING: watchdog failed to ping host" 1.1.1.1" Sep 14 14:13:58 proxy1 pgpool[25615]: [165-2] 2020-09-14 14:13:58: pid 25615: DETAIL: ping process exits with code: 2 Sep 14 14:13:58 proxy1 pgpool[25615]: [165-3] 2020-09-14 14:13:58: pid 25615: LOCATION: wd_ping.c:173 Sep 14 14:13:59 proxy1 pgpool[25647]: [157-1] 2020-09-14 14:13:59: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:13:59 proxy1 pgpool[25647]: [157-2] 2020-09-14 14:13:59: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:59 proxy1 pgpool[25649]: [157-1] 2020-09-14 14:13:59: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:13:59 proxy1 pgpool[25649]: [157-2] 2020-09-14 14:13:59: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:13:59 proxy1 pgpool[25648]: [156-1] 2020-09-14 14:13:59: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:13:59 proxy1 pgpool[25648]: [156-2] 2020-09-14 14:13:59: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:00 proxy1 pgpool[25646]: [156-1] 2020-09-14 14:14:00: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:00 proxy1 pgpool[25646]: [156-2] 2020-09-14 14:14:00: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:00 proxy1 pgpool[25615]: [166-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog ping process for host "1.0.0.1" exited successfully Sep 14 14:14:00 proxy1 pgpool[25615]: [166-2] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_ping.c:182 Sep 14 14:14:00 proxy1 pgpool[25615]: [167-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog ping Sep 14 14:14:00 proxy1 pgpool[25615]: [167-2] 2020-09-14 14:14:00: pid 25615: DETAIL: ping data: PING 1.0.0.1 (1.0.0.1) 56(84) bytes of data. Sep 14 14:14:00 proxy1 pgpool[25615]: [167-3] #011 Sep 14 14:14:00 proxy1 pgpool[25615]: [167-4] #011--- 1.0.0.1 ping statistics --- Sep 14 14:14:00 proxy1 pgpool[25615]: [167-5] #0113 packets transmitted, 3 received, 0% packet loss, time 5ms Sep 14 14:14:00 proxy1 pgpool[25615]: [167-6] #011rtt min/avg/max/mdev = 5.466/5.635/5.797/0.148 ms Sep 14 14:14:00 proxy1 pgpool[25615]: [167-7] #011 Sep 14 14:14:00 proxy1 pgpool[25615]: [167-8] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_ping.c:225 Sep 14 14:14:00 proxy1 pgpool[25615]: [168-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog succeeded to ping a host "1.0.0.1" Sep 14 14:14:00 proxy1 pgpool[25615]: [168-2] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_ping.c:194 Sep 14 14:14:00 proxy1 pgpool[25615]: [169-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog life checking by heartbeat Sep 14 14:14:00 proxy1 pgpool[25615]: [169-2] 2020-09-14 14:14:00: pid 25615: DETAIL: checking pgpool 1 (pgpool2:5432) Sep 14 14:14:00 proxy1 pgpool[25615]: [169-3] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_lifecheck.c:781 Sep 14 14:14:00 proxy1 pgpool[25615]: [170-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog checking if pgpool is alive using heartbeat Sep 14 14:14:00 proxy1 pgpool[25615]: [170-2] 2020-09-14 14:14:00: pid 25615: DETAIL: the last heartbeat from "pgpool2:5432" received 1 seconds ago Sep 14 14:14:00 proxy1 pgpool[25615]: [170-3] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_lifecheck.c:986 Sep 14 14:14:00 proxy1 pgpool[25615]: [171-1] 2020-09-14 14:14:00: pid 25615: DEBUG: checking pgpool status by heartbeat Sep 14 14:14:00 proxy1 pgpool[25615]: [171-2] 2020-09-14 14:14:00: pid 25615: DETAIL: OK; status OK Sep 14 14:14:00 proxy1 pgpool[25615]: [171-3] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_lifecheck.c:800 Sep 14 14:14:00 proxy1 pgpool[25615]: [172-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog life checking by heartbeat Sep 14 14:14:00 proxy1 pgpool[25615]: [172-2] 2020-09-14 14:14:00: pid 25615: DETAIL: checking pgpool 2 (pgpool3:5432) Sep 14 14:14:00 proxy1 pgpool[25615]: [172-3] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_lifecheck.c:781 Sep 14 14:14:00 proxy1 pgpool[25615]: [173-1] 2020-09-14 14:14:00: pid 25615: DEBUG: watchdog checking if pgpool is alive using heartbeat Sep 14 14:14:00 proxy1 pgpool[25615]: [173-2] 2020-09-14 14:14:00: pid 25615: DETAIL: the last heartbeat from "pgpool3:5432" received 0 seconds ago Sep 14 14:14:00 proxy1 pgpool[25615]: [173-3] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_lifecheck.c:986 Sep 14 14:14:00 proxy1 pgpool[25615]: [174-1] 2020-09-14 14:14:00: pid 25615: DEBUG: checking pgpool status by heartbeat Sep 14 14:14:00 proxy1 pgpool[25615]: [174-2] 2020-09-14 14:14:00: pid 25615: DETAIL: OK; status OK Sep 14 14:14:00 proxy1 pgpool[25615]: [174-3] 2020-09-14 14:14:00: pid 25615: LOCATION: wd_lifecheck.c:800 Sep 14 14:14:01 proxy1 pgpool[25647]: [158-1] 2020-09-14 14:14:01: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:01 proxy1 pgpool[25647]: [158-2] 2020-09-14 14:14:01: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:01 proxy1 pgpool[25649]: [158-1] 2020-09-14 14:14:01: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:01 proxy1 pgpool[25649]: [158-2] 2020-09-14 14:14:01: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:01 proxy1 pgpool[25648]: [157-1] 2020-09-14 14:14:01: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:01 proxy1 pgpool[25648]: [157-2] 2020-09-14 14:14:01: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:01 proxy1 pgpool[25614]: [663-1] 2020-09-14 14:14:01: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = TIMEOUT Current State = MASTER Sep 14 14:14:01 proxy1 pgpool[25614]: [663-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:01 proxy1 pgpool[25614]: [664-1] 2020-09-14 14:14:01: pid 25614: DEBUG: sending packet, watchdog node:[pgpool2:5432 Linux proxy2] command id:[39] type:[IAM COORDINATOR] state:[MASTER] Sep 14 14:14:01 proxy1 pgpool[25614]: [664-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:01 proxy1 pgpool[25614]: [665-1] 2020-09-14 14:14:01: pid 25614: DEBUG: sending watchdog packet to socket:10, type:[M], command ID:39, data Length:118 Sep 14 14:14:01 proxy1 pgpool[25614]: [665-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3385 Sep 14 14:14:01 proxy1 pgpool[25614]: [666-1] 2020-09-14 14:14:01: pid 25614: DEBUG: sending packet, watchdog node:[pgpool3:5432 Linux proxy3] command id:[39] type:[IAM COORDINATOR] state:[MASTER] Sep 14 14:14:01 proxy1 pgpool[25614]: [666-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:01 proxy1 pgpool[25614]: [667-1] 2020-09-14 14:14:01: pid 25614: DEBUG: sending watchdog packet to socket:11, type:[M], command ID:39, data Length:118 Sep 14 14:14:01 proxy1 pgpool[25614]: [667-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3385 Sep 14 14:14:01 proxy1 pgpool[25614]: [668-1] 2020-09-14 14:14:01: pid 25614: DEBUG: received watchdog packet type:I Sep 14 14:14:01 proxy1 pgpool[25614]: [668-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3034 Sep 14 14:14:01 proxy1 pgpool[25614]: [669-1] 2020-09-14 14:14:01: pid 25614: DEBUG: reading packet type I of length 323 Sep 14 14:14:01 proxy1 pgpool[25614]: [669-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3066 Sep 14 14:14:02 proxy1 pgpool[25614]: [670-1] 2020-09-14 14:14:01: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = MASTER Sep 14 14:14:02 proxy1 pgpool[25614]: [670-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:02 proxy1 pgpool[25614]: [671-1] 2020-09-14 14:14:01: pid 25614: DEBUG: received packet, watchdog node:[pgpool2:5432 Linux proxy2] command id:[39] type:[NODE INFO] state:[MASTER] Sep 14 14:14:02 proxy1 pgpool[25614]: [671-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:02 proxy1 pgpool[25614]: [672-1] 2020-09-14 14:14:01: pid 25614: DEBUG: packet I with command ID 39 is reply to the command M Sep 14 14:14:02 proxy1 pgpool[25614]: [672-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3669 Sep 14 14:14:02 proxy1 pgpool[25614]: [673-1] 2020-09-14 14:14:01: pid 25614: DEBUG: Watchdog node "pgpool2:5432 Linux proxy2" has replied for command id 39 Sep 14 14:14:02 proxy1 pgpool[25614]: [673-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:4579 Sep 14 14:14:02 proxy1 pgpool[25614]: [674-1] 2020-09-14 14:14:01: pid 25614: DEBUG: received watchdog packet type:I Sep 14 14:14:02 proxy1 pgpool[25614]: [674-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3034 Sep 14 14:14:02 proxy1 pgpool[25614]: [675-1] 2020-09-14 14:14:01: pid 25614: DEBUG: reading packet type I of length 323 Sep 14 14:14:02 proxy1 pgpool[25614]: [675-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3066 Sep 14 14:14:02 proxy1 pgpool[25614]: [676-1] 2020-09-14 14:14:01: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = MASTER Sep 14 14:14:02 proxy1 pgpool[25614]: [676-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:02 proxy1 pgpool[25614]: [677-1] 2020-09-14 14:14:01: pid 25614: DEBUG: received packet, watchdog node:[pgpool3:5432 Linux proxy3] command id:[39] type:[NODE INFO] state:[MASTER] Sep 14 14:14:02 proxy1 pgpool[25614]: [677-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:02 proxy1 pgpool[25614]: [678-1] 2020-09-14 14:14:01: pid 25614: DEBUG: packet I with command ID 39 is reply to the command M Sep 14 14:14:02 proxy1 pgpool[25614]: [678-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:3669 Sep 14 14:14:02 proxy1 pgpool[25614]: [679-1] 2020-09-14 14:14:01: pid 25614: DEBUG: Watchdog node "pgpool3:5432 Linux proxy3" has replied for command id 39 Sep 14 14:14:02 proxy1 pgpool[25614]: [679-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:4579 Sep 14 14:14:02 proxy1 pgpool[25614]: [680-1] 2020-09-14 14:14:01: pid 25614: DEBUG: command I with command id 39 is finished with COMMAND_FINISHED_ALL_REPLIED Sep 14 14:14:02 proxy1 pgpool[25614]: [680-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:4596 Sep 14 14:14:02 proxy1 pgpool[25614]: [681-1] 2020-09-14 14:14:01: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = COMMAND FINISHED Current State = MASTER Sep 14 14:14:02 proxy1 pgpool[25614]: [681-2] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:02 proxy1 pgpool[25614]: [682-1] 2020-09-14 14:14:01: pid 25614: DEBUG: I am the cluster leader node command finished with status:[ALL NODES REPLIED] Sep 14 14:14:02 proxy1 pgpool[25614]: [682-2] 2020-09-14 14:14:01: pid 25614: DETAIL: The command was sent to 2 nodes and 2 nodes replied to it Sep 14 14:14:02 proxy1 pgpool[25614]: [682-3] 2020-09-14 14:14:01: pid 25614: LOCATION: watchdog.c:5796 Sep 14 14:14:02 proxy1 pgpool[25646]: [157-1] 2020-09-14 14:14:02: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:02 proxy1 pgpool[25646]: [157-2] 2020-09-14 14:14:02: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:03 proxy1 pgpool[25647]: [159-1] 2020-09-14 14:14:03: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:03 proxy1 pgpool[25647]: [159-2] 2020-09-14 14:14:03: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:03 proxy1 pgpool[25649]: [159-1] 2020-09-14 14:14:03: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:03 proxy1 pgpool[25649]: [159-2] 2020-09-14 14:14:03: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:03 proxy1 pgpool[25648]: [158-1] 2020-09-14 14:14:03: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:03 proxy1 pgpool[25648]: [158-2] 2020-09-14 14:14:03: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:04 proxy1 pgpool[25646]: [158-1] 2020-09-14 14:14:04: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:04 proxy1 pgpool[25646]: [158-2] 2020-09-14 14:14:04: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:05 proxy1 pgpool[25647]: [160-1] 2020-09-14 14:14:05: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:05 proxy1 pgpool[25647]: [160-2] 2020-09-14 14:14:05: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:05 proxy1 pgpool[25649]: [160-1] 2020-09-14 14:14:05: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:05 proxy1 pgpool[25649]: [160-2] 2020-09-14 14:14:05: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:05 proxy1 pgpool[25648]: [159-1] 2020-09-14 14:14:05: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:05 proxy1 pgpool[25648]: [159-2] 2020-09-14 14:14:05: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:06 proxy1 pgpool[25646]: [159-1] 2020-09-14 14:14:06: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:06 proxy1 pgpool[25646]: [159-2] 2020-09-14 14:14:06: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:06 proxy1 pgpool[25723]: [100-1] 2020-09-14 14:14:06: pid 25723: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25723]: [100-2] 2020-09-14 14:14:06: pid 25723: LOCATION: health_check.c:294 Sep 14 14:14:06 proxy1 pgpool[25725]: [100-1] 2020-09-14 14:14:06: pid 25725: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25725]: [100-2] 2020-09-14 14:14:06: pid 25725: LOCATION: health_check.c:294 Sep 14 14:14:06 proxy1 pgpool[25724]: [100-1] 2020-09-14 14:14:06: pid 25724: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25724]: [100-2] 2020-09-14 14:14:06: pid 25724: LOCATION: health_check.c:294 Sep 14 14:14:06 proxy1 pgpool[25723]: [101-1] 2020-09-14 14:14:06: pid 25723: DEBUG: authenticate kind = 5 Sep 14 14:14:06 proxy1 pgpool[25723]: [101-2] 2020-09-14 14:14:06: pid 25723: LOCATION: pool_auth.c:141 Sep 14 14:14:06 proxy1 pgpool[25725]: [101-1] 2020-09-14 14:14:06: pid 25725: DEBUG: authenticate kind = 5 Sep 14 14:14:06 proxy1 pgpool[25725]: [101-2] 2020-09-14 14:14:06: pid 25725: LOCATION: pool_auth.c:141 Sep 14 14:14:06 proxy1 pgpool[25723]: [102-1] 2020-09-14 14:14:06: pid 25723: DEBUG: authenticate backend: key data received Sep 14 14:14:06 proxy1 pgpool[25723]: [102-2] 2020-09-14 14:14:06: pid 25723: LOCATION: pool_auth.c:251 Sep 14 14:14:06 proxy1 pgpool[25723]: [103-1] 2020-09-14 14:14:06: pid 25723: DEBUG: authenticate backend: transaction state: I Sep 14 14:14:06 proxy1 pgpool[25723]: [103-2] 2020-09-14 14:14:06: pid 25723: LOCATION: pool_auth.c:284 Sep 14 14:14:06 proxy1 pgpool[25723]: [104-1] 2020-09-14 14:14:06: pid 25723: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25723]: [104-2] 2020-09-14 14:14:06: pid 25723: LOCATION: health_check.c:311 Sep 14 14:14:06 proxy1 pgpool[25723]: [105-1] 2020-09-14 14:14:06: pid 25723: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25723]: [105-2] 2020-09-14 14:14:06: pid 25723: LOCATION: health_check.c:311 Sep 14 14:14:06 proxy1 pgpool[25725]: [102-1] 2020-09-14 14:14:06: pid 25725: DEBUG: authenticate backend: key data received Sep 14 14:14:06 proxy1 pgpool[25725]: [102-2] 2020-09-14 14:14:06: pid 25725: LOCATION: pool_auth.c:251 Sep 14 14:14:06 proxy1 pgpool[25725]: [103-1] 2020-09-14 14:14:06: pid 25725: DEBUG: authenticate backend: transaction state: I Sep 14 14:14:06 proxy1 pgpool[25725]: [103-2] 2020-09-14 14:14:06: pid 25725: LOCATION: pool_auth.c:284 Sep 14 14:14:06 proxy1 pgpool[25725]: [104-1] 2020-09-14 14:14:06: pid 25725: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25725]: [104-2] 2020-09-14 14:14:06: pid 25725: LOCATION: health_check.c:311 Sep 14 14:14:06 proxy1 pgpool[25725]: [105-1] 2020-09-14 14:14:06: pid 25725: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25725]: [105-2] 2020-09-14 14:14:06: pid 25725: LOCATION: health_check.c:311 Sep 14 14:14:06 proxy1 pgpool[25724]: [101-1] 2020-09-14 14:14:06: pid 25724: DEBUG: authenticate kind = 5 Sep 14 14:14:06 proxy1 pgpool[25724]: [101-2] 2020-09-14 14:14:06: pid 25724: LOCATION: pool_auth.c:141 Sep 14 14:14:06 proxy1 pgpool[25724]: [102-1] 2020-09-14 14:14:06: pid 25724: DEBUG: authenticate backend: key data received Sep 14 14:14:06 proxy1 pgpool[25724]: [102-2] 2020-09-14 14:14:06: pid 25724: LOCATION: pool_auth.c:251 Sep 14 14:14:06 proxy1 pgpool[25724]: [103-1] 2020-09-14 14:14:06: pid 25724: DEBUG: authenticate backend: transaction state: I Sep 14 14:14:06 proxy1 pgpool[25724]: [103-2] 2020-09-14 14:14:06: pid 25724: LOCATION: pool_auth.c:284 Sep 14 14:14:06 proxy1 pgpool[25724]: [104-1] 2020-09-14 14:14:06: pid 25724: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25724]: [104-2] 2020-09-14 14:14:06: pid 25724: LOCATION: health_check.c:311 Sep 14 14:14:06 proxy1 pgpool[25724]: [105-1] 2020-09-14 14:14:06: pid 25724: DEBUG: health check: clearing alarm Sep 14 14:14:06 proxy1 pgpool[25724]: [105-2] 2020-09-14 14:14:06: pid 25724: LOCATION: health_check.c:311 Sep 14 14:14:07 proxy1 pgpool[25647]: [161-1] 2020-09-14 14:14:07: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:07 proxy1 pgpool[25647]: [161-2] 2020-09-14 14:14:07: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:07 proxy1 pgpool[25649]: [161-1] 2020-09-14 14:14:07: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:07 proxy1 pgpool[25649]: [161-2] 2020-09-14 14:14:07: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:07 proxy1 pgpool[25648]: [160-1] 2020-09-14 14:14:07: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:07 proxy1 pgpool[25648]: [160-2] 2020-09-14 14:14:07: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:08 proxy1 pgpool[25646]: [160-1] 2020-09-14 14:14:08: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:08 proxy1 pgpool[25646]: [160-2] 2020-09-14 14:14:08: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:09 proxy1 pgpool[25647]: [162-1] 2020-09-14 14:14:09: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:09 proxy1 pgpool[25647]: [162-2] 2020-09-14 14:14:09: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:09 proxy1 pgpool[25649]: [162-1] 2020-09-14 14:14:09: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:09 proxy1 pgpool[25649]: [162-2] 2020-09-14 14:14:09: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:09 proxy1 pgpool[25648]: [161-1] 2020-09-14 14:14:09: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:09 proxy1 pgpool[25648]: [161-2] 2020-09-14 14:14:09: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:10 proxy1 pgpool[25646]: [161-1] 2020-09-14 14:14:10: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:10 proxy1 pgpool[25646]: [161-2] 2020-09-14 14:14:10: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:10 proxy1 pgpool[25615]: [175-1] 2020-09-14 14:14:10: pid 25615: DEBUG: Lifecheck child reaper handler Sep 14 14:14:10 proxy1 pgpool[25615]: [175-2] 2020-09-14 14:14:10: pid 25615: LOCATION: wd_lifecheck.c:157 Sep 14 14:14:10 proxy1 pgpool[25611]: ping: 1.1.1.1: Name or service not known Sep 14 14:14:10 proxy1 pgpool[25615]: [176-1] 2020-09-14 14:14:10: pid 25615: WARNING: watchdog failed to ping host" 1.1.1.1" Sep 14 14:14:10 proxy1 pgpool[25615]: [176-2] 2020-09-14 14:14:10: pid 25615: DETAIL: ping process exits with code: 2 Sep 14 14:14:10 proxy1 pgpool[25615]: [176-3] 2020-09-14 14:14:10: pid 25615: LOCATION: wd_ping.c:173 Sep 14 14:14:11 proxy1 pgpool[25647]: [163-1] 2020-09-14 14:14:11: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:11 proxy1 pgpool[25647]: [163-2] 2020-09-14 14:14:11: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:11 proxy1 pgpool[25649]: [163-1] 2020-09-14 14:14:11: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:11 proxy1 pgpool[25649]: [163-2] 2020-09-14 14:14:11: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:11 proxy1 pgpool[25648]: [162-1] 2020-09-14 14:14:11: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:11 proxy1 pgpool[25648]: [162-2] 2020-09-14 14:14:11: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:12 proxy1 pgpool[25614]: [683-1] 2020-09-14 14:14:12: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = TIMEOUT Current State = MASTER Sep 14 14:14:12 proxy1 pgpool[25614]: [683-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:12 proxy1 pgpool[25614]: [684-1] 2020-09-14 14:14:12: pid 25614: DEBUG: sending packet, watchdog node:[pgpool2:5432 Linux proxy2] command id:[40] type:[IAM COORDINATOR] state:[MASTER] Sep 14 14:14:12 proxy1 pgpool[25614]: [684-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:12 proxy1 pgpool[25614]: [685-1] 2020-09-14 14:14:12: pid 25614: DEBUG: sending watchdog packet to socket:10, type:[M], command ID:40, data Length:118 Sep 14 14:14:12 proxy1 pgpool[25614]: [685-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3385 Sep 14 14:14:12 proxy1 pgpool[25614]: [686-1] 2020-09-14 14:14:12: pid 25614: DEBUG: sending packet, watchdog node:[pgpool3:5432 Linux proxy3] command id:[40] type:[IAM COORDINATOR] state:[MASTER] Sep 14 14:14:12 proxy1 pgpool[25614]: [686-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:12 proxy1 pgpool[25614]: [687-1] 2020-09-14 14:14:12: pid 25614: DEBUG: sending watchdog packet to socket:11, type:[M], command ID:40, data Length:118 Sep 14 14:14:12 proxy1 pgpool[25614]: [687-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3385 Sep 14 14:14:12 proxy1 pgpool[25614]: [688-1] 2020-09-14 14:14:12: pid 25614: DEBUG: received watchdog packet type:I Sep 14 14:14:12 proxy1 pgpool[25614]: [688-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3034 Sep 14 14:14:12 proxy1 pgpool[25614]: [689-1] 2020-09-14 14:14:12: pid 25614: DEBUG: reading packet type I of length 323 Sep 14 14:14:12 proxy1 pgpool[25614]: [689-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3066 Sep 14 14:14:12 proxy1 pgpool[25614]: [690-1] 2020-09-14 14:14:12: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = MASTER Sep 14 14:14:12 proxy1 pgpool[25614]: [690-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:12 proxy1 pgpool[25614]: [691-1] 2020-09-14 14:14:12: pid 25614: DEBUG: received packet, watchdog node:[pgpool2:5432 Linux proxy2] command id:[40] type:[NODE INFO] state:[MASTER] Sep 14 14:14:12 proxy1 pgpool[25614]: [691-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:12 proxy1 pgpool[25614]: [692-1] 2020-09-14 14:14:12: pid 25614: DEBUG: packet I with command ID 40 is reply to the command M Sep 14 14:14:12 proxy1 pgpool[25614]: [692-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3669 Sep 14 14:14:12 proxy1 pgpool[25614]: [693-1] 2020-09-14 14:14:12: pid 25614: DEBUG: Watchdog node "pgpool2:5432 Linux proxy2" has replied for command id 40 Sep 14 14:14:12 proxy1 pgpool[25614]: [693-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:4579 Sep 14 14:14:12 proxy1 pgpool[25614]: [694-1] 2020-09-14 14:14:12: pid 25614: DEBUG: received watchdog packet type:I Sep 14 14:14:12 proxy1 pgpool[25614]: [694-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3034 Sep 14 14:14:12 proxy1 pgpool[25614]: [695-1] 2020-09-14 14:14:12: pid 25614: DEBUG: reading packet type I of length 323 Sep 14 14:14:12 proxy1 pgpool[25614]: [695-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3066 Sep 14 14:14:12 proxy1 pgpool[25614]: [696-1] 2020-09-14 14:14:12: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = MASTER Sep 14 14:14:12 proxy1 pgpool[25614]: [696-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:12 proxy1 pgpool[25614]: [697-1] 2020-09-14 14:14:12: pid 25614: DEBUG: received packet, watchdog node:[pgpool3:5432 Linux proxy3] command id:[40] type:[NODE INFO] state:[MASTER] Sep 14 14:14:12 proxy1 pgpool[25614]: [697-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:12 proxy1 pgpool[25614]: [698-1] 2020-09-14 14:14:12: pid 25614: DEBUG: packet I with command ID 40 is reply to the command M Sep 14 14:14:12 proxy1 pgpool[25614]: [698-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:3669 Sep 14 14:14:12 proxy1 pgpool[25614]: [699-1] 2020-09-14 14:14:12: pid 25614: DEBUG: Watchdog node "pgpool3:5432 Linux proxy3" has replied for command id 40 Sep 14 14:14:12 proxy1 pgpool[25614]: [699-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:4579 Sep 14 14:14:12 proxy1 pgpool[25614]: [700-1] 2020-09-14 14:14:12: pid 25614: DEBUG: command I with command id 40 is finished with COMMAND_FINISHED_ALL_REPLIED Sep 14 14:14:12 proxy1 pgpool[25614]: [700-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:4596 Sep 14 14:14:12 proxy1 pgpool[25614]: [701-1] 2020-09-14 14:14:12: pid 25614: DEBUG: STATE MACHINE INVOKED WITH EVENT = COMMAND FINISHED Current State = MASTER Sep 14 14:14:12 proxy1 pgpool[25614]: [701-2] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:5127 Sep 14 14:14:12 proxy1 pgpool[25614]: [702-1] 2020-09-14 14:14:12: pid 25614: DEBUG: I am the cluster leader node command finished with status:[ALL NODES REPLIED] Sep 14 14:14:12 proxy1 pgpool[25614]: [702-2] 2020-09-14 14:14:12: pid 25614: DETAIL: The command was sent to 2 nodes and 2 nodes replied to it Sep 14 14:14:12 proxy1 pgpool[25614]: [702-3] 2020-09-14 14:14:12: pid 25614: LOCATION: watchdog.c:5796 Sep 14 14:14:12 proxy1 pgpool[25646]: [162-1] 2020-09-14 14:14:12: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:12 proxy1 pgpool[25646]: [162-2] 2020-09-14 14:14:12: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:12 proxy1 pgpool[25615]: [177-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog ping process for host "1.0.0.1" exited successfully Sep 14 14:14:12 proxy1 pgpool[25615]: [177-2] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_ping.c:182 Sep 14 14:14:12 proxy1 pgpool[25615]: [178-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog ping Sep 14 14:14:12 proxy1 pgpool[25615]: [178-2] 2020-09-14 14:14:12: pid 25615: DETAIL: ping data: PING 1.0.0.1 (1.0.0.1) 56(84) bytes of data. Sep 14 14:14:12 proxy1 pgpool[25615]: [178-3] #011 Sep 14 14:14:12 proxy1 pgpool[25615]: [178-4] #011--- 1.0.0.1 ping statistics --- Sep 14 14:14:12 proxy1 pgpool[25615]: [178-5] #0113 packets transmitted, 3 received, 0% packet loss, time 5ms Sep 14 14:14:12 proxy1 pgpool[25615]: [178-6] #011rtt min/avg/max/mdev = 5.485/5.644/5.735/0.112 ms Sep 14 14:14:12 proxy1 pgpool[25615]: [178-7] #011 Sep 14 14:14:12 proxy1 pgpool[25615]: [178-8] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_ping.c:225 Sep 14 14:14:12 proxy1 pgpool[25615]: [179-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog succeeded to ping a host "1.0.0.1" Sep 14 14:14:12 proxy1 pgpool[25615]: [179-2] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_ping.c:194 Sep 14 14:14:12 proxy1 pgpool[25615]: [180-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog life checking by heartbeat Sep 14 14:14:12 proxy1 pgpool[25615]: [180-2] 2020-09-14 14:14:12: pid 25615: DETAIL: checking pgpool 1 (pgpool2:5432) Sep 14 14:14:12 proxy1 pgpool[25615]: [180-3] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_lifecheck.c:781 Sep 14 14:14:12 proxy1 pgpool[25615]: [181-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog checking if pgpool is alive using heartbeat Sep 14 14:14:12 proxy1 pgpool[25615]: [181-2] 2020-09-14 14:14:12: pid 25615: DETAIL: the last heartbeat from "pgpool2:5432" received 1 seconds ago Sep 14 14:14:12 proxy1 pgpool[25615]: [181-3] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_lifecheck.c:986 Sep 14 14:14:12 proxy1 pgpool[25615]: [182-1] 2020-09-14 14:14:12: pid 25615: DEBUG: checking pgpool status by heartbeat Sep 14 14:14:12 proxy1 pgpool[25615]: [182-2] 2020-09-14 14:14:12: pid 25615: DETAIL: OK; status OK Sep 14 14:14:12 proxy1 pgpool[25615]: [182-3] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_lifecheck.c:800 Sep 14 14:14:12 proxy1 pgpool[25615]: [183-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog life checking by heartbeat Sep 14 14:14:12 proxy1 pgpool[25615]: [183-2] 2020-09-14 14:14:12: pid 25615: DETAIL: checking pgpool 2 (pgpool3:5432) Sep 14 14:14:12 proxy1 pgpool[25615]: [183-3] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_lifecheck.c:781 Sep 14 14:14:12 proxy1 pgpool[25615]: [184-1] 2020-09-14 14:14:12: pid 25615: DEBUG: watchdog checking if pgpool is alive using heartbeat Sep 14 14:14:12 proxy1 pgpool[25615]: [184-2] 2020-09-14 14:14:12: pid 25615: DETAIL: the last heartbeat from "pgpool3:5432" received 0 seconds ago Sep 14 14:14:12 proxy1 pgpool[25615]: [184-3] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_lifecheck.c:986 Sep 14 14:14:12 proxy1 pgpool[25615]: [185-1] 2020-09-14 14:14:12: pid 25615: DEBUG: checking pgpool status by heartbeat Sep 14 14:14:12 proxy1 pgpool[25615]: [185-2] 2020-09-14 14:14:12: pid 25615: DETAIL: OK; status OK Sep 14 14:14:12 proxy1 pgpool[25615]: [185-3] 2020-09-14 14:14:12: pid 25615: LOCATION: wd_lifecheck.c:800 Sep 14 14:14:13 proxy1 pgpool[25647]: [164-1] 2020-09-14 14:14:13: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:13 proxy1 pgpool[25647]: [164-2] 2020-09-14 14:14:13: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:13 proxy1 pgpool[25649]: [164-1] 2020-09-14 14:14:13: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:13 proxy1 pgpool[25649]: [164-2] 2020-09-14 14:14:13: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:13 proxy1 pgpool[25648]: [163-1] 2020-09-14 14:14:13: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:13 proxy1 pgpool[25648]: [163-2] 2020-09-14 14:14:13: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:14 proxy1 pgpool[25646]: [163-1] 2020-09-14 14:14:14: pid 25646: DEBUG: received heartbeat signal from "192.168.172.33(pgpool3):5432" node:Not_Set Sep 14 14:14:14 proxy1 pgpool[25646]: [163-2] 2020-09-14 14:14:14: pid 25646: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:15 proxy1 pgpool[25647]: [165-1] 2020-09-14 14:14:15: pid 25647: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool2:9694 Sep 14 14:14:15 proxy1 pgpool[25647]: [165-2] 2020-09-14 14:14:15: pid 25647: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:15 proxy1 pgpool[25649]: [165-1] 2020-09-14 14:14:15: pid 25649: DEBUG: watchdog heartbeat: send heartbeat signal to pgpool3:9694 Sep 14 14:14:15 proxy1 pgpool[25649]: [165-2] 2020-09-14 14:14:15: pid 25649: LOCATION: wd_heartbeat.c:569 Sep 14 14:14:15 proxy1 pgpool[25648]: [164-1] 2020-09-14 14:14:15: pid 25648: DEBUG: received heartbeat signal from "192.168.172.32(pgpool2):5432" node:pgpool2:5432 Linux proxy2 Sep 14 14:14:15 proxy1 pgpool[25648]: [164-2] 2020-09-14 14:14:15: pid 25648: LOCATION: wd_heartbeat.c:457 Sep 14 14:14:16 proxy1 pgpool[25614]: [703-1] 2020-09-14 14:14:16: pid 25614: LOG: Watchdog is shutting down Sep 14 14:14:16 proxy1 pgpool[25614]: [703-2] 2020-09-14 14:14:16: pid 25614: LOCATION: watchdog.c:3162 Sep 14 14:14:16 proxy1 pgpool[25614]: [704-1] 2020-09-14 14:14:16: pid 25614: DEBUG: sending packet, watchdog node:[pgpool2:5432 Linux proxy2] command id:[41] type:[INFORM I AM GOING DOWN] state:[MASTER] Sep 14 14:14:16 proxy1 pgpool[25614]: [704-2] 2020-09-14 14:14:16: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:16 proxy1 pgpool[25614]: [705-1] 2020-09-14 14:14:16: pid 25614: DEBUG: sending watchdog packet to socket:10, type:[X], command ID:41, data Length:0 Sep 14 14:14:16 proxy1 pgpool[25614]: [705-2] 2020-09-14 14:14:16: pid 25614: LOCATION: watchdog.c:3385 Sep 14 14:14:16 proxy1 pgpool[25614]: [706-1] 2020-09-14 14:14:16: pid 25614: DEBUG: sending packet, watchdog node:[pgpool3:5432 Linux proxy3] command id:[41] type:[INFORM I AM GOING DOWN] state:[MASTER] Sep 14 14:14:16 proxy1 pgpool[25614]: [706-2] 2020-09-14 14:14:16: pid 25614: LOCATION: watchdog.c:7522 Sep 14 14:14:16 proxy1 pgpool[25614]: [707-1] 2020-09-14 14:14:16: pid 25614: DEBUG: sending watchdog packet to socket:11, type:[X], command ID:41, data Length:0 Sep 14 14:14:16 proxy1 pgpool[25614]: [707-2] 2020-09-14 14:14:16: pid 25614: LOCATION: watchdog.c:3385 Sep 14 14:14:16 proxy1 pgpool[25615]: [186-1] 2020-09-14 14:14:16: pid 25615: DEBUG: lifecheck child receives shutdown request signal 2, forwarding to all children Sep 14 14:14:16 proxy1 pgpool[25615]: [186-2] 2020-09-14 14:14:16: pid 25615: LOCATION: wd_lifecheck.c:287 Sep 14 14:14:16 proxy1 pgpool[25615]: [187-1] 2020-09-14 14:14:16: pid 25615: DEBUG: lifecheck child receives fast shutdown request Sep 14 14:14:16 proxy1 pgpool[25615]: [187-2] 2020-09-14 14:14:16: pid 25615: LOCATION: wd_lifecheck.c:297 Sep 14 14:14:16 proxy1 pgpool[25646]: [164-1] 2020-09-14 14:14:16: pid 25646: DEBUG: watchdog heartbeat receiver child receives shutdown request signal 2 Sep 14 14:14:16 proxy1 pgpool[25646]: [164-2] 2020-09-14 14:14:16: pid 25646: LOCATION: wd_heartbeat.c:604 Sep 14 14:14:16 proxy1 pgpool[25647]: [166-1] 2020-09-14 14:14:16: pid 25647: DEBUG: watchdog heartbeat sender child receives shutdown request signal 2 Sep 14 14:14:16 proxy1 pgpool[25647]: [166-2] 2020-09-14 14:14:16: pid 25647: LOCATION: wd_heartbeat.c:585 Sep 14 14:14:16 proxy1 pgpool[25648]: [165-1] 2020-09-14 14:14:16: pid 25648: DEBUG: watchdog heartbeat receiver child receives shutdown request signal 2 Sep 14 14:14:16 proxy1 pgpool[25648]: [165-2] 2020-09-14 14:14:16: pid 25648: LOCATION: wd_heartbeat.c:604 Sep 14 14:14:16 proxy1 pgpool[25649]: [166-1] 2020-09-14 14:14:16: pid 25649: DEBUG: watchdog heartbeat sender child receives shutdown request signal 2 Sep 14 14:14:16 proxy1 pgpool[25649]: [166-2] 2020-09-14 14:14:16: pid 25649: LOCATION: wd_heartbeat.c:585 Sep 14 14:14:16 proxy1 systemd[1]: Stopping pgpool-II... Sep 14 14:14:16 proxy1 systemd[1]: pgpool2.service: Succeeded. Sep 14 14:14:16 proxy1 systemd[1]: Stopped pgpool-II.