2023-10-26 11:39:19: pid 762010: LOG: health_check_stats_shared_memory_size: requested size: 12288 2023-10-26 11:39:19: pid 762010: LOCATION: health_check.c:541 2023-10-26 11:39:19: pid 762010: LOG: memory cache initialized 2023-10-26 11:39:19: pid 762010: DETAIL: memcache blocks :64 2023-10-26 11:39:19: pid 762010: LOCATION: pool_memqcache.c:2061 2023-10-26 11:39:19: pid 762010: LOG: allocating (138460248) bytes of shared memory segment 2023-10-26 11:39:19: pid 762010: LOCATION: pgpool_main.c:3024 2023-10-26 11:39:19: pid 762010: LOG: allocating shared memory segment of size: 138460248 2023-10-26 11:39:19: pid 762010: LOCATION: pool_shmem.c:61 2023-10-26 11:39:19: pid 762010: LOG: health_check_stats_shared_memory_size: requested size: 12288 2023-10-26 11:39:19: pid 762010: LOCATION: health_check.c:541 2023-10-26 11:39:19: pid 762010: LOG: health_check_stats_shared_memory_size: requested size: 12288 2023-10-26 11:39:19: pid 762010: LOCATION: health_check.c:541 2023-10-26 11:39:19: pid 762010: LOG: memory cache initialized 2023-10-26 11:39:19: pid 762010: DETAIL: memcache blocks :64 2023-10-26 11:39:19: pid 762010: LOCATION: pool_memqcache.c:2061 2023-10-26 11:39:19: pid 762010: LOG: pool_discard_oid_maps: discarded memqcache oid maps 2023-10-26 11:39:19: pid 762010: LOCATION: pgpool_main.c:3108 2023-10-26 11:39:19: pid 762010: LOG: waiting for watchdog to initialize 2023-10-26 11:39:19: pid 762010: LOCATION: pgpool_main.c:428 2023-10-26 11:39:19: pid 762013: LOG: setting the local watchdog node name to "paqcxast04.aaa.es:9999 Linux paqcxast04.aaa.es" 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:772 2023-10-26 11:39:19: pid 762013: LOG: watchdog cluster is configured with 2 remote nodes 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:782 2023-10-26 11:39:19: pid 762013: LOG: watchdog remote node:0 on paqcxast01.aaa.es:9000 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:799 2023-10-26 11:39:19: pid 762013: LOG: watchdog remote node:1 on paqcxast02.aaa.es:9000 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:799 2023-10-26 11:39:19: pid 762013: LOG: interface monitoring is disabled in watchdog 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:668 2023-10-26 11:39:19: pid 762013: LOG: watchdog node state changed from [DEAD] to [LOADING] 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:19: pid 762013: LOG: new outbound connection to paqcxast02.aaa.es:9000 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:3484 2023-10-26 11:39:19: pid 762013: LOG: new outbound connection to paqcxast01.aaa.es:9000 2023-10-26 11:39:19: pid 762013: LOCATION: watchdog.c:3484 2023-10-26 11:39:24: pid 762013: LOG: new watchdog node connection is received from "10.151.18.82:39534" 2023-10-26 11:39:24: pid 762013: LOCATION: watchdog.c:3405 2023-10-26 11:39:24: pid 762013: LOG: watchdog node state changed from [LOADING] to [JOINING] 2023-10-26 11:39:24: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:24: pid 762013: LOG: new node joined the cluster hostname:"paqcxast02.aaa.es" port:9000 pgpool_port:9999 2023-10-26 11:39:24: pid 762013: DETAIL: Pgpool-II version:"4.4.4" watchdog messaging version: 1.2 2023-10-26 11:39:24: pid 762013: LOCATION: watchdog.c:1663 2023-10-26 11:39:28: pid 762013: LOG: watchdog node state changed from [JOINING] to [INITIALIZING] 2023-10-26 11:39:28: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:28: pid 762013: LOG: new watchdog node connection is received from "10.23.18.111:56407" 2023-10-26 11:39:28: pid 762013: LOCATION: watchdog.c:3405 2023-10-26 11:39:28: pid 762013: LOG: new node joined the cluster hostname:"paqcxast01.aaa.es" port:9000 pgpool_port:9999 2023-10-26 11:39:28: pid 762013: DETAIL: Pgpool-II version:"4.4.4" watchdog messaging version: 1.2 2023-10-26 11:39:28: pid 762013: LOCATION: watchdog.c:1663 2023-10-26 11:39:29: pid 762013: LOG: watchdog node state changed from [INITIALIZING] to [STANDING FOR LEADER] 2023-10-26 11:39:29: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:29: pid 762013: LOG: our stand for coordinator request is rejected by node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" 2023-10-26 11:39:29: pid 762013: DETAIL: we might be in partial network isolation and cluster already have a valid leader 2023-10-26 11:39:29: pid 762013: HINT: please verify the watchdog life-check and network is working properly 2023-10-26 11:39:29: pid 762013: LOCATION: watchdog.c:5919 2023-10-26 11:39:29: pid 762013: LOG: watchdog node state changed from [STANDING FOR LEADER] to [NETWORK ISOLATION] 2023-10-26 11:39:29: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:39: pid 762013: LOG: trying again to join the cluster 2023-10-26 11:39:39: pid 762013: LOCATION: watchdog.c:6514 2023-10-26 11:39:39: pid 762013: LOG: watchdog node state changed from [NETWORK ISOLATION] to [JOINING] 2023-10-26 11:39:39: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:39: pid 762013: LOG: setting the remote node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" as watchdog cluster leader 2023-10-26 11:39:39: pid 762013: LOCATION: watchdog.c:7966 2023-10-26 11:39:39: pid 762013: LOG: watchdog node state changed from [JOINING] to [INITIALIZING] 2023-10-26 11:39:39: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:40: pid 762013: LOG: watchdog node state changed from [INITIALIZING] to [STANDBY] 2023-10-26 11:39:40: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:39:40: pid 762013: LOG: signal_user1_to_parent_with_reason(1) 2023-10-26 11:39:40: pid 762013: LOCATION: pgpool_main.c:773 2023-10-26 11:39:40: pid 762013: LOG: successfully joined the watchdog cluster as standby node 2023-10-26 11:39:40: pid 762013: DETAIL: our join coordinator request is accepted by cluster leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:39:40: pid 762013: LOCATION: watchdog.c:6887 2023-10-26 11:39:40: pid 762010: LOG: watchdog process is initialized 2023-10-26 11:39:40: pid 762010: DETAIL: watchdog messaging data version: 1.2 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:443 2023-10-26 11:39:40: pid 762010: LOG: Pgpool-II parent process received SIGUSR1 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:1417 2023-10-26 11:39:40: pid 762010: LOG: Pgpool-II parent process received watchdog state change signal from watchdog 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:1461 2023-10-26 11:39:40: pid 762099: LOG: 3 watchdog nodes are configured for lifecheck 2023-10-26 11:39:40: pid 762099: LOCATION: wd_lifecheck.c:493 2023-10-26 11:39:40: pid 762099: LOG: watchdog nodes ID:2 Name:"paqcxast04.aaa.es:9999 Linux paqcxast04.aaa.es" 2023-10-26 11:39:40: pid 762099: DETAIL: Host:"paqcxast04.aaa.es" WD Port:9000 pgpool-II port:9999 2023-10-26 11:39:40: pid 762099: LOCATION: wd_lifecheck.c:501 2023-10-26 11:39:40: pid 762099: LOG: watchdog nodes ID:0 Name:"paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:39:40: pid 762099: DETAIL: Host:"paqcxast01.aaa.es" WD Port:9000 pgpool-II port:9999 2023-10-26 11:39:40: pid 762099: LOCATION: wd_lifecheck.c:501 2023-10-26 11:39:40: pid 762099: LOG: watchdog nodes ID:1 Name:"paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" 2023-10-26 11:39:40: pid 762099: DETAIL: Host:"paqcxast02.aaa.es" WD Port:9000 pgpool-II port:9999 2023-10-26 11:39:40: pid 762099: LOCATION: wd_lifecheck.c:501 2023-10-26 11:39:40: pid 762010: LOG: we have joined the watchdog cluster as STANDBY node 2023-10-26 11:39:40: pid 762010: DETAIL: syncing the backend states from the LEADER watchdog node 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:1468 2023-10-26 11:39:40: pid 762013: LOG: received the get data request from local pgpool-II on IPC interface 2023-10-26 11:39:40: pid 762013: LOCATION: watchdog.c:2944 2023-10-26 11:39:40: pid 762013: LOG: get data request from local pgpool-II node received on IPC interface is forwarded to leader watchdog node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:39:40: pid 762013: DETAIL: waiting for the reply... 2023-10-26 11:39:40: pid 762013: LOCATION: watchdog.c:2971 2023-10-26 11:39:40: pid 762010: LOG: leader watchdog node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" returned status for 2 backend nodes 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:3587 2023-10-26 11:39:40: pid 762010: LOG: backend:0 is set to UP status 2023-10-26 11:39:40: pid 762010: DETAIL: backend:0 is UP on cluster leader "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:3629 2023-10-26 11:39:40: pid 762010: LOG: backend:1 is set to UP status 2023-10-26 11:39:40: pid 762010: DETAIL: backend:1 is UP on cluster leader "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:3629 2023-10-26 11:39:40: pid 762010: LOG: unix_socket_directories[0]: /run/pgpool/.s.PGSQL.9999 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:4823 2023-10-26 11:39:40: pid 762010: LOG: listen address[0]: * 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:4855 2023-10-26 11:39:40: pid 762010: LOG: Setting up socket for 0.0.0.0:9999 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:984 2023-10-26 11:39:40: pid 762010: LOG: Setting up socket for :::9999 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:984 2023-10-26 11:39:40: pid 762010: LOG: listen address[0]: * 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:4855 2023-10-26 11:39:40: pid 762010: LOG: Setting up socket for 0.0.0.0:9898 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:984 2023-10-26 11:39:40: pid 762010: LOG: Setting up socket for :::9898 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:984 2023-10-26 11:39:40: pid 762204: LOG: PCP process: 762204 started 2023-10-26 11:39:40: pid 762204: LOCATION: pcp_child.c:160 2023-10-26 11:39:40: pid 762205: LOG: process started 2023-10-26 11:39:40: pid 762205: LOCATION: pgpool_main.c:890 2023-10-26 11:39:40: pid 762206: LOG: process started 2023-10-26 11:39:40: pid 762206: LOCATION: pgpool_main.c:890 2023-10-26 11:39:40: pid 762207: LOG: process started 2023-10-26 11:39:40: pid 762207: LOCATION: pgpool_main.c:890 2023-10-26 11:39:40: pid 762010: LOG: pgpool-II successfully started. version 4.4.4 (nurikoboshi) 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:647 2023-10-26 11:39:40: pid 762010: LOG: node status[0]: 0 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:658 2023-10-26 11:39:40: pid 762010: LOG: node status[1]: 0 2023-10-26 11:39:40: pid 762010: LOCATION: pgpool_main.c:658 2023-10-26 11:39:41: pid 762100: LOG: set SO_REUSEPORT option to the socket 2023-10-26 11:39:41: pid 762100: LOCATION: wd_heartbeat.c:691 2023-10-26 11:39:41: pid 762100: LOG: creating watchdog heartbeat receive socket. 2023-10-26 11:39:41: pid 762100: DETAIL: set SO_REUSEPORT 2023-10-26 11:39:41: pid 762100: LOCATION: wd_heartbeat.c:231 2023-10-26 11:39:41: pid 762102: LOG: set SO_REUSEPORT option to the socket 2023-10-26 11:39:41: pid 762102: LOCATION: wd_heartbeat.c:691 2023-10-26 11:39:41: pid 762102: LOG: creating watchdog heartbeat receive socket. 2023-10-26 11:39:41: pid 762102: DETAIL: set SO_REUSEPORT 2023-10-26 11:39:41: pid 762102: LOCATION: wd_heartbeat.c:231 2023-10-26 11:39:41: pid 762101: LOG: set SO_REUSEPORT option to the socket 2023-10-26 11:39:41: pid 762101: LOCATION: wd_heartbeat.c:691 2023-10-26 11:39:41: pid 762101: LOG: creating socket for sending heartbeat 2023-10-26 11:39:41: pid 762101: DETAIL: set SO_REUSEPORT 2023-10-26 11:39:41: pid 762101: LOCATION: wd_heartbeat.c:148 2023-10-26 11:39:41: pid 762103: LOG: set SO_REUSEPORT option to the socket 2023-10-26 11:39:41: pid 762103: LOCATION: wd_heartbeat.c:691 2023-10-26 11:39:41: pid 762103: LOG: creating socket for sending heartbeat 2023-10-26 11:39:41: pid 762103: DETAIL: set SO_REUSEPORT 2023-10-26 11:39:41: pid 762103: LOCATION: wd_heartbeat.c:148 2023-10-26 11:41:20: pid 762099: LOG: watchdog: lifecheck started 2023-10-26 11:41:20: pid 762099: LOCATION: wd_lifecheck.c:431 2023-10-26 11:49:44: pid 762204: LOG: forked new pcp worker, pid=764686 socket=8 2023-10-26 11:49:44: pid 762204: LOCATION: pcp_child.c:308 2023-10-26 11:49:44: pid 762204: LOG: PCP process with pid: 764686 exit with SUCCESS. 2023-10-26 11:49:44: pid 762204: LOCATION: pcp_child.c:364 2023-10-26 11:49:44: pid 762204: LOG: PCP process with pid: 764686 exits with status 0 2023-10-26 11:49:44: pid 762204: LOCATION: pcp_child.c:378 2023-10-26 11:50:12: pid 762205: LOG: failed to connect to PostgreSQL server on "paqcxast01.aaa.es:5432", timed out 2023-10-26 11:50:12: pid 762205: LOCATION: pool_connection_pool.c:661 2023-10-26 11:50:14: pid 762206: LOG: failed to connect to PostgreSQL server on "paqcxast01.aaa.es:5432", timed out 2023-10-26 11:50:14: pid 762206: LOCATION: pool_connection_pool.c:661 2023-10-26 11:50:14: pid 762206: LOG: health check failed on node 0 (timeout:0) 2023-10-26 11:50:14: pid 762206: LOCATION: health_check.c:218 2023-10-26 11:50:14: pid 762206: LOG: received degenerate backend request for node_id: 0 from pid [762206] 2023-10-26 11:50:14: pid 762206: LOCATION: pool_internal_comms.c:147 2023-10-26 11:50:14: pid 762013: LOG: failover request from local pgpool-II node received on IPC interface is forwarded to leader watchdog node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:14: pid 762013: DETAIL: waiting for the reply... 2023-10-26 11:50:14: pid 762013: LOCATION: watchdog.c:2884 2023-10-26 11:50:17: pid 762205: ERROR: Failed to check replication time lag 2023-10-26 11:50:17: pid 762205: DETAIL: No persistent db connection for the node 0 2023-10-26 11:50:17: pid 762205: HINT: check sr_check_user and sr_check_password 2023-10-26 11:50:17: pid 762205: CONTEXT: while checking replication time lag 2023-10-26 11:50:17: pid 762205: LOCATION: pool_worker_child.c:390 2023-10-26 11:50:17: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:17: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:17: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:18: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:18: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:18: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:18: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:18: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:18: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:18: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:18: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:18: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:19: pid 762013: LOG: We are connected to leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" and another node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" is trying to become a leader 2023-10-26 11:50:19: pid 762013: LOCATION: watchdog.c:6990 2023-10-26 11:50:19: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:19: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:19: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:19: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:19: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:19: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:19: pid 762013: WARNING: we have not received a beacon message from leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:19: pid 762013: DETAIL: requesting info message from leader node 2023-10-26 11:50:19: pid 762013: LOCATION: watchdog.c:7079 2023-10-26 11:50:20: pid 762013: LOG: remote node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" is not replying.. 2023-10-26 11:50:20: pid 762013: DETAIL: marking the node as lost 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:4808 2023-10-26 11:50:20: pid 762013: LOG: remote node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" is lost 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:5450 2023-10-26 11:50:20: pid 762013: LOG: watchdog cluster has lost the coordinator node 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:5457 2023-10-26 11:50:20: pid 762013: LOG: removing the remote node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" from watchdog cluster leader 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:7961 2023-10-26 11:50:20: pid 762013: LOG: We have lost the cluster leader node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:6948 2023-10-26 11:50:20: pid 762013: LOG: watchdog node state changed from [STANDBY] to [JOINING] 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:50:20: pid 762206: LOG: degenerate backend request for 1 node(s) from pid [762206] is canceled by other pgpool 2023-10-26 11:50:20: pid 762206: LOCATION: pool_internal_comms.c:221 2023-10-26 11:50:20: pid 762013: LOG: watchdog node state changed from [JOINING] to [INITIALIZING] 2023-10-26 11:50:20: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:50:21: pid 762013: LOG: watchdog node state changed from [INITIALIZING] to [STANDING FOR LEADER] 2023-10-26 11:50:21: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:50:25: pid 762013: LOG: watchdog node state changed from [STANDING FOR LEADER] to [LEADER] 2023-10-26 11:50:25: pid 762013: LOCATION: watchdog.c:7227 2023-10-26 11:50:25: pid 762013: LOG: Setting failover command timeout to 5 2023-10-26 11:50:25: pid 762013: LOCATION: watchdog.c:8203 2023-10-26 11:50:25: pid 762013: LOG: I am announcing my self as leader/coordinator watchdog node 2023-10-26 11:50:25: pid 762013: LOCATION: watchdog.c:6027 2023-10-26 11:50:27: pid 762205: LOG: failed to connect to PostgreSQL server on "paqcxast01.aaa.es:5432", timed out 2023-10-26 11:50:27: pid 762205: LOCATION: pool_connection_pool.c:661 2023-10-26 11:50:29: pid 762013: LOG: I am the cluster leader node 2023-10-26 11:50:29: pid 762013: DETAIL: our declare coordinator message is accepted by all nodes 2023-10-26 11:50:29: pid 762013: LOCATION: watchdog.c:6067 2023-10-26 11:50:29: pid 762013: LOG: setting the local node "paqcxast04.aaa.es:9999 Linux paqcxast04.aaa.es" as watchdog cluster leader 2023-10-26 11:50:29: pid 762013: LOCATION: watchdog.c:7966 2023-10-26 11:50:29: pid 762013: LOG: signal_user1_to_parent_with_reason(1) 2023-10-26 11:50:29: pid 762013: LOCATION: pgpool_main.c:773 2023-10-26 11:50:29: pid 762013: LOG: I am the cluster leader node but we do not have enough nodes in cluster 2023-10-26 11:50:29: pid 762013: DETAIL: waiting for the quorum to start escalation process 2023-10-26 11:50:29: pid 762013: LOCATION: watchdog.c:6081 2023-10-26 11:50:29: pid 762010: LOG: Pgpool-II parent process received SIGUSR1 2023-10-26 11:50:29: pid 762010: LOCATION: pgpool_main.c:1417 2023-10-26 11:50:29: pid 762010: LOG: Pgpool-II parent process received watchdog state change signal from watchdog 2023-10-26 11:50:29: pid 762010: LOCATION: pgpool_main.c:1461 2023-10-26 11:50:30: pid 762013: LOG: adding watchdog node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" to the standby list 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:8063 2023-10-26 11:50:30: pid 762013: LOG: quorum found 2023-10-26 11:50:30: pid 762013: DETAIL: starting escalation process 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:6161 2023-10-26 11:50:30: pid 762013: LOG: escalation process started with PID:764748 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:6742 2023-10-26 11:50:30: pid 764748: LOG: watchdog: escalation started 2023-10-26 11:50:30: pid 764748: LOCATION: wd_escalation.c:94 2023-10-26 11:50:30: pid 762013: LOG: signal_user1_to_parent_with_reason(3) 2023-10-26 11:50:30: pid 762013: LOCATION: pgpool_main.c:773 2023-10-26 11:50:30: pid 762010: LOG: Pgpool-II parent process received SIGUSR1 2023-10-26 11:50:30: pid 762010: LOCATION: pgpool_main.c:1417 2023-10-26 11:50:30: pid 762010: LOG: Pgpool-II parent process received watchdog quorum change signal from watchdog 2023-10-26 11:50:30: pid 762010: LOCATION: pgpool_main.c:1422 2023-10-26 11:50:30: pid 762013: LOG: Setting failover command timeout to 5 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:8203 2023-10-26 11:50:30: pid 762010: LOG: watchdog cluster now holds the quorum 2023-10-26 11:50:30: pid 762010: DETAIL: updating the state of quarantine backend nodes 2023-10-26 11:50:30: pid 762010: LOCATION: pgpool_main.c:1429 sh: /etc/pgpool-II/escalation.sh: Permission denied 2023-10-26 11:50:30: pid 764748: WARNING: watchdog escalation command failed with exit status: 126 2023-10-26 11:50:30: pid 764748: LOCATION: wd_escalation.c:124 2023-10-26 11:50:30: pid 762013: LOG: watchdog escalation process with pid: 764748 exit with SUCCESS. 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:3269 2023-10-26 11:50:30: pid 762099: LOG: informing the node status change to watchdog 2023-10-26 11:50:30: pid 762099: DETAIL: node id :0 status = "NODE DEAD" message:"No heartbeat signal from node" 2023-10-26 11:50:30: pid 762099: LOCATION: wd_lifecheck.c:529 2023-10-26 11:50:30: pid 762013: LOG: received node status change ipc message 2023-10-26 11:50:30: pid 762013: DETAIL: No heartbeat signal from node 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:2274 2023-10-26 11:50:30: pid 762013: LOG: remote node "paqcxast01.aaa.es:9999 Linux paqcxast01.aaa.es" is lost 2023-10-26 11:50:30: pid 762013: LOCATION: watchdog.c:5450 2023-10-26 11:50:32: pid 762205: ERROR: Failed to check replication time lag 2023-10-26 11:50:32: pid 762205: DETAIL: No persistent db connection for the node 0 2023-10-26 11:50:32: pid 762205: HINT: check sr_check_user and sr_check_password 2023-10-26 11:50:32: pid 762205: CONTEXT: while checking replication time lag 2023-10-26 11:50:32: pid 762205: LOCATION: pool_worker_child.c:390 2023-10-26 11:50:33: pid 762013: LOG: watchdog received the failover command from remote pgpool-II node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" 2023-10-26 11:50:33: pid 762013: LOCATION: watchdog.c:2525 2023-10-26 11:50:33: pid 762013: LOG: watchdog is processing the failover command [DEGENERATE_BACKEND_REQUEST] received from paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es 2023-10-26 11:50:33: pid 762013: LOCATION: watchdog.c:2778 2023-10-26 11:50:33: pid 762013: LOG: failover requires the majority vote, waiting for consensus 2023-10-26 11:50:33: pid 762013: DETAIL: failover request noted 2023-10-26 11:50:33: pid 762013: LOCATION: watchdog.c:2639 2023-10-26 11:50:33: pid 762013: LOG: failover command [DEGENERATE_BACKEND_REQUEST] request from pgpool-II node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" is queued, waiting for the confirmation from other nodes 2023-10-26 11:50:33: pid 762013: LOCATION: watchdog.c:2832 2023-10-26 11:50:33: pid 762013: LOG: signal_user1_to_parent_with_reason(4) 2023-10-26 11:50:33: pid 762013: LOCATION: pgpool_main.c:773 2023-10-26 11:50:33: pid 762010: LOG: Pgpool-II parent process received SIGUSR1 2023-10-26 11:50:33: pid 762010: LOCATION: pgpool_main.c:1417 2023-10-26 11:50:33: pid 762010: LOG: Pgpool-II parent process received inform quarantine nodes signal from watchdog 2023-10-26 11:50:33: pid 762010: LOCATION: pgpool_main.c:1437 2023-10-26 11:50:35: pid 762206: LOG: failed to connect to PostgreSQL server on "paqcxast01.aaa.es:5432", timed out 2023-10-26 11:50:35: pid 762206: LOCATION: pool_connection_pool.c:661 2023-10-26 11:50:35: pid 762206: LOG: health check failed on node 0 (timeout:0) 2023-10-26 11:50:35: pid 762206: LOCATION: health_check.c:218 2023-10-26 11:50:35: pid 762206: LOG: received degenerate backend request for node_id: 0 from pid [762206] 2023-10-26 11:50:35: pid 762206: LOCATION: pool_internal_comms.c:147 2023-10-26 11:50:35: pid 762013: LOG: watchdog received the failover command from local pgpool-II on IPC interface 2023-10-26 11:50:35: pid 762013: LOCATION: watchdog.c:2857 2023-10-26 11:50:35: pid 762013: LOG: watchdog is processing the failover command [DEGENERATE_BACKEND_REQUEST] received from local pgpool-II on IPC interface 2023-10-26 11:50:35: pid 762013: LOCATION: watchdog.c:2778 2023-10-26 11:50:35: pid 762013: LOG: we have got the consensus to perform the failover 2023-10-26 11:50:35: pid 762013: DETAIL: 2 node(s) voted in the favor 2023-10-26 11:50:35: pid 762013: LOCATION: watchdog.c:2650 2023-10-26 11:50:35: pid 762206: LOG: signal_user1_to_parent_with_reason(0) 2023-10-26 11:50:35: pid 762206: LOCATION: pgpool_main.c:773 2023-10-26 11:50:35: pid 762010: LOG: Pgpool-II parent process received SIGUSR1 2023-10-26 11:50:35: pid 762010: LOCATION: pgpool_main.c:1417 2023-10-26 11:50:35: pid 762010: LOG: Pgpool-II parent process has received failover request 2023-10-26 11:50:35: pid 762010: LOCATION: pgpool_main.c:1482 2023-10-26 11:50:35: pid 762013: LOG: received the failover indication from Pgpool-II on IPC interface 2023-10-26 11:50:35: pid 762013: LOCATION: watchdog.c:3003 2023-10-26 11:50:35: pid 762013: LOG: watchdog is informed of failover start by the main process 2023-10-26 11:50:35: pid 762013: LOCATION: watchdog.c:3077 2023-10-26 11:50:35: pid 762010: LOG: === Starting degeneration. shutdown host paqcxast01.aaa.es(5432) === 2023-10-26 11:50:35: pid 762010: LOCATION: pgpool_main.c:4205 2023-10-26 11:50:35: pid 762010: LOG: Restart all children 2023-10-26 11:50:35: pid 762010: LOCATION: pgpool_main.c:4368 2023-10-26 11:50:35: pid 762010: LOG: execute command: /etc/pgpool-II/failover.sh 0 paqcxast01.aaa.es 5432 /var/lib/pgsql/data 1 paqcxast02.aaa.es 0 0 5432 /var/lib/pgsql/data paqcxast01.aaa.es 5432 2023-10-26 11:50:35: pid 762010: LOCATION: pgpool_main.c:2407 sh: /etc/pgpool-II/failover.sh: Permission denied 2023-10-26 11:50:35: pid 762010: LOG: find_primary_node_repeatedly: waiting for finding a primary node 2023-10-26 11:50:35: pid 762010: LOCATION: pgpool_main.c:2865 2023-10-26 11:50:42: pid 762205: LOG: failed to connect to PostgreSQL server on "paqcxast01.aaa.es:5432", timed out 2023-10-26 11:50:42: pid 762205: LOCATION: pool_connection_pool.c:661 2023-10-26 11:50:43: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:43: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:43: pid 762010: LOG: reaper handler 2023-10-26 11:50:43: pid 762010: LOCATION: pgpool_main.c:1830 2023-10-26 11:50:44: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:44: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:45: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:45: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:46: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:46: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:47: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:47: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:48: pid 762013: LOG: watchdog received the failover command from remote pgpool-II node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" 2023-10-26 11:50:48: pid 762013: LOCATION: watchdog.c:2525 2023-10-26 11:50:48: pid 762013: LOG: watchdog is processing the failover command [DEGENERATE_BACKEND_REQUEST] received from paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es 2023-10-26 11:50:48: pid 762013: LOCATION: watchdog.c:2778 2023-10-26 11:50:48: pid 762013: LOG: failover requires the majority vote, waiting for consensus 2023-10-26 11:50:48: pid 762013: DETAIL: failover request noted 2023-10-26 11:50:48: pid 762013: LOCATION: watchdog.c:2639 2023-10-26 11:50:48: pid 762013: LOG: failover command [DEGENERATE_BACKEND_REQUEST] request from pgpool-II node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" is queued, waiting for the confirmation from other nodes 2023-10-26 11:50:48: pid 762013: LOCATION: watchdog.c:2832 2023-10-26 11:50:48: pid 762013: LOG: signal_user1_to_parent_with_reason(4) 2023-10-26 11:50:48: pid 762013: LOCATION: pgpool_main.c:773 2023-10-26 11:50:48: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:48: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:48: pid 762010: LOG: Pgpool-II parent process received SIGUSR1 2023-10-26 11:50:48: pid 762010: LOCATION: pgpool_main.c:1417 2023-10-26 11:50:48: pid 762010: LOG: Pgpool-II parent process received inform quarantine nodes signal from watchdog 2023-10-26 11:50:48: pid 762010: LOCATION: pgpool_main.c:1437 2023-10-26 11:50:48: pid 762010: LOG: reaper handler 2023-10-26 11:50:48: pid 762010: LOCATION: pgpool_main.c:1830 2023-10-26 11:50:49: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:49: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:50: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:50: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:51: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:51: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:52: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:52: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:53: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:53: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:54: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:54: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:55: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:55: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:56: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:56: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:57: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:57: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:58: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:58: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:50:59: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:50:59: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:00: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:00: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:01: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:01: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:02: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:02: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:03: pid 762013: LOG: watchdog received the failover command from remote pgpool-II node "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" 2023-10-26 11:51:03: pid 762013: LOCATION: watchdog.c:2525 2023-10-26 11:51:03: pid 762013: LOG: watchdog is processing the failover command [DEGENERATE_BACKEND_REQUEST] received from paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es 2023-10-26 11:51:03: pid 762013: LOCATION: watchdog.c:2778 2023-10-26 11:51:03: pid 762013: LOG: Duplicate failover request from "paqcxast02.aaa.es:9999 Linux paqcxast02.aaa.es" node 2023-10-26 11:51:03: pid 762013: DETAIL: request ignored 2023-10-26 11:51:03: pid 762013: LOCATION: watchdog.c:2702 2023-10-26 11:51:03: pid 762013: LOG: failover requires the majority vote, waiting for consensus 2023-10-26 11:51:03: pid 762013: DETAIL: failover request noted 2023-10-26 11:51:03: pid 762013: LOCATION: watchdog.c:2639 2023-10-26 11:51:03: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:03: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:04: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:04: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:05: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:05: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:06: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:06: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:07: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:07: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:08: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:08: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:09: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:09: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:10: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:10: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:11: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:11: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:12: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:12: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:13: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:13: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:15: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:15: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:16: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:16: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:17: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:17: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:18: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:18: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:19: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:19: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:20: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:20: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:21: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:21: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:22: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:22: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:23: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:23: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:24: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:24: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:25: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:25: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:26: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:26: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:27: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:27: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:28: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:28: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:29: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:29: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:30: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:30: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:31: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:31: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:32: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:32: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:33: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:33: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:34: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:34: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:35: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:35: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:36: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:36: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:37: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:37: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:38: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:38: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:39: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:39: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:40: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:40: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:41: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:41: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:42: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:42: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:43: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:43: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:44: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:44: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:44: pid 762204: LOG: forked new pcp worker, pid=765107 socket=8 2023-10-26 11:51:44: pid 762204: LOCATION: pcp_child.c:308 2023-10-26 11:51:44: pid 762204: LOG: PCP process with pid: 765107 exit with SUCCESS. 2023-10-26 11:51:44: pid 762204: LOCATION: pcp_child.c:364 2023-10-26 11:51:44: pid 762204: LOG: PCP process with pid: 765107 exits with status 0 2023-10-26 11:51:44: pid 762204: LOCATION: pcp_child.c:378 2023-10-26 11:51:45: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:45: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:46: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:46: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:47: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:47: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:48: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:48: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:49: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:49: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:50: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:50: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:51: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:51: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:52: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:52: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:53: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:53: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:54: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:54: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:55: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:55: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:57: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:57: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:58: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:58: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:51:59: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:51:59: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:00: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:00: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:01: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:01: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:02: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:02: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:03: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:03: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:04: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:04: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:05: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:05: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:06: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:06: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:07: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:07: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:08: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:08: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:09: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:09: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:10: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:10: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:11: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:11: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:12: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:12: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:13: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:13: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:14: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:14: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:15: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:15: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:16: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:16: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:17: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:17: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:18: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:18: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:19: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:19: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:20: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:20: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:21: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:21: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:22: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:22: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:23: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:23: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:24: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:24: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:25: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:25: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:26: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:26: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:27: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:27: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:28: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:28: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:29: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:29: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:30: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:30: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:31: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:31: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:32: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:32: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:33: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:33: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:34: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:34: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:35: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:35: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:36: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:36: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:37: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:37: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:39: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:39: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:40: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:40: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:41: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:41: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:42: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:42: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:43: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:43: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:44: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:44: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:45: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:45: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:46: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:46: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:47: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:47: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:48: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:48: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:49: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:49: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:50: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:50: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:51: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:51: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:52: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:52: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:53: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:53: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:54: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:54: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:55: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:55: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:56: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:56: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:57: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:57: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:58: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:58: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:52:59: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:52:59: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:00: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:00: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:01: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:01: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:02: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:02: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:03: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:03: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:04: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:04: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:05: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:05: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:06: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:06: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:07: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:07: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:08: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:08: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:09: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:09: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:10: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:10: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:11: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:11: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:12: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:12: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:13: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:13: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:14: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:14: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:15: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:15: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:16: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:16: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:17: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:17: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:18: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:18: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:19: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:19: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:20: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:20: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:21: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:21: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:23: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:23: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:24: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:24: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:25: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:25: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:26: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:26: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:27: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:27: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:28: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:28: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:29: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:29: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:30: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:30: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:31: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:31: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:32: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:32: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:33: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:33: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:34: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:34: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:35: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:35: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:36: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:36: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:37: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:37: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:38: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:38: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:39: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:39: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:40: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:40: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:41: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:41: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:42: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:42: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:43: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:43: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:44: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:44: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:45: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:45: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:46: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:46: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:47: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:47: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:48: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:48: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:49: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:49: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:50: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:50: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:51: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:51: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:52: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:52: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:53: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:53: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:54: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:54: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:55: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:55: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:56: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:56: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:57: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:57: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:58: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:58: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:53:59: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:53:59: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:00: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:00: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:01: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:01: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:02: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:02: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:03: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:03: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:04: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:04: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:05: pid 762204: LOG: forked new pcp worker, pid=765404 socket=8 2023-10-26 11:54:05: pid 762204: LOCATION: pcp_child.c:308 2023-10-26 11:54:05: pid 762204: LOG: PCP process with pid: 765404 exit with SUCCESS. 2023-10-26 11:54:05: pid 762204: LOCATION: pcp_child.c:364 2023-10-26 11:54:05: pid 762204: LOG: PCP process with pid: 765404 exits with status 0 2023-10-26 11:54:05: pid 762204: LOCATION: pcp_child.c:378 2023-10-26 11:54:06: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:06: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:07: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:07: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:08: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:08: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:09: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:09: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:10: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:10: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:11: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:11: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:12: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:12: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:13: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:13: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:14: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:14: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:15: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:15: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:16: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:16: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:17: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:17: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:18: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:18: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:19: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:19: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:20: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:20: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:21: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:21: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:22: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:22: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:23: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:23: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:24: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:24: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:25: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:25: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:26: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:26: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:27: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:27: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:28: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:28: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:29: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:29: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:30: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:30: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:31: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:31: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:32: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:32: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:33: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:33: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:34: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:34: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:35: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:35: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:36: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:36: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:37: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:37: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:38: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:38: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:39: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:39: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:40: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:40: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:41: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:41: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:42: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:42: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:43: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:43: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:44: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:44: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:45: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:45: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:46: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:46: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:48: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:48: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:49: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:49: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:50: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:50: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:51: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:51: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:52: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:52: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:53: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:53: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:54: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:54: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:55: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:55: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:56: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:56: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:57: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:57: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:58: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:58: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:54:59: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:54:59: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:00: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:00: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:01: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:01: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:02: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:02: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:03: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:03: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:04: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:04: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:05: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:05: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:06: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:06: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:07: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:07: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:08: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:08: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:09: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:09: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:10: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:10: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:11: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:11: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:12: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:12: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:13: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:13: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:14: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:14: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:15: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:15: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:16: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:16: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:17: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:17: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:18: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:18: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:19: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:19: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:20: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:20: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:21: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:21: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:22: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:22: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:23: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:23: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:24: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:24: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:25: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:25: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:26: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:26: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:28: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:28: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:29: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:29: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:30: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:30: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:31: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:31: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:32: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:32: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:33: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:33: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:34: pid 762010: LOG: find_primary_node: standby node is 1 2023-10-26 11:55:34: pid 762010: LOCATION: pgpool_main.c:2790 2023-10-26 11:55:35: pid 762010: LOG: failed to find primary node 2023-10-26 11:55:35: pid 762010: DETAIL: find_primary_node_repeatedly: expired after 300 seconds 2023-10-26 11:55:35: pid 762010: LOCATION: pgpool_main.c:2886 2023-10-26 11:55:35: pid 762010: LOG: failover: set new primary node: -1 2023-10-26 11:55:35: pid 762010: LOCATION: pgpool_main.c:4595 2023-10-26 11:55:35: pid 762010: LOG: failover: set new main node: 1 2023-10-26 11:55:35: pid 762010: LOCATION: pgpool_main.c:4602 2023-10-26 11:55:35: pid 762205: LOG: worker process received restart request 2023-10-26 11:55:35: pid 762205: LOCATION: pool_worker_child.c:167 2023-10-26 11:55:35: pid 762013: LOG: received the failover indication from Pgpool-II on IPC interface 2023-10-26 11:55:35: pid 762013: LOCATION: watchdog.c:3003 2023-10-26 11:55:35: pid 762013: LOG: watchdog is informed of failover end by the main process 2023-10-26 11:55:35: pid 762013: LOCATION: watchdog.c:3105 2023-10-26 11:55:35: pid 762010: LOG: === Failover done. shutdown host paqcxast01.aaa.es(5432) === 2023-10-26 11:55:35: pid 762010: LOCATION: pgpool_main.c:4740 2023-10-26 11:55:36: pid 762204: LOG: restart request received in pcp child process 2023-10-26 11:55:36: pid 762204: LOCATION: pcp_child.c:167 2023-10-26 11:55:36: pid 762010: LOG: PCP child 762204 exits with status 0 in failover() 2023-10-26 11:55:36: pid 762010: LOCATION: pgpool_main.c:4785 2023-10-26 11:55:36: pid 762010: LOG: fork a new PCP child pid 765715 in failover() 2023-10-26 11:55:36: pid 762010: LOCATION: pgpool_main.c:4789 2023-10-26 11:55:36: pid 762010: LOG: reaper handler 2023-10-26 11:55:36: pid 762010: LOCATION: pgpool_main.c:1830 2023-10-26 11:55:36: pid 762010: LOG: reaper handler: exiting normally 2023-10-26 11:55:36: pid 762010: LOCATION: pgpool_main.c:2050 2023-10-26 11:55:36: pid 765715: LOG: PCP process: 765715 started 2023-10-26 11:55:36: pid 765715: LOCATION: pcp_child.c:160 2023-10-26 11:55:36: pid 765716: LOG: process started 2023-10-26 11:55:36: pid 765716: LOCATION: pgpool_main.c:890