[pgpool-hackers: 4259] Watchdog heartbeat issue

Tatsuo Ishii ishii at sraoss.co.jp
Sat Jan 14 22:34:56 JST 2023


Hi Usama,

While checking buildfarm results of
028.watchdog_enable_consensus_with_half_votes test failure (by
timeout), I think I found an issue with watchdog.

The test uses two watchdog nodes, namely pgpool0 and pgpool1. Attached
pgpool.log of pgpool1 shows that it shut down due to "bind on socket
failed with error "Address already in use" (see attached pgpool1.log
for more details).

2023-01-14 00:27:15: life_check pid 26771: LOG:  watchdog nodes ID:1 Name:"localhost:50004 Linux abf1b59af489"
2023-01-14 00:27:15: life_check pid 26771: DETAIL:  Host:"localhost" WD Port:50006 pgpool-II port:50004
2023-01-14 00:27:15: main pid 26702: LOG:  we have joined the watchdog cluster as STANDBY node
2023-01-14 00:27:15: main pid 26702: DETAIL:  syncing the backend states from the LEADER watchdog node
2023-01-14 00:27:15: life_check pid 26771: LOG:  watchdog nodes ID:0 Name:"localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:15: life_check pid 26771: DETAIL:  Host:"localhost" WD Port:50002 pgpool-II port:50000
2023-01-14 00:27:15: watchdog pid 26709: LOG:  received the get data request from local pgpool-II on IPC interface
2023-01-14 00:27:15: watchdog pid 26709: LOG:  get data request from local pgpool-II node received on IPC interface is forwarded to leader watchdog node "localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:15: watchdog pid 26709: DETAIL:  waiting for the reply...
2023-01-14 00:27:15: main pid 26702: LOG:  leader watchdog node "localhost:50000 Linux abf1b59af489" returned status for 2 backend nodes
2023-01-14 00:27:15: main pid 26702: LOG:  Setting up socket for ::1:50004
2023-01-14 00:27:15: main pid 26702: FATAL:  failed to create INET domain socket
2023-01-14 00:27:15: main pid 26702: DETAIL:  bind on socket failed with error "Address already in use"
2023-01-14 00:27:15: main pid 26702: LOG:  shutting down
2023-01-14 00:27:15: watchdog pid 26709: LOG:  Watchdog is shutting down

The bind error itself sometimes we cannot avoid. But problem is, the
leader watchdog node (pgpool0) goes into an infinite loop in
wd_lifecheck.c:lifecheck_main():

	/* wait until ready to go */
	while (WD_OK != is_wd_lifecheck_ready())
	{
		sleep(pool_config->wd_interval * 10);
	}

If is_wd_lifecheck_ready() fails to receive heartbeat signal, it
returns WD_NG and the loop continues again. As a result, the
regression test failed with timeout (attached pgpool0.log). There's no
way to avoid bind on socket error and I think what we can do is, just
sleep before start watchdog.

But in my opinion the infinite loop above is a real issue in
production systems. Can we try the loop continue in limited time and
if it does not succeed, disregard the node in question?

Best reagards,
--
Tatsuo Ishii
SRA OSS LLC
English: http://www.sraoss.co.jp/index_en/
Japanese:http://www.sraoss.co.jp
-------------- next part --------------
2023-01-14 00:27:08: main pid 26698: LOG:  Backend status file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/pgpool_status discarded
2023-01-14 00:27:08: main pid 26698: LOG:  health_check_stats_shared_memory_size: requested size: 12288
2023-01-14 00:27:08: main pid 26698: LOG:  memory cache initialized
2023-01-14 00:27:08: main pid 26698: DETAIL:  memcache blocks :64
2023-01-14 00:27:08: main pid 26698: LOG:  allocating (136571768) bytes of shared memory segment
2023-01-14 00:27:08: main pid 26698: LOG:  allocating shared memory segment of size: 136571768 
2023-01-14 00:27:08: main pid 26698: LOG:  health_check_stats_shared_memory_size: requested size: 12288
2023-01-14 00:27:08: main pid 26698: LOG:  health_check_stats_shared_memory_size: requested size: 12288
2023-01-14 00:27:08: main pid 26698: LOG:  memory cache initialized
2023-01-14 00:27:08: main pid 26698: DETAIL:  memcache blocks :64
2023-01-14 00:27:08: main pid 26698: LOG:  pool_discard_oid_maps: discarded memqcache oid maps
2023-01-14 00:27:08: main pid 26698: LOG:  waiting for watchdog to initialize
2023-01-14 00:27:08: watchdog pid 26708: LOG:  setting the local watchdog node name to "localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:08: watchdog pid 26708: LOG:  watchdog cluster is configured with 1 remote nodes
2023-01-14 00:27:08: watchdog pid 26708: LOG:  watchdog remote node:0 on localhost:50006
2023-01-14 00:27:08: watchdog pid 26708: LOG:  interface monitoring is disabled in watchdog
2023-01-14 00:27:08: watchdog pid 26708: LOG:  watchdog node state changed from [DEAD] to [LOADING]
2023-01-14 00:27:08: watchdog pid 26708: LOG:  new watchdog node connection is received from "127.0.0.1:10921"
2023-01-14 00:27:08: watchdog pid 26708: LOG:  new outbound connection to localhost:50006 
2023-01-14 00:27:08: watchdog pid 26708: LOG:  new node joined the cluster hostname:"localhost" port:50006 pgpool_port:50004
2023-01-14 00:27:08: watchdog pid 26708: DETAIL:  Pgpool-II version:"4.2.11" watchdog messaging version: 1.2
2023-01-14 00:27:13: watchdog pid 26708: LOG:  watchdog node state changed from [LOADING] to [JOINING]
2023-01-14 00:27:13: watchdog pid 26708: LOG:  watchdog node state changed from [JOINING] to [INITIALIZING]
2023-01-14 00:27:14: watchdog pid 26708: LOG:  watchdog node state changed from [INITIALIZING] to [STANDING FOR LEADER]
2023-01-14 00:27:14: watchdog pid 26708: LOG:  watchdog node state changed from [STANDING FOR LEADER] to [LEADER]
2023-01-14 00:27:14: watchdog pid 26708: LOG:  Setting failover command timeout to 13
2023-01-14 00:27:14: watchdog pid 26708: LOG:  I am announcing my self as leader/coordinator watchdog node
2023-01-14 00:27:14: watchdog pid 26708: LOG:  I am the cluster leader node
2023-01-14 00:27:14: watchdog pid 26708: DETAIL:  our declare coordinator message is accepted by all nodes
2023-01-14 00:27:14: watchdog pid 26708: LOG:  setting the local node "localhost:50000 Linux abf1b59af489" as watchdog cluster leader
2023-01-14 00:27:14: watchdog pid 26708: LOG:  signal_user1_to_parent_with_reason(1)
2023-01-14 00:27:14: watchdog pid 26708: LOG:  I am the cluster leader node. Starting escalation process
2023-01-14 00:27:14: main pid 26698: LOG:  watchdog process is initialized
2023-01-14 00:27:14: main pid 26698: DETAIL:  watchdog messaging data version: 1.2
2023-01-14 00:27:14: watchdog pid 26708: LOG:  escalation process started with PID:26722
2023-01-14 00:27:14: watchdog_utility pid 26722: LOG:  watchdog: escalation started
2023-01-14 00:27:14: main pid 26698: LOG:  Pgpool-II parent process received SIGUSR1
2023-01-14 00:27:14: main pid 26698: LOG:  Pgpool-II parent process received watchdog state change signal from watchdog
2023-01-14 00:27:14: life_check pid 26723: LOG:  2 watchdog nodes are configured for lifecheck
2023-01-14 00:27:14: main pid 26698: LOG:  Setting up socket for ::1:50000
2023-01-14 00:27:14: life_check pid 26723: LOG:  watchdog nodes ID:0 Name:"localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:14: life_check pid 26723: DETAIL:  Host:"localhost" WD Port:50002 pgpool-II port:50000
2023-01-14 00:27:14: main pid 26698: LOG:  Setting up socket for 127.0.0.1:50000
2023-01-14 00:27:14: life_check pid 26723: LOG:  watchdog nodes ID:1 Name:"localhost:50004 Linux abf1b59af489"
2023-01-14 00:27:14: life_check pid 26723: DETAIL:  Host:"localhost" WD Port:50006 pgpool-II port:50004
2023-01-14 00:27:14: watchdog pid 26708: LOG:  watchdog escalation process with pid: 26722 exit with SUCCESS.
2023-01-14 00:27:14: main pid 26698: LOG:  find_primary_node_repeatedly: waiting for finding a primary node
2023-01-14 00:27:14: main pid 26698: LOG:  find_primary_node: primary node is 0
2023-01-14 00:27:14: main pid 26698: LOG:  find_primary_node: standby node is 1
2023-01-14 00:27:14: sr_check_worker pid 26761: LOG:  process started
2023-01-14 00:27:14: pcp_main pid 26760: LOG:  PCP process: 26760 started
2023-01-14 00:27:14: health_check pid 26762: LOG:  process started
2023-01-14 00:27:14: health_check pid 26763: LOG:  process started
2023-01-14 00:27:14: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:14: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:27:14: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:14: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:27:14: main pid 26698: LOG:  pgpool-II successfully started. version 4.2.11 (chichiriboshi)
2023-01-14 00:27:14: main pid 26698: LOG:  node status[0]: 1
2023-01-14 00:27:14: main pid 26698: LOG:  node status[1]: 2
2023-01-14 00:27:15: watchdog pid 26708: LOG:  adding watchdog node "localhost:50004 Linux abf1b59af489" to the standby list
2023-01-14 00:27:15: watchdog pid 26708: LOG:  signal_user1_to_parent_with_reason(3)
2023-01-14 00:27:15: main pid 26698: LOG:  Pgpool-II parent process received SIGUSR1
2023-01-14 00:27:15: main pid 26698: LOG:  Pgpool-II parent process received watchdog quorum change signal from watchdog
2023-01-14 00:27:15: watchdog pid 26708: LOG:  Setting failover command timeout to 13
2023-01-14 00:27:15: main pid 26698: LOG:  watchdog cluster now holds the quorum
2023-01-14 00:27:15: main pid 26698: DETAIL:  updating the state of quarantine backend nodes
2023-01-14 00:27:15: heart_beat_receiver pid 26724: LOG:  set SO_REUSEPORT option to the socket
2023-01-14 00:27:15: heart_beat_receiver pid 26724: LOG:  creating watchdog heartbeat receive socket.
2023-01-14 00:27:15: heart_beat_receiver pid 26724: DETAIL:  set SO_REUSEPORT
2023-01-14 00:27:15: heart_beat_sbender pid 26726: LOG:  set SO_REUSEPORT option to the socket
2023-01-14 00:27:15: heart_beat_sender pid 26726: LOG:  creating socket for sending heartbeat
2023-01-14 00:27:15: heart_beat_sender pid 26726: DETAIL:  set SO_REUSEPORT
2023-01-14 00:27:15: watchdog pid 26708: LOG:  read from socket failed, remote end closed the connection
2023-01-14 00:27:15: watchdog pid 26708: LOG:  client socket of localhost:50004 Linux abf1b59af489 is closed
2023-01-14 00:27:15: watchdog pid 26708: LOG:  remote node "localhost:50004 Linux abf1b59af489" is shutting down
2023-01-14 00:27:15: watchdog pid 26708: LOG:  removing watchdog node "localhost:50004 Linux abf1b59af489" from the standby list
2023-01-14 00:27:15: watchdog pid 26708: LOG:  signal_user1_to_parent_with_reason(3)
2023-01-14 00:27:15: main pid 26698: LOG:  Pgpool-II parent process received SIGUSR1
2023-01-14 00:27:15: main pid 26698: LOG:  Pgpool-II parent process received watchdog quorum change signal from watchdog
2023-01-14 00:27:15: main pid 26698: LOG:  watchdog cluster now holds the quorum
2023-01-14 00:27:15: main pid 26698: DETAIL:  updating the state of quarantine backend nodes
2023-01-14 00:27:24: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:24: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:27:24: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:24: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:27:34: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:34: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:27:34: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:34: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:27:44: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:44: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:27:44: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:44: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:27:54: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:54: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:27:54: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:27:54: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:28:04: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:04: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:28:04: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:04: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:28:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:28:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:28:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:28:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:28:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:28:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:28:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:28:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:28:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:28:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:28:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:29:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:29:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:29:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:29:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:29:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:29:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:29:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:29:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:29:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:29:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:29:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:29:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:29:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:30:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:30:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:30:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:30:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:30:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:30:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:30:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:30:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:30:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:30:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:30:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:30:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:30:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:31:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:31:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:31:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:31:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:31:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:31:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:31:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:31:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:31:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:31:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:31:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:31:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:31:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:32:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:32:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:32:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:32:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:32:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:32:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:32:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:33:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:33:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:33:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:33:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:33:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:33:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:33:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:33:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:33:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:33:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:33:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:33:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:33:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:34:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:34:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:34:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:34:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:34:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:34:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:34:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:34:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:34:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:34:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:34:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:34:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:34:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:35:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:35:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:35:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:35:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:35:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:35:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:35:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:35:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:35:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:35:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:35:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:35:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:35:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:36:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:36:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:36:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:36:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:36:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:36:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:36:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:36:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:36:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:36:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:36:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:36:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:36:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:37:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:37:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:37:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:37:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:37:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:37:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:37:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:38:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:38:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:38:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:38:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:38:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:38:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:38:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:38:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:38:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:38:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:38:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:38:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:38:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:39:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:39:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:39:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:39:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:39:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:39:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:39:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:39:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:39:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:39:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:39:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:39:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:39:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:40:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:40:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:40:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:40:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:40:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:40:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:40:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:41:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:41:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:41:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:41:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:41:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:41:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:41:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:42:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:42:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:42:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:42:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:42:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:42:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:42:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:43:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:43:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:43:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:43:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:43:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:43:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:43:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:43:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:43:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:43:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:43:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:43:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:43:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:44:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:44:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:44:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:44:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:44:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:44:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:44:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:45:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:45:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:05: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:45:15: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:15: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:45:15: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:15: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:45:25: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:25: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:45:25: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:25: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:45:35: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:35: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:45:35: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:35: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:45:45: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:45: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:45:45: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:45: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:45:55: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:55: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:45:55: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:45:55: health_check0 pid 26762: DETAIL:  No such file or directory
2023-01-14 00:46:05: health_check1 pid 26763: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:46:05: health_check1 pid 26763: DETAIL:  No such file or directory
2023-01-14 00:46:05: health_check0 pid 26762: WARNING:  check_backend_down_request: failed to open file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool0/log/backend_down_request
2023-01-14 00:46:05: health_check0 pid 26762: DETAIL:  No such file or directory
-------------- next part --------------
2023-01-14 00:27:08: main pid 26702: LOG:  Backend status file /var/volum/RockyLinux8/11/V4_2_STABLE/src/test/regression/tests/028.watchdog_enable_consensus_with_half_votes/testdir/pgpool1/log/pgpool_status discarded
2023-01-14 00:27:08: main pid 26702: LOG:  health_check_stats_shared_memory_size: requested size: 12288
2023-01-14 00:27:08: main pid 26702: LOG:  memory cache initialized
2023-01-14 00:27:08: main pid 26702: DETAIL:  memcache blocks :64
2023-01-14 00:27:08: main pid 26702: LOG:  allocating (136571768) bytes of shared memory segment
2023-01-14 00:27:08: main pid 26702: LOG:  allocating shared memory segment of size: 136571768 
2023-01-14 00:27:08: main pid 26702: LOG:  health_check_stats_shared_memory_size: requested size: 12288
2023-01-14 00:27:08: main pid 26702: LOG:  health_check_stats_shared_memory_size: requested size: 12288
2023-01-14 00:27:08: main pid 26702: LOG:  memory cache initialized
2023-01-14 00:27:08: main pid 26702: DETAIL:  memcache blocks :64
2023-01-14 00:27:08: main pid 26702: LOG:  pool_discard_oid_maps: discarded memqcache oid maps
2023-01-14 00:27:08: main pid 26702: LOG:  waiting for watchdog to initialize
2023-01-14 00:27:08: watchdog pid 26709: LOG:  setting the local watchdog node name to "localhost:50004 Linux abf1b59af489"
2023-01-14 00:27:08: watchdog pid 26709: LOG:  watchdog cluster is configured with 1 remote nodes
2023-01-14 00:27:08: watchdog pid 26709: LOG:  watchdog remote node:0 on localhost:50002
2023-01-14 00:27:08: watchdog pid 26709: LOG:  interface monitoring is disabled in watchdog
2023-01-14 00:27:08: watchdog pid 26709: LOG:  watchdog node state changed from [DEAD] to [LOADING]
2023-01-14 00:27:08: watchdog pid 26709: LOG:  new watchdog node connection is received from "127.0.0.1:44162"
2023-01-14 00:27:08: watchdog pid 26709: LOG:  new outbound connection to localhost:50002 
2023-01-14 00:27:08: watchdog pid 26709: LOG:  new node joined the cluster hostname:"localhost" port:50002 pgpool_port:50000
2023-01-14 00:27:08: watchdog pid 26709: DETAIL:  Pgpool-II version:"4.2.11" watchdog messaging version: 1.2
2023-01-14 00:27:13: watchdog pid 26709: LOG:  watchdog node state changed from [LOADING] to [JOINING]
2023-01-14 00:27:13: watchdog pid 26709: LOG:  watchdog node state changed from [JOINING] to [INITIALIZING]
2023-01-14 00:27:14: watchdog pid 26709: LOG:  watchdog node state changed from [INITIALIZING] to [STANDING FOR LEADER]
2023-01-14 00:27:14: watchdog pid 26709: LOG:  watchdog node state changed from [STANDING FOR LEADER] to [PARTICIPATING IN ELECTION]
2023-01-14 00:27:14: watchdog pid 26709: LOG:  watchdog node state changed from [PARTICIPATING IN ELECTION] to [INITIALIZING]
2023-01-14 00:27:14: watchdog pid 26709: LOG:  setting the remote node "localhost:50000 Linux abf1b59af489" as watchdog cluster leader
2023-01-14 00:27:15: watchdog pid 26709: LOG:  watchdog node state changed from [INITIALIZING] to [STANDBY]
2023-01-14 00:27:15: watchdog pid 26709: LOG:  signal_user1_to_parent_with_reason(1)
2023-01-14 00:27:15: watchdog pid 26709: LOG:  successfully joined the watchdog cluster as standby node
2023-01-14 00:27:15: watchdog pid 26709: DETAIL:  our join coordinator request is accepted by cluster leader node "localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:15: main pid 26702: LOG:  watchdog process is initialized
2023-01-14 00:27:15: main pid 26702: DETAIL:  watchdog messaging data version: 1.2
2023-01-14 00:27:15: watchdog pid 26709: LOG:  signal_user1_to_parent_with_reason(3)
2023-01-14 00:27:15: main pid 26702: LOG:  Pgpool-II parent process received SIGUSR1
2023-01-14 00:27:15: main pid 26702: LOG:  Pgpool-II parent process received watchdog quorum change signal from watchdog
2023-01-14 00:27:15: main pid 26702: LOG:  watchdog cluster now holds the quorum
2023-01-14 00:27:15: main pid 26702: DETAIL:  updating the state of quarantine backend nodes
2023-01-14 00:27:15: main pid 26702: LOG:  Pgpool-II parent process received watchdog state change signal from watchdog
2023-01-14 00:27:15: life_check pid 26771: LOG:  2 watchdog nodes are configured for lifecheck
2023-01-14 00:27:15: life_check pid 26771: LOG:  watchdog nodes ID:1 Name:"localhost:50004 Linux abf1b59af489"
2023-01-14 00:27:15: life_check pid 26771: DETAIL:  Host:"localhost" WD Port:50006 pgpool-II port:50004
2023-01-14 00:27:15: main pid 26702: LOG:  we have joined the watchdog cluster as STANDBY node
2023-01-14 00:27:15: main pid 26702: DETAIL:  syncing the backend states from the LEADER watchdog node
2023-01-14 00:27:15: life_check pid 26771: LOG:  watchdog nodes ID:0 Name:"localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:15: life_check pid 26771: DETAIL:  Host:"localhost" WD Port:50002 pgpool-II port:50000
2023-01-14 00:27:15: watchdog pid 26709: LOG:  received the get data request from local pgpool-II on IPC interface
2023-01-14 00:27:15: watchdog pid 26709: LOG:  get data request from local pgpool-II node received on IPC interface is forwarded to leader watchdog node "localhost:50000 Linux abf1b59af489"
2023-01-14 00:27:15: watchdog pid 26709: DETAIL:  waiting for the reply...
2023-01-14 00:27:15: main pid 26702: LOG:  leader watchdog node "localhost:50000 Linux abf1b59af489" returned status for 2 backend nodes
2023-01-14 00:27:15: main pid 26702: LOG:  Setting up socket for ::1:50004
2023-01-14 00:27:15: main pid 26702: FATAL:  failed to create INET domain socket
2023-01-14 00:27:15: main pid 26702: DETAIL:  bind on socket failed with error "Address already in use"
2023-01-14 00:27:15: main pid 26702: LOG:  shutting down
2023-01-14 00:27:15: watchdog pid 26709: LOG:  Watchdog is shutting down


More information about the pgpool-hackers mailing list