<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><br class=""></div><div><blockquote type="cite" class=""><div class="">On 5/02/2022, at 1:45 PM, Tatsuo Ishii <<a href="mailto:ishii@sraoss.co.jp" class="">ishii@sraoss.co.jp</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><blockquote type="cite" class="">Hi,<br class=""><br class="">I’m migrating my Database cluster to PostgreSQL 14 and have been trying PGPOOL for the Load Balancer feature only.<br class=""><br class="">At the moment I have two servers, and even though PGPOOL and Postgres are up and running on both of them, “show pool_nodes” shows as one of them being down.<br class=""></blockquote><br class="">[snip]<br class=""><br class="">Which version of Pgpool-II is this?<br class=""></div></div></blockquote><div><br class=""></div><div>Version pgpool-II version 4.1.4 (karasukiboshi)</div><br class=""><blockquote type="cite" class=""><div class=""><div class=""><br class="">Can you share pgpool log upon starting up?<br class=""></div></div></blockquote><div><br class=""></div><div>Sure… Logs are below:</div><div><br class=""></div></div><blockquote style="margin: 0 0 0 40px; border: none; padding: 0px;" class=""><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:07: pid 1306560: LOG: reading status file: 0 th backend is set to down status</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:07: pid 1306560: LOG: memory cache initialized</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:07: pid 1306560: DETAIL: memcache blocks :64</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:07: pid 1306560: LOG: pool_discard_oid_maps: discarded memqcache oid maps</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:07: pid 1306560: LOG: waiting for watchdog to initialize</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: setting the local watchdog node name to "<a href="http://pgsql-awsbau-masterdb.prod.foo.com:9999" class="">pgsql-awsbau-masterdb.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-masterdb.prod.foo.com" class="">pgsql-awsbau-masterdb.prod.foo.com</a>"</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: watchdog cluster is configured with 1 remote nodes</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: watchdog remote node:0 on <a href="http://pgsql-awsbau-slave01.prod.foo.com:9000" class="">pgsql-awsbau-slave01.prod.foo.com:9000</a></div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: interface monitoring is disabled in watchdog</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: watchdog node state changed from [DEAD] to [LOADING]</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: new outbound connection to <a href="http://pgsql-awsbau-slave01.prod.foo.com:9000" class="">pgsql-awsbau-slave01.prod.foo.com:9000</a></div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: setting the remote node "<a href="http://pgsql-awsbau-slave01.prod.foo.com:9999" class="">pgsql-awsbau-slave01.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>" as watchdog cluster master</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: watchdog node state changed from [LOADING] to [INITIALIZING]</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: new watchdog node connection is received from "10.0.9.120:28815"</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: LOG: new node joined the cluster hostname:"<a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>" port:9000 pgpool_port:9999</div></div></div><div><div><div>Feb 8 22:49:07 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:07: pid 1306563: DETAIL: Pgpool-II version:"4.1.4" watchdog messaging version: 1.1</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: watchdog node state changed from [INITIALIZING] to [STANDBY]</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: successfully joined the watchdog cluster as standby node</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: DETAIL: our join coordinator request is accepted by cluster leader node "<a href="http://pgsql-awsbau-slave01.prod.foo.com:9999" class="">pgsql-awsbau-slave01.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>"</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: watchdog process is initialized</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: DETAIL: watchdog messaging data version: 1.1</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: Pgpool-II parent process received watchdog quorum change signal from watchdog</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: new IPC connection received</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: new IPC connection received</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: watchdog cluster now holds the quorum</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: DETAIL: updating the state of quarantine backend nodes</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: new IPC connection received</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: new IPC connection received</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306569]: 2022-02-08 22:49:08: pid 1306569: LOG: 2 watchdog nodes are configured for lifecheck</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: we have joined the watchdog cluster as STANDBY node</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: DETAIL: syncing the backend states from the MASTER watchdog node</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306569]: 2022-02-08 22:49:08: pid 1306569: LOG: watchdog nodes ID:0 Name:"<a href="http://pgsql-awsbau-masterdb.prod.foo.com:9999" class="">pgsql-awsbau-masterdb.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-masterdb.prod.foo.com" class="">pgsql-awsbau-masterdb.prod.foo.com</a>"</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306569]: 2022-02-08 22:49:08: pid 1306569: DETAIL: Host:"<a href="http://pgsql-awsbau-masterdb.prod.foo.com" class="">pgsql-awsbau-masterdb.prod.foo.com</a>" WD Port:9000 pgpool-II port:9999</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306569]: 2022-02-08 22:49:08: pid 1306569: LOG: watchdog nodes ID:1 Name:"<a href="http://pgsql-awsbau-slave01.prod.foo.com:9999" class="">pgsql-awsbau-slave01.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>"</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306569]: 2022-02-08 22:49:08: pid 1306569: DETAIL: Host:"<a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>" WD Port:9000 pgpool-II port:9999</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: new IPC connection received</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: received the get data request from local pgpool-II on IPC interface</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: LOG: get data request from local pgpool-II node received on IPC interface is forwarded to master watchdog node "<a href="http://pgsql-awsbau-slave01.prod.foo.com:9999" class="">pgsql-awsbau-slave01.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>"</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306563]: 2022-02-08 22:49:08: pid 1306563: DETAIL: waiting for the reply...</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: master watchdog node "<a href="http://pgsql-awsbau-slave01.prod.foo.com:9999" class="">pgsql-awsbau-slave01.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>" returned status for 2 backend nodes</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: backend:1 is set to UP status</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: DETAIL: backend:1 is UP on cluster master "<a href="http://pgsql-awsbau-slave01.prod.foo.com:9999" class="">pgsql-awsbau-slave01.prod.foo.com:9999</a> Linux <a href="http://pgsql-awsbau-slave01.prod.foo.com" class="">pgsql-awsbau-slave01.prod.foo.com</a>"</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: Setting up socket for 0.0.0.0:9999</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: Setting up socket for :::9999</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306605]: 2022-02-08 22:49:08: pid 1306605: LOG: PCP process: 1306605 started</div></div></div><div><div><div>Feb 8 22:49:08 pgsql-awsbau-masterdb pgpool[1306560]: 2022-02-08 22:49:08: pid 1306560: LOG: pgpool-II successfully started. version 4.1.4 (karasukiboshi)</div></div></div><div><div><div>Feb 8 22:49:09 pgsql-awsbau-masterdb pgpool[1306571]: 2022-02-08 22:49:09: pid 1306571: LOG: set SO_REUSEPORT option to the socket</div></div></div><div><div><div>Feb 8 22:49:09 pgsql-awsbau-masterdb pgpool[1306570]: 2022-02-08 22:49:09: pid 1306570: LOG: set SO_REUSEPORT option to the socket</div></div></div><div><div><div>Feb 8 22:49:09 pgsql-awsbau-masterdb pgpool[1306571]: 2022-02-08 22:49:09: pid 1306571: LOG: creating socket for sending heartbeat</div></div></div><div><div><div>Feb 8 22:49:09 pgsql-awsbau-masterdb pgpool[1306571]: 2022-02-08 22:49:09: pid 1306571: DETAIL: set SO_REUSEPORT</div></div></div><div><div><div>Feb 8 22:49:09 pgsql-awsbau-masterdb pgpool[1306570]: 2022-02-08 22:49:09: pid 1306570: LOG: creating watchdog heartbeat receive socket.</div></div></div><div><div><div>Feb 8 22:49:09 pgsql-awsbau-masterdb pgpool[1306570]: 2022-02-08 22:49:09: pid 1306570: DETAIL: set SO_REUSEPORT</div></div></div></blockquote><div><div><br class=""></div><br class=""><blockquote type="cite" class=""><div class=""><div class=""><br class="">One thing I found weird is show pool_nodes shows "role" fields as<br class="">"slave" or "master". However I see:<br class=""><br class=""><blockquote type="cite" class="">backend_clustering_mode = 'streaming_replication'<br class=""></blockquote><br class="">In this case the role field should be either "primary" or standby.<br class=""></div></div></blockquote><div><br class=""></div><div>Hmm... interesting!</div><div><br class=""></div><div>My goal with PGPool is to only use it as Load Balancer. I have deployed PG-Pool across all my PG nodes (2 in total for testing). One master and one Slave, using PG’s native streaming replication feature.</div></div><br class=""></body></html>