[pgpool-general: 3309] Failover is OK but Pgpool doesn't see the new master

Sébastien Ruiz sruiz at cyres.fr
Thu Nov 27 22:35:30 JST 2014


Hello,

Configuration with three nodes, streaming mode (postgresql 9.3.3, pgpool 3.3.2, ubuntu)
----------------------------------------------------
Configuration pgpool :

backend_hostname0 = '172.31.4.143'
backend_port0 = 5432
backend_weight0 = 1
backend_data_directory0 = '/X0CPAY50_1/admin'
backend_flag0 = 'ALLOW_TO_FAILOVER'

backend_hostname1 = '172.31.4.144'
backend_port1 = 5432
backend_weight1 = 1
backend_data_directory1 = '/X0CPAY50_1/admin'
backend_flag1 = 'ALLOW_TO_FAILOVER'

backend_hostname2 = '172.31.4.145'
backend_port2 = 5432
backend_weight2 = 1
backend_data_directory2 = '/X0CPAY50_1/admin'
backend_flag2 = 'ALLOW_TO_FAILOVER'

enable_pool_hba = on
pool_passwd = 'pool_passwd'
authentication_timeout = 60
ssl = off
num_init_children = 32
max_pool = 4
child_life_time = 300
child_max_connections = 0
connection_life_time = 0
client_idle_limit = 0
connection_cache = on
load_balance_mode = off
master_slave_mode = on
master_slave_sub_mode = 'stream'
sr_check_period = 10
sr_check_user = 'postgres'
sr_check_password = 'postgres'
delay_threshold = 10000000
follow_master_command = ''
parallel_mode = off
health_check_period = 40
health_check_timeout = 10
health_check_user = 'postgres'
health_check_password = 'postgres'
health_check_max_retries = 3
health_check_retry_delay = 1

failover_command = '/logiciels/pgpool/product/3.3.2/failover.sh "%d" "%h" "%p" "%D" "%m" "%H" "%M" "%P" '
failback_command = ''
fail_over_on_backend_error = off
search_primary_node_timeout = 10
recovery_user = 'postgres'
recovery_password = 'postgres'
recovery_1st_stage_command = 'basebackup.sh'
recovery_2nd_stage_command = ''
recovery_timeout = 90
client_idle_limit_in_recovery = 0
use_watchdog = off


My problem :

Everything works fine except when i stop the network of the master (or unplug the server electrically) to provoke a suddenly

crash of this master and start the failover.





Initial state :

node_id |   hostname   | port | status | lb_weight |  role

---------+--------------+------+--------+-----------+---------

 0       | 172.31.4.143 | 5432 | 2      | 0.333333  | standby

 1       | 172.31.4.144 | 5432 | 2      | 0.333333  | primary

 2       | 172.31.4.145 | 5432 | 2      | 0.333333  | standby



Stop network for node 1 (primary) :

After the failover (the new master is node 0 and the database is ok in read/write), this is the status of pg_pool :

node_id |   hostname   | port | status | lb_weight |  role

---------+--------------+------+--------+-----------+---------

 0       | 172.31.4.143 | 5432 | 2      | 0.333333  | standby

 1       | 172.31.4.144 | 5432 | 3      | 0.333333  | standby

 2       | 172.31.4.145 | 5432 | 2      | 0.333333  | standby

The new master (node 0) is seen like a standby role...



If i restart the pgpool, everything is right :

node_id |   hostname   | port | status | lb_weight |  role

---------+--------------+------+--------+-----------+---------

 0       | 172.31.4.143 | 5432 | 2      | 0.333333  | primary

 1       | 172.31.4.144 | 5432 | 3      | 0.333333  | standby

 2       | 172.31.4.145 | 5432 | 2      | 0.333333  | standby



What's append ??

----------------------------------------------------------------------------------------
Log :

2014-11-27 13:55:08 DEBUG: pid 29284: do_query: Ready for query
2014-11-27 13:55:08 DEBUG: pid 29284: find_primary_node: 0 node is standby
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: extended:0 query:SELECT pg_is_in_recovery()
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: kind: T
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: row description received
2014-11-27 13:55:08 DEBUG: pid 29284: num_fileds: 1
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: kind: D
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: data row received
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: kind: C
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: Command complete received
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: kind: Z
2014-11-27 13:55:08 DEBUG: pid 29284: do_query: Ready for query
2014-11-27 13:55:08 LOG:   pid 29284: find_primary_node: primary node id is 1
2014-11-27 13:55:08 DEBUG: pid 29284: starting health checking
2014-11-27 13:55:08 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:55:08 DEBUG: pid 29284: health_check: 0 th DB node status: 1
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:08 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:55:08 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:55:08 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:55:08 DEBUG: pid 29284: health_check: 1 th DB node status: 1
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:55:08 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:55:08 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:55:08 DEBUG: pid 29284: health_check: 2 th DB node status: 1
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:55:08 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:55:08 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:55:08 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:18 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:55:18 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:55:18 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:55:18 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:55:18 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:55:28 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:56:29 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:30 ERROR: pid 29284: connect_inet_domain_socket: select() timed out
2014-11-27 13:56:30 ERROR: pid 29284: make_persistent_db_connection: connection to 172.31.4.144(5432) failed
2014-11-27 13:56:30 ERROR: pid 29284: health check failed. 1 th host 172.31.4.144 at port 5432 is down
2014-11-27 13:56:30 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:30 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:30 LOG:   pid 29284: health check retry sleep time: 1 second(s)
2014-11-27 13:56:30 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:31 DEBUG: pid 29284: retrying 1 th health checking
2014-11-27 13:56:31 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:31 DEBUG: pid 29284: health_check: 0 th DB node status: 2
2014-11-27 13:56:31 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:56:31 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:56:31 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:56:31 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:56:31 DEBUG: pid 29284: health_check: 1 th DB node status: 2
2014-11-27 13:56:31 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:32 ERROR: pid 29284: connect_inet_domain_socket: select() timed out
2014-11-27 13:56:32 ERROR: pid 29284: make_persistent_db_connection: connection to 172.31.4.144(5432) failed
2014-11-27 13:56:32 ERROR: pid 29284: health check failed. 1 th host 172.31.4.144 at port 5432 is down
2014-11-27 13:56:32 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:32 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:32 LOG:   pid 29284: health check retry sleep time: 1 second(s)
2014-11-27 13:56:32 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:33 DEBUG: pid 29284: retrying 2 th health checking
2014-11-27 13:56:33 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:33 DEBUG: pid 29284: health_check: 0 th DB node status: 2
2014-11-27 13:56:33 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:56:33 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:56:33 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:56:33 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:56:33 DEBUG: pid 29284: health_check: 1 th DB node status: 2
2014-11-27 13:56:33 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:34 ERROR: pid 29284: connect_inet_domain_socket: select() timed out
2014-11-27 13:56:34 ERROR: pid 29284: make_persistent_db_connection: connection to 172.31.4.144(5432) failed
2014-11-27 13:56:34 ERROR: pid 29284: health check failed. 1 th host 172.31.4.144 at port 5432 is down
2014-11-27 13:56:34 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:34 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:34 LOG:   pid 29284: health check retry sleep time: 1 second(s)
2014-11-27 13:56:34 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:35 DEBUG: pid 29284: retrying 3 th health checking
2014-11-27 13:56:35 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:35 DEBUG: pid 29284: health_check: 0 th DB node status: 2
2014-11-27 13:56:35 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:56:35 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:56:35 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:56:35 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:56:35 DEBUG: pid 29284: health_check: 1 th DB node status: 2
2014-11-27 13:56:35 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:36 ERROR: pid 29284: connect_inet_domain_socket: select() timed out
2014-11-27 13:56:36 ERROR: pid 29284: make_persistent_db_connection: connection to 172.31.4.144(5432) failed
2014-11-27 13:56:36 ERROR: pid 29284: health check failed. 1 th host 172.31.4.144 at port 5432 is down
2014-11-27 13:56:36 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:36 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:36 LOG:   pid 29284: set 1 th backend down status
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler called
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: starting to select new master node
2014-11-27 13:56:36 LOG:   pid 29284: starting degeneration. shutdown host 172.31.4.144(5432)
2014-11-27 13:56:36 LOG:   pid 29284: Restart all children
2014-11-27 13:56:36 DEBUG: pid 29291: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29291
2014-11-27 13:56:36 DEBUG: pid 29292: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29292
2014-11-27 13:56:36 DEBUG: pid 29295: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29295
2014-11-27 13:56:36 DEBUG: pid 29296: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29296
2014-11-27 13:56:36 DEBUG: pid 29297: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29297
2014-11-27 13:56:36 DEBUG: pid 29298: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29298
2014-11-27 13:56:36 DEBUG: pid 29299: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29299
2014-11-27 13:56:36 DEBUG: pid 29300: child received shutdown request signal 3
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29300
2014-11-27 13:56:36 DEBUG: pid 29301: child received shutdown request signal 3
Etc....
2014-11-27 13:56:36 DEBUG: pid 29284: failover_handler: kill 29330
2014-11-27 13:56:36 LOG:   pid 29284: execute command: /logiciels/pgpool/product/3.3.2/failover.sh "1" "172.31.4.144" "5432" "/X0CPAY50_1/admin" "0" "172.31.4.143" "0" "1"
+ failed_node_id=1
+ failed_host_name=172.31.4.144
+ failed_port=5432
+ failed_db_cluster=/X0CPAY50_1/admin
+ new_master_id=0
+ new_master_host_name=172.31.4.143
+ old_master_id=0
+ old_primary_node_id=1
+ trigger=/tmp/stopstandby
+ '[' 1 = 1 ']'
+ ssh -n -o PasswordAuthentication=no 172.31.4.143 'touch /tmp/stopstandby'
+ ssh -n -o PasswordAuthentication=no 172.31.4.143 'sed '\''/hot_standby/d'\'' /X0CPAY50_1/admin/postgresql.conf >>/X0CPAY50_1/admin/postgresql.conf_tmp
        mv /X0CPAY50_1/admin/postgresql.conf_tmp /X0CPAY50_1/admin/postgresql.conf
        sed '\''/wal_level/d'\'' /X0CPAY50_1/admin/postgresql.conf >>/X0CPAY50_1/admin/postgresql.conf_tmp
        mv /X0CPAY50_1/admin/postgresql.conf_tmp /X0CPAY50_1/admin/postgresql.conf
        sed '\''/max_wal_senders/d'\'' /X0CPAY50_1/admin/postgresql.conf >>/X0CPAY50_1/admin/postgresql.conf_tmp
        mv /X0CPAY50_1/admin/postgresql.conf_tmp /X0CPAY50_1/admin/postgresql.conf
        echo "wal_level = hot_standby" >> /X0CPAY50_1/admin/postgresql.conf
        echo "max_wal_senders = 3" >> /X0CPAY50_1/admin/postgresql.conf
        '
2014-11-27 13:56:37 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
+ ssh -n -o PasswordAuthentication=no 172.31.4.143 'source /home/postgres/.profile;nohup /logiciels/postgres/product/9.3/bin/pg_ctl restart -D /X0CPAY50_1/admin > /dev/null 2>&1&'
+ exit 0
2014-11-27 13:56:38 LOG:   pid 29284: find_primary_node_repeatedly: waiting for finding a primary node
2014-11-27 13:56:38 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:38 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:38 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:38 DEBUG: pid 29284: reap_handler called
2014-11-27 13:56:38 DEBUG: pid 29284: reap_handler: exited due to switching
2014-11-27 13:56:38 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:39 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:39 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:39 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:39 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:40 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:40 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:40 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:40 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:40 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:41 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:41 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:41 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:41 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:42 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:42 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:42 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:42 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:43 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:43 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:43 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:43 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:44 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:44 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:44 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:44 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:45 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:45 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:45 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:45 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:46 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:46 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:46 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:46 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:47 ERROR: pid 29284: s_do_auth: expecting R got E
2014-11-27 13:56:47 ERROR: pid 29284: make_persistent_db_connection: s_do_auth failed
2014-11-27 13:56:47 ERROR: pid 29284: find_primary_node: make_persistent_connection failed
2014-11-27 13:56:47 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:48 LOG:   pid 29284: failover: set new primary node: -1
2014-11-27 13:56:48 LOG:   pid 29284: failover: set new master node: 0
2014-11-27 13:56:48 DEBUG: pid 29484: I am 29484
2014-11-27 13:56:48 DEBUG: pid 29485: I am 29485
2014-11-27 13:56:48 DEBUG: pid 29483: I am 29483
2014-11-27 13:56:48 DEBUG: pid 29486: I am 29486
2014-11-27 13:56:48 DEBUG: pid 29484: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29487: I am 29487
2014-11-27 13:56:48 DEBUG: pid 29483: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29485: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29486: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29489: I am 29489
2014-11-27 13:56:48 DEBUG: pid 29487: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29490: I am 29490
2014-11-27 13:56:48 DEBUG: pid 29489: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29491: I am 29491
2014-11-27 13:56:48 DEBUG: pid 29488: I am 29488
2014-11-27 13:56:48 DEBUG: pid 29488: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29490: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29492: I am 29492
2014-11-27 13:56:48 DEBUG: pid 29491: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29493: I am 29493
2014-11-27 13:56:48 DEBUG: pid 29492: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29493: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29496: I am 29496
2014-11-27 13:56:48 DEBUG: pid 29495: I am 29495
2014-11-27 13:56:48 DEBUG: pid 29496: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29495: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29499: I am 29499
2014-11-27 13:56:48 DEBUG: pid 29498: I am 29498
2014-11-27 13:56:48 DEBUG: pid 29497: I am 29497
2014-11-27 13:56:48 DEBUG: pid 29494: I am 29494
2014-11-27 13:56:48 DEBUG: pid 29498: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29499: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29497: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29494: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29501: I am 29501
2014-11-27 13:56:48 DEBUG: pid 29502: I am 29502
2014-11-27 13:56:48 DEBUG: pid 29500: I am 29500
2014-11-27 13:56:48 DEBUG: pid 29503: I am 29503
2014-11-27 13:56:48 DEBUG: pid 29501: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29502: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29504: I am 29504
2014-11-27 13:56:48 DEBUG: pid 29500: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29503: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29505: I am 29505
2014-11-27 13:56:48 DEBUG: pid 29504: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29506: I am 29506
2014-11-27 13:56:48 DEBUG: pid 29505: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29506: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 LOG:   pid 29334: connect_inet_domain_socket: select() interrupted. retrying...
2014-11-27 13:56:48 DEBUG: pid 29506: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 LOG:   pid 29334: connect_inet_domain_socket: select() interrupted. retrying...
2014-11-27 13:56:48 DEBUG: pid 29509: I am 29509
2014-11-27 13:56:48 DEBUG: pid 29510: I am 29510
2014-11-27 13:56:48 DEBUG: pid 29508: I am 29508
2014-11-27 13:56:48 DEBUG: pid 29511: I am 29511
2014-11-27 13:56:48 DEBUG: pid 29509: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29510: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29508: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29512: I am 29512
2014-11-27 13:56:48 DEBUG: pid 29511: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29513: I am 29513
2014-11-27 13:56:48 LOG:   pid 29284: failover done. shutdown host 172.31.4.144(5432)
2014-11-27 13:56:48 DEBUG: pid 29512: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29507: I am 29507
2014-11-27 13:56:48 DEBUG: pid 29514: I am 29514
2014-11-27 13:56:48 DEBUG: pid 29513: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29507: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:48 DEBUG: pid 29514: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:56:49 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:49 LOG:   pid 29333: pcp child process received restart request
2014-11-27 13:56:49 LOG:   pid 29284: PCP child 29333 exits with status 256 in failover()
2014-11-27 13:56:49 LOG:   pid 29284: fork a new PCP child pid 29515 in failover()
2014-11-27 13:56:49 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:56:49 DEBUG: pid 29284: reap_handler called
2014-11-27 13:56:49 DEBUG: pid 29284: reap_handler: call wait3
2014-11-27 13:56:49 DEBUG: pid 29284: child 29291 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29292 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29295 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29296 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29297 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29298 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29299 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29300 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29301 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29302 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29305 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29306 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29307 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29308 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29311 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29312 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29313 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29313 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29314 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29315 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29316 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29317 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29318 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29319 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29322 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29323 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29324 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29325 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29326 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29327 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29328 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29329 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: child 29330 exits with status 0
2014-11-27 13:56:49 DEBUG: pid 29284: reap_handler: normally exited
2014-11-27 13:56:50 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:51 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:52 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:53 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:54 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:55 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:56 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:57 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:58 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:56:59 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:00 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:01 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:02 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:03 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:04 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:05 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:06 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:07 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:08 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:09 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:10 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:11 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:12 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:13 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:14 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:15 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:16 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:17 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:18 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:19 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:20 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:21 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:22 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:23 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:24 LOG:   pid 29334: connect_inet_domain_socket: select() timed out. retrying...
2014-11-27 13:57:24 ERROR: pid 29334: connect_inet_domain_socket: getsockopt() detected error: No route to host
2014-11-27 13:57:24 ERROR: pid 29334: make_persistent_db_connection: connection to 172.31.4.144(5432) failed
2014-11-27 13:57:24 DEBUG: pid 29334: s_do_auth: auth kind: 5
2014-11-27 13:57:24 DEBUG: pid 29334: s_do_auth: auth kind: 0
2014-11-27 13:57:24 DEBUG: pid 29334: s_do_auth: backend key data received
2014-11-27 13:57:24 DEBUG: pid 29334: s_do_auth: transaction state: I
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: kind: T
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: row description received
2014-11-27 13:57:24 DEBUG: pid 29334: num_fileds: 1
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: kind: D
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: data row received
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: kind: C
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: Command complete received
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: kind: Z
2014-11-27 13:57:24 DEBUG: pid 29334: do_query: Ready for query
2014-11-27 13:57:24 DEBUG: pid 29334: check_replication_time_lag: DB node is valid but no persistent connection
2014-11-27 13:57:24 ERROR: pid 29334: check_replication_time_lag: could not connect to DB node 1, check sr_check_user and sr_check_password
2014-11-27 13:57:29 DEBUG: pid 29284: retrying 4 th health checking
2014-11-27 13:57:29 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:57:29 DEBUG: pid 29284: health_check: 0 th DB node status: 2
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:57:29 DEBUG: pid 29284: health_check: 1 th DB node status: 3
2014-11-27 13:57:29 DEBUG: pid 29284: health_check: 2 th DB node status: 2
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:57:29 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:57:29 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:57:29 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:57:34 LOG:   pid 29334: worker process received restart request
2014-11-27 13:57:34 DEBUG: pid 29284: reap_handler called
2014-11-27 13:57:34 DEBUG: pid 29284: reap_handler: call wait3
2014-11-27 13:57:34 LOG:   pid 29284: worker child 29334 exits with status 256
2014-11-27 13:57:34 LOG:   pid 29284: fork a new worker child pid 29516
2014-11-27 13:57:34 DEBUG: pid 29284: reap_handler: normally exited
2014-11-27 13:57:34 DEBUG: pid 29516: I am 29516
2014-11-27 13:57:34 DEBUG: pid 29516: pool_initialize_private_backend_status: initialize backend status
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:57:34 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:57:34 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:57:34 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:57:34 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:57:34 LOG:   pid 29516: Replication of node:2 is behind 16777360 bytes from the primary server (node:0)
2014-11-27 13:57:40 DEBUG: pid 29514: I am 29514 accept fd 6
2014-11-27 13:57:40 LOG:   pid 29514: connection received: host=[local]
2014-11-27 13:57:40 DEBUG: pid 29514: read_startup_packet: application_name: psql
2014-11-27 13:57:40 DEBUG: pid 29514: Protocol Major: 3 Minor: 0 database: postgres user: postgres
2014-11-27 13:57:40 DEBUG: pid 29514: Protocol Major: 3 Minor: 0 database: postgres user: postgres
2014-11-27 13:57:40 DEBUG: pid 29514: new_connection: connecting 0 backend
2014-11-27 13:57:40 DEBUG: pid 29514: new_connection: connecting 1 backend
2014-11-27 13:57:40 DEBUG: pid 29514: new_connection: skipping slot 1 because backend_status = 3
2014-11-27 13:57:40 DEBUG: pid 29514: new_connection: connecting 2 backend
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length: slot: 0 length: 12
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length: slot: 2 length: 12
2014-11-27 13:57:40 DEBUG: pid 29514: pool_do_auth: auth kind:5
2014-11-27 13:57:40 DEBUG: pid 29514: trying md5 authentication
2014-11-27 13:57:40 DEBUG: pid 29514: DB node id: 0 salt: aca7ec4
2014-11-27 13:57:40 DEBUG: pid 29514: trying md5 authentication
2014-11-27 13:57:40 DEBUG: pid 29514: DB node id: 2 salt: b987b568
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 26
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 26
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: application_name value: psql
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: application_name value: psql
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: client_encoding value: UTF8
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: client_encoding value: UTF8
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 23
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 23
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: DateStyle value: ISO, DMY
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: DateStyle value: ISO, DMY
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: integer_datetimes value: on
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: integer_datetimes value: on
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 27
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 27
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: IntervalStyle value: postgres
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: IntervalStyle value: postgres
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 20
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 20
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: is_superuser value: on
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: is_superuser value: on
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: server_encoding value: UTF8
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: server_encoding value: UTF8
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 25
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: server_version value: 9.3.3
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: server_version value: 9.3.3
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: server_version value: 9.3.3
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 35
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 35
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: session_authorization value: postgres
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: session_authorization value: postgres
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 35
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 35
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: standard_conforming_strings value: on
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: standard_conforming_strings value: on
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 0 length: 26
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length2: master slot: 2 length: 26
2014-11-27 13:57:40 DEBUG: pid 29514: 0 th backend: name: TimeZone value: Europe/Paris
2014-11-27 13:57:40 DEBUG: pid 29514: 2 th backend: name: TimeZone value: Europe/Paris
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length: slot: 0 length: 12
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length: slot: 2 length: 12
2014-11-27 13:57:40 DEBUG: pid 29514: pool_do_auth: cp->info[i]:0x7f0f69c58000 pid:21632
2014-11-27 13:57:40 DEBUG: pid 29514: pool_do_auth: cp->info[i]:0x7f0f69c58110 pid:13051
2014-11-27 13:57:40 DEBUG: pid 29514: pool_send_auth_ok: send pid 13051 to frontend
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_query_in_progress: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_command_success: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_writing_transaction: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_failed_transaction: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_transaction_isolation: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_skip_reading_from_backends: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_ignore_till_sync: done
2014-11-27 13:57:40 DEBUG: pid 29514: read_kind_from_one_backend: read kind from 0 th backend Z
2014-11-27 13:57:40 DEBUG: pid 29514: read_kind_from_backend: kind: Z from 0 th backend
2014-11-27 13:57:40 DEBUG: pid 29514: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 3
2014-11-27 13:57:40 DEBUG: pid 29514: read_kind_from_backend: kind: Z from 2 th backend
2014-11-27 13:57:40 DEBUG: pid 29514: read_kind_from_backend: read kind from 2 th backend Z NUM_BACKENDS: 3
2014-11-27 13:57:40 DEBUG: pid 29514: ProcessBackendResponse: kind from backend: Z
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length: slot: 0 length: 5
2014-11-27 13:57:40 DEBUG: pid 29514: pool_read_message_length: slot: 2 length: 5
2014-11-27 13:57:40 DEBUG: pid 29514: ReadyForQuery: transaction state:^@
2014-11-27 13:57:40 DEBUG: pid 29514: ReadyForQuery: transaction state:I
2014-11-27 13:57:40 DEBUG: pid 29514: ProcessBackendResponse: Ready For Query
2014-11-27 13:57:40 DEBUG: pid 29514: ProcessFrontendResponse: kind from frontend Q(51)
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_doing_extended_query_message: done
2014-11-27 13:57:40 LOG:   pid 29514: statement: show pool_nodes
2014-11-27 13:57:40 DEBUG: pid 29514: pool_set_query_in_progress: done
2014-11-27 13:57:40 DEBUG: pid 29514: nodes reporting
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_query_in_progress: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_query_in_progress: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_set_skip_reading_from_backends: done
2014-11-27 13:57:40 DEBUG: pid 29514: ProcessFrontendResponse: kind from frontend X(58)
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_doing_extended_query_message: done
2014-11-27 13:57:40 DEBUG: pid 29514: pool_unset_query_in_progress: done
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:57:44 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:57:44 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:57:44 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:57:44 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:57:44 LOG:   pid 29516: Replication of node:2 is behind 16777360 bytes from the primary server (node:0)
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:57:54 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:57:54 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:57:54 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:57:54 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:57:54 LOG:   pid 29516: Replication of node:2 is behind 16777360 bytes from the primary server (node:0)
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:58:04 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:58:04 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:58:04 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:58:04 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:58:04 DEBUG: pid 29516: do_query: Ready for query
2014-11-27 13:58:04 LOG:   pid 29516: Replication of node:2 is behind 16777360 bytes from the primary server (node:0)
2014-11-27 13:58:09 DEBUG: pid 29284: starting health checking
2014-11-27 13:58:09 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:58:09 DEBUG: pid 29284: health_check: 0 th DB node status: 2
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:58:09 DEBUG: pid 29284: health_check: 1 th DB node status: 3
2014-11-27 13:58:09 DEBUG: pid 29284: health_check: 2 th DB node status: 2
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: auth kind: 5
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: auth kind: 0
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: backend key data received
2014-11-27 13:58:09 DEBUG: pid 29284: s_do_auth: transaction state: I
2014-11-27 13:58:09 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:58:09 DEBUG: pid 29284: health check: clearing alarm
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: auth kind: 5
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: auth kind: 0
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: backend key data received
2014-11-27 13:58:14 DEBUG: pid 29516: s_do_auth: transaction state: I
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: kind: T
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: row description received
2014-11-27 13:58:14 DEBUG: pid 29516: num_fileds: 1
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: kind: D
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: data row received
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: kind: C
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: Command complete received
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: kind: Z
2014-11-27 13:58:14 DEBUG: pid 29516: do_query: Ready for query



Please if someone can help me it will be nice.










Cordialement,

Sébastien RUIZ
Consultant bases de données

sruiz at cyres.fr<mailto:sruiz at cyres.fr>

[cid:image001.jpg at 01CF6DD8.A222B1E0]<http://www.ingensi.com/>







Direction commerciale
et marketing
140 bis, rue de Rennes 75006 Paris
Tél. : 01 72 50 01 26

Centre de services

19-21, rue Edouard Vaillant
37000 Tours
Tél. : 02 47 68 48 50







[cid:image002.jpg at 01CF6DD8.A222B1E0]<http://www.cyres.fr/>
Suivez nous sur   [Description : Description : P:\Cyres Corporate\logo 2014\Logos signatures Mail\linkedin.jpg] <https://www.linkedin.com/company/groupe-cyres>  [Description : Description : P:\Cyres Corporate\logo 2014\Logos signatures Mail\viadeo.jpg] <http://www.viadeo.com/fr/profile/groupe.cyres>  [Description : Description : P:\Cyres Corporate\logo 2014\Logos signatures Mail\twitter.jpg] <https://twitter.com/CYRESGROUPE>  [Description : Description : P:\Cyres Corporate\logo 2014\Logos signatures Mail\google+.jpg] <https://plus.google.com/+CyresFr/posts>  [Description : Description : P:\Cyres Corporate\logo 2014\Logos signatures Mail\facebook.jpg] <https://www.facebook.com/cyresgroupe>

Groupe Cyrès<http://www.cyres.fr/> | Blog Cyrès<http://www.cyres.fr/publications/blog> | Ingensi<http://www.ingensi.com/> | Hosteam<http://www.hosteam.fr/> | Interactive<http://interactive.cyres.fr/>



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 1993 bytes
Desc: image001.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0007.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 1291 bytes
Desc: image002.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0008.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 779 bytes
Desc: image003.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0009.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 753 bytes
Desc: image004.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0010.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.jpg
Type: image/jpeg
Size: 778 bytes
Desc: image005.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0011.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.jpg
Type: image/jpeg
Size: 814 bytes
Desc: image006.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0012.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image007.jpg
Type: image/jpeg
Size: 730 bytes
Desc: image007.jpg
URL: <http://www.sraoss.jp/pipermail/pgpool-general/attachments/20141127/5331edac/attachment-0013.jpg>


More information about the pgpool-general mailing list