[Pgpool-general] pgpool crashing(?) at startup

Daniel.Crespo at l-3com.com Daniel.Crespo at l-3com.com
Thu Jan 21 19:57:49 UTC 2010 

Hi,

I'm using pgpool 2.2.2 connecting to two backends PGSQL8.2.1. Below is a
diagram of my configuration

                .---> backend0
               /   
App ---> pgpool
               \
                `---> backend1

Where App, for testing purposes is:

while [ 1 ]; do psql -U postgres -p 9999 -c "select 1;"; sleep 0.01;
done

The problem is as follows:

1. pgpool is stopped
2. App is started
   Every 0.01 secs, outputs:
   psql: could not connect to server: Connection refused
        Is the server running locally and accepting
        connections on Unix domain socket "/tmp/.s.PGSQL.9999"?

4. pgpool tries starting (app is trying connecting every 0.01 secs)
5. pgpool stop running.

Below is the output of log of pgpool

2010-01-21 14:31:56 DEBUG: pid 10811: key: listen_addresses
2010-01-21 14:31:56 DEBUG: pid 10811: value: '*' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: port
2010-01-21 14:31:56 DEBUG: pid 10811: value: 9999 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: pcp_port
2010-01-21 14:31:56 DEBUG: pid 10811: value: 9898 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: socket_dir
2010-01-21 14:31:56 DEBUG: pid 10811: value: '/tmp' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: pcp_socket_dir
2010-01-21 14:31:56 DEBUG: pid 10811: value: '/tmp' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_socket_dir
2010-01-21 14:31:56 DEBUG: pid 10811: value: '/tmp' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: pcp_timeout
2010-01-21 14:31:56 DEBUG: pid 10811: value: 10 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: num_init_children
2010-01-21 14:31:56 DEBUG: pid 10811: value: 100 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: max_pool
2010-01-21 14:31:56 DEBUG: pid 10811: value: 1 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: child_life_time
2010-01-21 14:31:56 DEBUG: pid 10811: value: 0 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: connection_life_time
2010-01-21 14:31:56 DEBUG: pid 10811: value: 0 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: child_max_connections
2010-01-21 14:31:56 DEBUG: pid 10811: value: 0 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: client_idle_limit
2010-01-21 14:31:56 DEBUG: pid 10811: value: 0 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: authentication_timeout
2010-01-21 14:31:56 DEBUG: pid 10811: value: 60 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: logdir
2010-01-21 14:31:56 DEBUG: pid 10811: value: '/tmp' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: pid_file_name
2010-01-21 14:31:56 DEBUG: pid 10811: value:
'/var/run/pgpool/pgpool.pid' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: replication_mode
2010-01-21 14:31:56 DEBUG: pid 10811: value: true kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: load_balance_mode
2010-01-21 14:31:56 DEBUG: pid 10811: value: true kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: replication_stop_on_mismatch
2010-01-21 14:31:56 DEBUG: pid 10811: value: true kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: replication_stop_on_mismatch: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: replicate_select
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: replicate_select: 0
2010-01-21 14:31:56 DEBUG: pid 10811: key: reset_query_list
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'ABORT; RESET ALL; SET
SESSION AUTHORIZATION DEFAULT' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: extract_string_tokens: token:
ABORT
2010-01-21 14:31:56 DEBUG: pid 10811: extract_string_tokens: token:
RESET ALL
2010-01-21 14:31:56 DEBUG: pid 10811: extract_string_tokens: token:  SET
SESSION AUTHORIZATION DEFAULT
2010-01-21 14:31:56 DEBUG: pid 10811: key: print_timestamp
2010-01-21 14:31:56 DEBUG: pid 10811: value: true kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: master_slave_mode
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: connection_cache
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: health_check_timeout
2010-01-21 14:31:56 DEBUG: pid 10811: value: 20 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: health_check_period
2010-01-21 14:31:56 DEBUG: pid 10811: value: 5 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: health_check_user
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'postgres' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: failover_command
2010-01-21 14:31:56 DEBUG: pid 10811: value: ' .
/var/lib/pgsql/replication/failover_command_trigger %h %d' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: failback_command
2010-01-21 14:31:56 DEBUG: pid 10811: value: ' .
/var/lib/pgsql/replication/failback_command_trigger %h %d' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: insert_lock
2010-01-21 14:31:56 DEBUG: pid 10811: value: true kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: ignore_leading_white_space
2010-01-21 14:31:56 DEBUG: pid 10811: value: true kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: log_statement
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: log_connections
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: log_hostname
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: parallel_mode
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: enable_query_cache
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: pgpool2_hostname
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'localhost' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: system_db_hostname
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'localhost' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: system_db_port
2010-01-21 14:31:56 DEBUG: pid 10811: value: 5432 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: system_db_dbname
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'pgpool' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: system_db_schema
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'pgpool_catalog' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: system_db_user
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'pgpool' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: system_db_password
2010-01-21 14:31:56 DEBUG: pid 10811: value: '' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: enable_pool_hba
2010-01-21 14:31:56 DEBUG: pid 10811: value: false kind: 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: recovery_user
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'postgres' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: recovery_password
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'postgres' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: recovery_1st_stage_command
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'pgpool_copy_backup' kind:
4
2010-01-21 14:31:56 DEBUG: pid 10811: key: recovery_2nd_stage_command
2010-01-21 14:31:56 DEBUG: pid 10811: value: 'pgpool_switch_xlog' kind:
4
2010-01-21 14:31:56 DEBUG: pid 10811: key: recovery_timeout
2010-01-21 14:31:56 DEBUG: pid 10811: value: 50400 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: client_idle_limit_in_recovery
2010-01-21 14:31:56 DEBUG: pid 10811: value: 1 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_hostname0
2010-01-21 14:31:56 DEBUG: pid 10811: value: '192.168.101.222' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_port0
2010-01-21 14:31:56 DEBUG: pid 10811: value: 5432 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: pool_config: port slot number 0
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_weight0
2010-01-21 14:31:56 DEBUG: pid 10811: value: 1 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: pool_config: weight slot number 0
weight: 1.000000
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_data_directory0
2010-01-21 14:31:56 DEBUG: pid 10811: value: '/var/lib/pgsql/data' kind:
4
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_hostname1
2010-01-21 14:31:56 DEBUG: pid 10811: value: '192.168.101.214' kind: 4
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_port1
2010-01-21 14:31:56 DEBUG: pid 10811: value: 5432 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: pool_config: port slot number 1
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_weight1
2010-01-21 14:31:56 DEBUG: pid 10811: value: 1 kind: 2
2010-01-21 14:31:56 DEBUG: pid 10811: pool_config: weight slot number 1
weight: 1.000000
2010-01-21 14:31:56 DEBUG: pid 10811: key: backend_data_directory1
2010-01-21 14:31:56 DEBUG: pid 10811: value: '/var/lib/pgsql/data' kind:
4
2010-01-21 14:31:56 DEBUG: pid 10811: num_backends: 2 num_backends: 2
total_weight: 2.000000
2010-01-21 14:31:56 DEBUG: pid 10811: backend 0 weight:
1073741823.500000
2010-01-21 14:31:56 DEBUG: pid 10811: backend 1 weight:
1073741823.500000
2010-01-21 14:31:56 DEBUG: pid 10869: I am 10869
2010-01-21 14:31:56 DEBUG: pid 10870: I am 10870
2010-01-21 14:31:56 DEBUG: pid 10871: I am 10871
2010-01-21 14:31:56 DEBUG: pid 10872: I am 10872
2010-01-21 14:31:56 DEBUG: pid 10873: I am 10873
2010-01-21 14:31:56 DEBUG: pid 10874: I am 10874
2010-01-21 14:31:56 DEBUG: pid 10875: I am 10875
2010-01-21 14:31:56 DEBUG: pid 10876: I am 10876
2010-01-21 14:31:56 DEBUG: pid 10877: I am 10877
2010-01-21 14:31:56 DEBUG: pid 10873: I am 10873 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10873: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10873: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10878: I am 10878
2010-01-21 14:31:56 DEBUG: pid 10873: new_connection: connecting 1
backend
2010-01-21 14:31:56 DEBUG: pid 10880: I am 10880
2010-01-21 14:31:56 ERROR: pid 10873: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 DEBUG: pid 10881: I am 10881
2010-01-21 14:31:56 ERROR: pid 10873: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10873: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10873: notice_backend_error: 1 fail over
request from pid 10873
2010-01-21 14:31:56 DEBUG: pid 10882: I am 10882
2010-01-21 14:31:56 DEBUG: pid 10872: I am 10872 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10872: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10872: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10872: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10872: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10872: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10872: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10872: notice_backend_error: 1 fail over
request from pid 10872
2010-01-21 14:31:56 DEBUG: pid 10874: I am 10874 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10874: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10874: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10874: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10874: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10874: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10874: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10874: notice_backend_error: 1 fail over
request from pid 10874
2010-01-21 14:31:56 DEBUG: pid 10882: I am 10882 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10882: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10882: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10882: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10882: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10882: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10882: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10882: notice_backend_error: 1 fail over
request from pid 10882
2010-01-21 14:31:56 DEBUG: pid 10877: I am 10877 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10877: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10877: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10877: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10877: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10877: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10877: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10877: notice_backend_error: 1 fail over
request from pid 10877
2010-01-21 14:31:56 DEBUG: pid 10878: I am 10878 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10878: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10878: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10878: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10878: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10878: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10878: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10878: notice_backend_error: 1 fail over
request from pid 10878
2010-01-21 14:31:56 DEBUG: pid 10881: I am 10881 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10881: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10881: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10881: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10881: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10881: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10881: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10881: notice_backend_error: 1 fail over
request from pid 10881
2010-01-21 14:31:56 DEBUG: pid 10880: I am 10880 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10880: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10880: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10880: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10880: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10880: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10880: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10880: notice_backend_error: 1 fail over
request from pid 10880
2010-01-21 14:31:56 DEBUG: pid 10876: I am 10876 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10876: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10876: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10876: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10876: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10876: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10876: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10876: notice_backend_error: 1 fail over
request from pid 10876
2010-01-21 14:31:56 DEBUG: pid 10875: I am 10875 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10875: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10875: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10875: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10875: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10875: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10875: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10875: notice_backend_error: 1 fail over
request from pid 10875
2010-01-21 14:31:56 DEBUG: pid 10871: I am 10871 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10871: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10871: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10871: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10871: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10871: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10871: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10871: notice_backend_error: 1 fail over
request from pid 10871
2010-01-21 14:31:56 DEBUG: pid 10870: I am 10870 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10870: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10870: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10870: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10870: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10870: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10870: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10870: notice_backend_error: 1 fail over
request from pid 10870
2010-01-21 14:31:56 DEBUG: pid 10869: I am 10869 accept fd 5
2010-01-21 14:31:56 DEBUG: pid 10869: Protocol Major: 3 Minor: 0
database: postgres user: postgres
2010-01-21 14:31:56 DEBUG: pid 10869: new_connection: connecting 0
backend
2010-01-21 14:31:56 DEBUG: pid 10869: new_connection: connecting 1
backend
2010-01-21 14:31:56 ERROR: pid 10869: connect_inet_domain_socket:
connect() failed: Connection refused
2010-01-21 14:31:56 ERROR: pid 10869: connection to
192.168.101.214(5432) failed
2010-01-21 14:31:56 ERROR: pid 10869: new_connection: create_cp() failed
2010-01-21 14:31:56 LOG:   pid 10869: notice_backend_error: 1 fail over
request from pid 10869

If instead of 0.01 secs, I use 0.1 secs, for example, pgpool runs just
fine.

Anything I can do beside incrementing the time bewteen tries?

Thanks,
Daniel

More information about the Pgpool-general mailing list