View Issue Details

IDProjectCategoryView StatusLast Update
0000106Pgpool-IIBugpublic2015-08-04 10:03
Reporterdeepak.kothandanAssigned Tot-ishii 
PriorityhighSeveritymajorReproducibilityalways
Status resolvedResolutionopen 
PlatformLinuxOSopenSUSEOS Version12.3
Product Version 
Target VersionFixed in Version 
Summary0000106: pgpool - v 3.3.3 hangs and does not allow more connection
DescriptionWe have setup pgpool-II in Master/Slave mode with Streaming Replication Enabled.
Two postgresql backend(version 9.3). Our application connects through jdbc to pgpool

The connections seems to work for a while and suddenly pgpool hangs with detect error: kind:S(please see logs for more detail)and stops receiving new connections, all the connections in pgpool are in idle state. We cannot even connect to the database using psql with the port of pgpool, but connections directly to master/slave database is working fine.

Have attached the logs and conf files of both pgpool and postgres. Please check and let me know if have made some mistakes or how to overcome this issue, in case its a problem with pgpool.
Additional Information# ----------------------------
# pgPool-II configuration file
# ----------------------------
#
# This file consists of lines of the form:
#
# name = value
#
# Whitespace may be used. Comments are introduced with "#" anywhere on a line.
# The complete list of parameter names and allowed values can be found in the
# pgPool-II documentation.
#
# This file is read on server startup and when the server receives a SIGHUP
# signal. If you edit the file on a running system, you have to SIGHUP the
# server for the changes to take effect, or use "pgpool reload". Some
# parameters, which are marked below, require a server shutdown and restart to
# take effect.
#


#------------------------------------------------------------------------------
# CONNECTIONS
#------------------------------------------------------------------------------

# - pgpool Connection Settings -

listen_addresses = 'localhost'
                                   # Host name or IP address to listen on:
                                   # '*' for all, '' for no TCP/IP connections
                                   # (change requires restart)
port = 5539
                                   # Port number
                                   # (change requires restart)
socket_dir = '/tmp'
                                   # Unix domain socket path
                                   # The Debian package defaults to
                                   # /var/run/postgresql
                                   # (change requires restart)


# - pgpool Communication Manager Connection Settings -

pcp_port = 9898
                                   # Port number for pcp
                                   # (change requires restart)
pcp_socket_dir = '/tmp'
                                   # Unix domain socket path for pcp
                                   # The Debian package defaults to
                                   # /var/run/postgresql
                                   # (change requires restart)

# - Backend Connection Settings -

                                   # Host name or IP address to connect to for backend 0
                                   # Port number for backend 0
                                   # Weight for backend 0 (only in load balancing mode)
#backend_data_directory0 = '/data'
                                   # Data directory for backend 0
#backend_flag0 = 'ALLOW_TO_FAILOVER'
                                   # Controls various backend behavior
                                   # ALLOW_TO_FAILOVER or DISALLOW_TO_FAILOVER
#backend_hostname1 = 'host2'
#backend_port1 = 5433
#backend_weight1 = 1
#backend_data_directory1 = '/data1'
#backend_flag1 = 'ALLOW_TO_FAILOVER'

# - Authentication -

enable_pool_hba = off
                                   # Use pool_hba.conf for client authentication
pool_passwd = 'pool_passwd'
                                   # File name of pool_passwd for md5 authentication.
                                   # "" disables pool_passwd.
                                   # (change requires restart)
authentication_timeout = 60
                                   # Delay in seconds to complete client authentication
                                   # 0 means no timeout.

# - SSL Connections -

ssl = off
                                   # Enable SSL support
                                   # (change requires restart)
#ssl_key = './server.key'
                                   # Path to the SSL private key file
                                   # (change requires restart)
#ssl_cert = './server.cert'
                                   # Path to the SSL public certificate file
                                   # (change requires restart)
#ssl_ca_cert = ''
                                   # Path to a single PEM format file
                                   # containing CA root certificate(s)
                                   # (change requires restart)
#ssl_ca_cert_dir = ''
                                   # Directory containing CA root certificate(s)
                                   # (change requires restart)


#------------------------------------------------------------------------------
# POOLS
#------------------------------------------------------------------------------

# - Pool size -

num_init_children = 5
                                   # Number of pools
                                   # (change requires restart)
max_pool = 4
                                   # Number of connections per pool
                                   # (change requires restart)

# - Life time -

child_life_time = 0
                                   # Pool exits after being idle for this many seconds
child_max_connections = 0
                                   # Pool exits after receiving that many connections
                                   # 0 means no exit
connection_life_time = 0
                                   # Connection to backend closes after being idle for this many seconds
                                   # 0 means no close
client_idle_limit = 0
                                   # Client is disconnected after being idle for that many seconds
                                   # (even inside an explicit transactions!)
                                   # 0 means no disconnection


#------------------------------------------------------------------------------
# LOGS
#------------------------------------------------------------------------------

# - Where to log -

log_destination = 'stderr'
                                   # Where to log
                                   # Valid values are combinations of stderr,
                                   # and syslog. Default to stderr.

# - What to log -

print_timestamp = on
                                   # Print timestamp on each line
                                   # (change requires restart)

log_connections = off
                                   # Log connections
log_hostname = on
                                   # Hostname will be shown in ps status
                                   # and in logs if connections are logged
log_statement = on
                                   # Log all statements
log_per_node_statement = off
                                   # Log all statements
                                   # with node and backend informations
log_standby_delay = 'none'
                                   # Log standby delay
                                   # Valid values are combinations of always,
                                   # if_over_threshold, none

# - Syslog specific -

syslog_facility = 'LOCAL0'
                                   # Syslog local facility. Default to LOCAL0
syslog_ident = 'pgpool'
                                   # Syslog program identification string
                                   # Default to 'pgpool'

# - Debug -

debug_level = 0
                                   # Debug message verbosity level
                                   # 0 means no message, 1 or more mean verbose


#------------------------------------------------------------------------------
# FILE LOCATIONS
#------------------------------------------------------------------------------

pid_file_name = '/var/run/pgpool/pgpool.pid'
                                   # PID file name
                                   # (change requires restart)
logdir = '/tmp'
                                   # Directory of pgPool status file
                                   # (change requires restart)


#------------------------------------------------------------------------------
# CONNECTION POOLING
#------------------------------------------------------------------------------

connection_cache = on
                                   # Activate connection pools
                                   # (change requires restart)

                                   # Semicolon separated list of queries
                                   # to be issued at the end of a session
                                   # The default is for 8.3 and later
reset_query_list = 'ABORT; DISCARD ALL'
                                   # The following one is for 8.2 and before
#reset_query_list = 'ABORT; RESET ALL; SET SESSION AUTHORIZATION DEFAULT'


#------------------------------------------------------------------------------
# REPLICATION MODE
#------------------------------------------------------------------------------

replication_mode = off
                                   # Activate replication mode
                                   # (change requires restart)
replicate_select = off
                                   # Replicate SELECT statements
                                   # when in replication or parallel mode
                                   # replicate_select is higher priority than
                                   # load_balance_mode.

insert_lock = on
                                   # Automatically locks a dummy row or a table
                                   # with INSERT statements to keep SERIAL data
                                   # consistency
                                   # Without SERIAL, no lock will be issued
lobj_lock_table = ''
                                   # When rewriting lo_creat command in
                                   # replication mode, specify table name to
                                   # lock

# - Degenerate handling -

replication_stop_on_mismatch = off
                                   # On disagreement with the packet kind
                                   # sent from backend, degenerate the node
                                   # which is most likely "minority"
                                   # If off, just force to exit this session

failover_if_affected_tuples_mismatch = off
                                   # On disagreement with the number of affected
                                   # tuples in UPDATE/DELETE queries, then
                                   # degenerate the node which is most likely
                                   # "minority".
                                   # If off, just abort the transaction to
                                   # keep the consistency


#------------------------------------------------------------------------------
# LOAD BALANCING MODE
#------------------------------------------------------------------------------

load_balance_mode = off
                                   # Activate load balancing mode
                                   # (change requires restart)
ignore_leading_white_space = off
                                   # Ignore leading white spaces of each query
white_function_list = ''
                                   # Comma separated list of function names
                                   # that don't write to database
                                   # Regexp are accepted
black_function_list = 'nextval,setval'
                                   # Comma separated list of function names
                                   # that write to database
                                   # Regexp are accepted


#------------------------------------------------------------------------------
# MASTER/SLAVE MODE
#------------------------------------------------------------------------------

master_slave_mode = on
                                   # Activate master/slave mode
                                   # (change requires restart)
master_slave_sub_mode = 'stream'
                                   # Master/slave sub mode
                                   # Valid values are combinations slony or
                                   # stream. Default is slony.
                                   # (change requires restart)

# - Streaming -

sr_check_period = 60
                                   # Streaming replication check period
                                   # Disabled (0) by default
sr_check_user = 'isdb8'
                                   # Streaming replication check user
                                   # This is necessary even if you disable
                                   # streaming replication delay check with
                                   # sr_check_period = 0
sr_check_password = 'bug55cv'
                                   # Password for streaming replication check user
delay_threshold = 0
                                   # Threshold before not dispatching query to standby node
                                   # Unit is in bytes
                                   # Disabled (0) by default

# - Special commands -

follow_master_command = ''
                                   # Executes this command after master failover
                                   # Special values:
                                   # %d = node id
                                   # %h = host name
                                   # %p = port number
                                   # %D = database cluster path
                                   # %m = new master node id
                                   # %H = hostname of the new master node
                                   # %M = old master node id
                                   # %P = old primary node id
                                   # %r = new master port number
                                   # %R = new master database cluster path
                                   # %% = '%' character


#------------------------------------------------------------------------------
# PARALLEL MODE
#------------------------------------------------------------------------------

parallel_mode = off
                                   # Activates parallel query mode
                                   # (change requires restart)
pgpool2_hostname = ''
                                   # Set pgpool2 hostname
                                   # (change requires restart)

# - System DB info -

system_db_hostname = 'localhost'
                                   # (change requires restart)
system_db_port = 5432
                                   # (change requires restart)
system_db_dbname = 'pgpool'
                                   # (change requires restart)
system_db_schema = 'pgpool_catalog'
                                   # (change requires restart)
system_db_user = 'pgpool'
                                   # (change requires restart)
system_db_password = ''
                                   # (change requires restart)


#------------------------------------------------------------------------------
# HEALTH CHECK
#------------------------------------------------------------------------------

health_check_period = 30
                                   # Health check period
                                   # Disabled (0) by default
health_check_timeout = 30
                                   # Health check timeout
                                   # 0 means no timeout
health_check_user = 'isdb8'
                                   # Health check user
health_check_password = 'bug55cv'
                                   # Password for health check user
health_check_max_retries = 0
                                   # Maximum number of times to retry a failed health check before giving up.
health_check_retry_delay = 1
                                   # Amount of time to wait (in seconds) between retries.


#------------------------------------------------------------------------------
# FAILOVER AND FAILBACK
#------------------------------------------------------------------------------

failover_command = '/usr/local/etc/failover.sh %d %h %p %D %m %M %H %P'
                                   # Executes this command at failover
                                   # Special values:
                                   # %d = node id
                                   # %h = host name
                                   # %p = port number
                                   # %D = database cluster path
                                   # %m = new master node id
                                   # %H = hostname of the new master node
                                   # %M = old master node id
                                   # %P = old primary node id
                                   # %r = new master port number
                                   # %R = new master database cluster path
                                   # %% = '%' character
failback_command = ''
                                   # Executes this command at failback.
                                   # Special values:
                                   # %d = node id
                                   # %h = host name
                                   # %p = port number
                                   # %D = database cluster path
                                   # %m = new master node id
                                   # %H = hostname of the new master node
                                   # %M = old master node id
                                   # %P = old primary node id
                                   # %r = new master port number
                                   # %R = new master database cluster path
                                   # %% = '%' character

fail_over_on_backend_error = off
                                   # Initiates failover when reading/writing to the
                                   # backend communication socket fails
                                   # If set to off, pgpool will report an
                                   # error and disconnect the session.

search_primary_node_timeout = 10
                                   # Timeout in seconds to search for the
                                   # primary node when a failover occurs.
                                   # 0 means no timeout, keep searching
                                   # for a primary node forever.

#------------------------------------------------------------------------------
# ONLINE RECOVERY
#------------------------------------------------------------------------------

recovery_user = 'nobody'
                                   # Online recovery user
recovery_password = ''
                                   # Online recovery password
recovery_1st_stage_command = ''
                                   # Executes a command in first stage
recovery_2nd_stage_command = ''
                                   # Executes a command in second stage
recovery_timeout = 90
                                   # Timeout in seconds to wait for the
                                   # recovering node's postmaster to start up
                                   # 0 means no wait
client_idle_limit_in_recovery = 0
                                   # Client is disconnected after being idle
                                   # for that many seconds in the second stage
                                   # of online recovery
                                   # 0 means no disconnection
                                   # -1 means immediate disconnection


#------------------------------------------------------------------------------
# WATCHDOG
#------------------------------------------------------------------------------

# - Enabling -

use_watchdog = off
                                    # Activates watchdog
                                    # (change requires restart)

# -Connection to up stream servers -

trusted_servers = ''
                                    # trusted server list which are used
                                    # to confirm network connection
                                    # (hostA,hostB,hostC,...)
                                    # (change requires restart)
ping_path = '/bin'
                                    # ping command path
                                    # (change requires restart)

# - Watchdog communication Settings -

wd_hostname = ''
                                    # Host name or IP address of this watchdog
                                    # (change requires restart)
wd_port = 9000
                                    # port number for watchdog service
                                    # (change requires restart)
wd_authkey = ''
                                    # Authentication key for watchdog communication
                                    # (change requires restart)

# - Virtual IP control Setting -

delegate_IP = ''
                                    # delegate IP address
                                    # If this is empty, virtual IP never bring up.
                                    # (change requires restart)
ifconfig_path = '/sbin'
                                    # ifconfig command path
                                    # (change requires restart)
if_up_cmd = 'ifconfig eth0:0 inet $_IP_$ netmask 255.255.255.0'
                                    # startup delegate IP command
                                    # (change requires restart)
if_down_cmd = 'ifconfig eth0:0 down'
                                    # shutdown delegate IP command
                                    # (change requires restart)

arping_path = '/usr/sbin # arping command path'
                                    # (change requires restart)

arping_cmd = 'arping -U $_IP_$ -w 1'
                                    # arping command
                                    # (change requires restart)

# - Behaivor on escalation Setting -

clear_memqcache_on_escalation = on
                                    # Clear all the query cache on shared memory
                                    # when standby pgpool escalate to active pgpool
                                    # (= virtual IP holder).
                                    # This should be off if client connects to pgpool
                                    # not using virtual IP.
                                    # (change requires restart)
wd_escalation_command = ''
                                    # Executes this command at escalation on new active pgpool.
                                    # (change requires restart)

# - Lifecheck Setting -

# -- common --

wd_lifecheck_method = 'heartbeat'
                                    # Method of watchdog lifecheck ('heartbeat' or 'query')
                                    # (change requires restart)
wd_interval = 10
                                    # lifecheck interval (sec) > 0
                                    # (change requires restart)

# -- heartbeat mode --

wd_heartbeat_port = 9694
                                    # Port number for receiving heartbeat signal
                                    # (change requires restart)
wd_heartbeat_keepalive = 2
                                    # Interval time of sending heartbeat signal (sec)
                                    # (change requires restart)
wd_heartbeat_deadtime = 30
                                    # Deadtime interval for heartbeat signal (sec)
                                    # (change requires restart)
                                    # Host name or IP address of destination 0
                                    # for sending heartbeat signal.
                                    # (change requires restart)
                                    # Port number of destination 0 for sending
                                    # heartbeat signal. Usually this is the
                                    # same as wd_heartbeat_port.
                                    # (change requires restart)
                                    # Name of NIC device (such like 'eth0')
                                    # used for sending/receiving heartbeat
                                    # signal to/from destination 0.
                                    # This works only when this is not empty
                                    # and pgpool has root privilege.
                                    # (change requires restart)

#heartbeat_destination1 = 'host0_ip2'
#heartbeat_destination_port1 = 9694
#heartbeat_device1 = ''

# -- query mode --

wd_life_point = 3
                                    # lifecheck retry times
                                    # (change requires restart)
wd_lifecheck_query = 'SELECT 1'
                                    # lifecheck query to pgpool from watchdog
                                    # (change requires restart)
wd_lifecheck_dbname = 'template1'
                                    # Database name connected for lifecheck
                                    # (change requires restart)
wd_lifecheck_user = 'nobody'
                                    # watchdog user monitoring pgpools in lifecheck
                                    # (change requires restart)
wd_lifecheck_password = ''
                                    # Password for watchdog user in lifecheck
                                    # (change requires restart)

# - Other pgpool Connection Settings -

#other_pgpool_hostname0 = 'host0'
                                    # Host name or IP address to connect to for other pgpool 0
                                    # (change requires restart)
#other_pgpool_port0 = 5432
                                    # Port number for othet pgpool 0
                                    # (change requires restart)
#other_wd_port0 = 9000
                                    # Port number for othet watchdog 0
                                    # (change requires restart)
#other_pgpool_hostname1 = 'host1'
#other_pgpool_port1 = 5432
#other_wd_port1 = 9000


#------------------------------------------------------------------------------
# OTHERS
#------------------------------------------------------------------------------
relcache_expire = 0
                                   # Life time of relation cache in seconds.
                                   # 0 means no cache expiration(the default).
                                   # The relation cache is used for cache the
                                   # query result against PostgreSQL system
                                   # catalog to obtain various information
                                   # including table structures or if it's a
                                   # temporary table or not. The cache is
                                   # maintained in a pgpool child local memory
                                   # and being kept as long as it survives.
                                   # If someone modify the table by using
                                   # ALTER TABLE or some such, the relcache is
                                   # not consistent anymore.
                                   # For this purpose, cache_expiration
                                   # controls the life time of the cache.

relcache_size = 256
                                   # Number of relation cache
                                   # entry. If you see frequently:
                                   # "pool_search_relcache: cache replacement happend"
                                   # in the pgpool log, you might want to increate this number.

check_temp_table = on
                                   # If on, enable temporary table check in SELECT statements.
                                   # This initiates queries against system catalog of primary/master
                                   # thus increases load of master.
                                   # If you are absolutely sure that your system never uses temporary tables
                                   # and you want to save access to primary/master, you could turn this off.
                                   # Default is on.


#------------------------------------------------------------------------------
# ON MEMORY QUERY MEMORY CACHE
#------------------------------------------------------------------------------
memory_cache_enabled = off
                                   # If on, use the memory cache functionality, off by default
memqcache_method = 'shmem'
                                   # Cache storage method. either 'shmem'(shared memory) or
                                   # 'memcached'. 'shmem' by default
                                   # (change requires restart)
memqcache_memcached_host = 'localhost'
                                   # Memcached host name or IP address. Mandatory if
                                   # memqcache_method = 'memcached'.
                                   # Defaults to localhost.
                                   # (change requires restart)
memqcache_memcached_port = 11211
                                   # Memcached port number. Mondatory if memqcache_method = 'memcached'.
                                   # Defaults to 11211.
                                   # (change requires restart)
memqcache_total_size = 67108864
                                   # Total memory size in bytes for storing memory cache.
                                   # Mandatory if memqcache_method = 'shmem'.
                                   # Defaults to 64MB.
                                   # (change requires restart)
memqcache_max_num_cache = 1000000
                                   # Total number of cache entries. Mandatory
                                   # if memqcache_method = 'shmem'.
                                   # Each cache entry consumes 48 bytes on shared memory.
                                   # Defaults to 1,000,000(45.8MB).
                                   # (change requires restart)
memqcache_expire = 0
                                   # Memory cache entry life time specified in seconds.
                                   # 0 means infinite life time. 0 by default.
                                   # (change requires restart)
memqcache_auto_cache_invalidation = on
                                   # If on, invalidation of query cache is triggered by corresponding
                                   # DDL/DML/DCL(and memqcache_expire). If off, it is only triggered
                                   # by memqcache_expire. on by default.
                                   # (change requires restart)
memqcache_maxcache = 409600
                                   # Maximum SELECT result size in bytes.
                                   # Must be smaller than memqcache_cache_block_size. Defaults to 400KB.
                                   # (change requires restart)
memqcache_cache_block_size = 1048576
                                   # Cache block size in bytes. Mandatory if memqcache_method = 'shmem'.
                                   # Defaults to 1MB.
                                   # (change requires restart)
memqcache_oiddir = '/var/log/pgpool/oiddir'
                                      # Temporary work directory to record table oids
                                   # (change requires restart)
white_memqcache_table_list = ''
                                   # Comma separated list of table names to memcache
                                   # that don't write to database
                                   # Regexp are accepted
black_memqcache_table_list = ''
                                   # Comma separated list of table names not to memcache
                                   # that don't write to database
                                   # Regexp are accepted
ssl_key = ''
ssl_cert = ''
ssl_ca_cert = ''
ssl_ca_cert_dir = ''
backend_hostname0 = 'master'
backend_port0 = 5439
backend_weight0 = 1
backend_data_directory0 = '/pgdata/postgresql-data-8'
backend_flag0= 'ALLOW_TO_FAILOVER'
backend_hostname1 = 'slave'
backend_port1 = 5439
backend_weight1 = 1
backend_data_directory1 = '/pgdata/postgresql-data-8'
backend_flag1= 'ALLOW_TO_FAILOVER'
other_pgpool_hostname0 = ''
other_pgpool_port0 =
other_wd_port0 =
heartbeat_destination0 = 'host0_ip1'
heartbeat_destination_port0 = 9694
heartbeat_device0 = ''



# -----------------------------
# PostgreSQL configuration file
# -----------------------------
#
# This file consists of lines of the form:
#
# name = value
#
# (The "=" is optional.) Whitespace may be used. Comments are introduced with
# "#" anywhere on a line. The complete list of parameter names and allowed
# values can be found in the PostgreSQL documentation.
#
# The commented-out settings shown in this file represent the default values.
# Re-commenting a setting is NOT sufficient to revert it to the default value;
# you need to reload the server.
#
# This file is read on server startup and when the server receives a SIGHUP
# signal. If you edit the file on a running system, you have to SIGHUP the
# server for the changes to take effect, or use "pg_ctl reload". Some
# parameters, which are marked below, require a server shutdown and restart to
# take effect.
#
# Any parameter can also be given as a command-line option to the server, e.g.,
# "postgres -c log_connections=on". Some parameters can be changed at run time
# with the "SET" SQL command.
#
# Memory units: kB = kilobytes Time units: ms = milliseconds
# MB = megabytes s = seconds
# GB = gigabytes min = minutes
# h = hours
# d = days


#------------------------------------------------------------------------------
# FILE LOCATIONS
#------------------------------------------------------------------------------

# The default values of these variables are driven from the -D command-line
# option or PGDATA environment variable, represented here as ConfigDir.

#data_directory = 'ConfigDir' # use data in another directory
                    # (change requires restart)
#hba_file = 'ConfigDir/pg_hba.conf' # host-based authentication file
                    # (change requires restart)
#ident_file = 'ConfigDir/pg_ident.conf' # ident configuration file
                    # (change requires restart)

# If external_pid_file is not explicitly set, no extra PID file is written.
#external_pid_file = '' # write an extra PID file
                    # (change requires restart)


#------------------------------------------------------------------------------
# CONNECTIONS AND AUTHENTICATION
#------------------------------------------------------------------------------

# - Connection Settings -

listen_addresses='localhost'
#listen_addresses = 'localhost' # what IP address(es) to listen on;
                    # comma-separated list of addresses;
                    # defaults to 'localhost'; use '*' for all
                    # (change requires restart)
port=5439
#port = 5432 # (change requires restart)
max_connections=70
#max_connections = 100 # (change requires restart)
# Note: Increasing max_connections costs 0000096:0000400 bytes of shared memory per
# connection slot, plus lock space (see max_locks_per_transaction).
superuser_reserved_connections = 10 # (change requires restart)
#unix_socket_directories = '/tmp' # comma-separated list of directories
                    # (change requires restart)
#unix_socket_group = '' # (change requires restart)
#unix_socket_permissions = 0777 # begin with 0 to use octal notation
                    # (change requires restart)
#bonjour = off # advertise server via Bonjour
                    # (change requires restart)
#bonjour_name = '' # defaults to the computer name
                    # (change requires restart)

# - Security and Authentication -

#authentication_timeout = 1min # 1s-600s
#ssl = off # (change requires restart)
#ssl_ciphers = 'DEFAULT:!LOW:!EXP:!MD5:@STRENGTH' # allowed SSL ciphers
                    # (change requires restart)
#ssl_renegotiation_limit = 512MB # amount of data between renegotiations
#ssl_cert_file = 'server.crt' # (change requires restart)
#ssl_key_file = 'server.key' # (change requires restart)
#ssl_ca_file = '' # (change requires restart)
#ssl_crl_file = '' # (change requires restart)
#password_encryption = on
#db_user_namespace = off

# Kerberos and GSSAPI
#krb_server_keyfile = ''
#krb_srvname = 'postgres' # (Kerberos only)
#krb_caseins_users = off

# - TCP Keepalives -
# see "man 7 tcp" for details

#tcp_keepalives_idle = 0 # TCP_KEEPIDLE, in seconds;
                    # 0 selects the system default
#tcp_keepalives_interval = 0 # TCP_KEEPINTVL, in seconds;
                    # 0 selects the system default
#tcp_keepalives_count = 0 # TCP_KEEPCNT;
                    # 0 selects the system default


#------------------------------------------------------------------------------
# RESOURCE USAGE (except WAL)
#------------------------------------------------------------------------------

# - Memory -

shared_buffers=8GB
#shared_buffers = 128MB # min 128kB
                    # (change requires restart)
#temp_buffers = 8MB # min 800kB
#max_prepared_transactions = 0 # zero disables the feature
                    # (change requires restart)
# Note: Increasing max_prepared_transactions costs 0000151:0000600 bytes of shared memory
# per transaction slot, plus lock space (see max_locks_per_transaction).
# It is not advisable to set max_prepared_transactions nonzero unless you
# actively intend to use prepared transactions.
work_mem=400MB
#work_mem = 1MB # min 64kB
maintenance_work_mem=600MB
#maintenance_work_mem = 16MB # min 1MB
#max_stack_depth = 2MB # min 100kB

# - Disk -

#temp_file_limit = -1 # limits per-session temp file space
                    # in kB, or -1 for no limit

# - Kernel Resource Usage -

#max_files_per_process = 1000 # min 25
                    # (change requires restart)
#shared_preload_libraries = '' # (change requires restart)

# - Cost-Based Vacuum Delay -

#vacuum_cost_delay = 0 # 0-100 milliseconds
#vacuum_cost_page_hit = 1 # 0-10000 credits
#vacuum_cost_page_miss = 10 # 0-10000 credits
#vacuum_cost_page_dirty = 20 # 0-10000 credits
vacuum_cost_limit=500
#vacuum_cost_limit = 200 # 1-10000 credits

# - Background Writer -

#bgwriter_delay = 200ms # 10-10000ms between rounds
#bgwriter_lru_maxpages = 100 # 0-1000 max buffers written/round
#bgwriter_lru_multiplier = 2.0 # 0-10.0 multipler on buffers scanned/round

# - Asynchronous Behavior -

#effective_io_concurrency = 1 # 1-1000; 0 disables prefetching


#------------------------------------------------------------------------------
# WRITE AHEAD LOG
#------------------------------------------------------------------------------

# - Settings -

wal_level = hot_standby # minimal, archive, or hot_standby
                    # (change requires restart)
#fsync = on # turns forced synchronization on or off
#synchronous_commit = on # synchronization level;
                    # off, local, remote_write, or on
#wal_sync_method = fsync # the default is the first option
                    # supported by the operating system:
                    # open_datasync
                    # fdatasync (default on Linux)
                    # fsync
                    # fsync_writethrough
                    # open_sync
#full_page_writes = on # recover from partial page writes
wal_buffers=80MB
#wal_buffers = -1 # min 32kB, -1 sets based on shared_buffers
                    # (change requires restart)
#wal_writer_delay = 200ms # 1-10000 milliseconds

#commit_delay = 0 # range 0-100000, in microseconds
#commit_siblings = 5 # range 1-1000

# - Checkpoints -

checkpoint_segments=128
#checkpoint_segments = 3 # in logfile segments, min 1, 16MB each
checkpoint_timeout=10min
#checkpoint_timeout = 5min # range 30s-1h
checkpoint_completion_target=0.8
#checkpoint_completion_target = 0.5 # checkpoint target duration, 0.0 - 1.0
#checkpoint_warning = 30s # 0 disables

# - Archiving -

archive_mode = on # allows archiving to be done
                # (change requires restart)

archive_command = 'rsync -a %p isdb8@192.168.1.9:/pgdata/postgresql-data-8/wals/%f' # command to use to archive a logfile segment
                # placeholders: %p = path of file to archive
                # %f = file name only
                # e.g. 'test ! -f /mnt/server/archivedir/%f && cp %p /mnt/server/archivedir/%f'
#archive_timeout = 0 # force a logfile segment switch after this
                # number of seconds; 0 disables
 

#------------------------------------------------------------------------------
# REPLICATION
#------------------------------------------------------------------------------

# - Sending Server(s) -

# Set these on the master and on any standby that will send replication data.

max_wal_senders = 2 # max number of walsender processes
                # (change requires restart)
wal_keep_segments = 32 # in logfile segments, 16MB each; 0 disables
#wal_sender_timeout = 60s # in milliseconds; 0 disables

# - Master Server -

# These settings are ignored on a standby server.

#synchronous_standby_names = '' # standby servers that provide sync rep
                # comma-separated list of application_name
                # from standby(s); '*' = all
#vacuum_defer_cleanup_age = 0 # number of xacts by which cleanup is delayed

# - Standby Servers -

# These settings are ignored on a master server.

hot_standby = on # "on" allows queries during recovery
                    # (change requires restart)
#max_standby_archive_delay = 30s # max delay before canceling queries
                    # when reading WAL from archive;
                    # -1 allows indefinite delay
#max_standby_streaming_delay = 30s # max delay before canceling queries
                    # when reading streaming WAL;
                    # -1 allows indefinite delay
#wal_receiver_status_interval = 10s # send replies at least this often
                    # 0 disables
#hot_standby_feedback = off # send info from standby to prevent
                    # query conflicts
#wal_receiver_timeout = 60s # time that receiver waits for
                    # communication from master
                    # in milliseconds; 0 disables


#------------------------------------------------------------------------------
# QUERY TUNING
#------------------------------------------------------------------------------

# - Planner Method Configuration -

#enable_bitmapscan = on
#enable_hashagg = on
#enable_hashjoin = on
#enable_indexscan = on
#enable_indexonlyscan = on
#enable_material = on
#enable_mergejoin = on
#enable_nestloop = on
#enable_seqscan = on
#enable_sort = on
#enable_tidscan = on

# - Planner Cost Constants -

#seq_page_cost = 1.0 # measured on an arbitrary scale
random_page_cost=3
#random_page_cost = 4.0 # same scale as above
#cpu_tuple_cost = 0.01 # same scale as above
#cpu_index_tuple_cost = 0.005 # same scale as above
#cpu_operator_cost = 0.0025 # same scale as above
effective_cache_size=16GB
#effective_cache_size = 128MB

# - Genetic Query Optimizer -

#geqo = on
#geqo_threshold = 12
#geqo_effort = 5 # range 1-10
#geqo_pool_size = 0 # selects default based on effort
#geqo_generations = 0 # selects default based on effort
#geqo_selection_bias = 2.0 # range 1.5-2.0
#geqo_seed = 0.0 # range 0.0-1.0

# - Other Planner Options -

default_statistics_target=60
#default_statistics_target = 100 # range 1-10000
#constraint_exclusion = partition # on, off, or partition
#cursor_tuple_fraction = 0.1 # range 0.0-1.0
#from_collapse_limit = 8
#join_collapse_limit = 8 # 1 disables collapsing of explicit
                    # JOIN clauses


#------------------------------------------------------------------------------
# ERROR REPORTING AND LOGGING
#------------------------------------------------------------------------------

# - Where to Log -

log_destination='stderr,csvlog'
#log_destination = 'stderr' # Valid values are combinations of
                    # stderr, csvlog, syslog, and eventlog,
                    # depending on platform. csvlog
                    # requires logging_collector to be on.

# This is used when logging to stderr:
logging_collector=on
#logging_collector = off # Enable capturing of stderr and csvlog
                    # into log files. Required to be on for
                    # csvlogs.
                    # (change requires restart)

# These are only used if logging_collector is on:
#log_directory = 'pg_log' # directory where log files are written,
                    # can be absolute or relative to PGDATA
log_filename='master-%Y%m%d_%H%M.log'
#log_filename = 'postgresql-%Y-%m-%d_%H%M%S.log' # log file name pattern,
                    # can include strftime() escapes
#log_file_mode = 0600 # creation mode for log files,
                    # begin with 0 to use octal notation
#log_truncate_on_rotation = off # If on, an existing log file with the
                    # same name as the new log file will be
                    # truncated rather than appended to.
                    # But such truncation only occurs on
                    # time-driven rotation, not on restarts
                    # or size-driven rotation. Default is
                    # off, meaning append to existing files
                    # in all cases.
log_rotation_age=60min
#log_rotation_age = 1d # Automatic rotation of logfiles will
                    # happen after that time. 0 disables.
#log_rotation_size = 10MB # Automatic rotation of logfiles will
                    # happen after that much log output.
                    # 0 disables.

# These are relevant when logging to syslog:
#syslog_facility = 'LOCAL0'
#syslog_ident = 'postgres'

# This is only relevant when logging to eventlog (win32):
#event_source = 'PostgreSQL'

# - When to Log -

#client_min_messages = notice # values in order of decreasing detail:
                    # debug5
                    # debug4
                    # debug3
                    # debug2
                    # debug1
                    # log
                    # notice
                    # warning
                    # error

log_min_messages=warning
#log_min_messages = warning # values in order of decreasing detail:
                    # debug5
                    # debug4
                    # debug3
                    # debug2
                    # debug1
                    # info
                    # notice
                    # warning
                    # error
                    # log
                    # fatal
                    # panic

log_min_error_statement=error
#log_min_error_statement = error # values in order of decreasing detail:
                    # debug5
                    # debug4
                    # debug3
                    # debug2
                    # debug1
                    # info
                    # notice
                    # warning
                    # error
                    # log
                    # fatal
                    # panic (effectively off)

log_min_duration_statement=5000
#log_min_duration_statement = -1 # -1 is disabled, 0 logs all statements
                    # and their durations, > 0 logs only
                    # statements running at least this number
                    # of milliseconds


# - What to Log -

#debug_print_parse = off
#debug_print_rewritten = off
#debug_print_plan = off
#debug_pretty_print = on
log_checkpoints=on
#log_checkpoints = off
log_connections = on
#log_disconnections = off
#log_duration = off
#log_error_verbosity = default # terse, default, or verbose messages
#log_hostname = off
log_line_prefix='%t|%c|%p|%u|'
#log_line_prefix = '' # special values:
                    # %a = application name
                    # %u = user name
                    # %d = database name
                    # %r = remote host and port
                    # %h = remote host
                    # %p = process ID
                    # %t = timestamp without milliseconds
                    # %m = timestamp with milliseconds
                    # %i = command tag
                    # %e = SQL state
                    # %c = session ID
                    # %l = session line number
                    # %s = session start timestamp
                    # %v = virtual transaction ID
                    # %x = transaction ID (0 if none)
                    # %q = stop here in non-session
                    # processes
                    # %% = '%'
                    # e.g. '<%u%%%d> '
log_lock_waits=on
#log_lock_waits = off # log lock waits >= deadlock_timeout
#log_statement = 'all' # none, ddl, mod, all
log_temp_files=500MB
#log_temp_files = -1 # log temporary files equal or larger
                    # than the specified size in kilobytes;
                    # -1 disables, 0 logs all temp files
log_timezone = 'Europe/Berlin'


#------------------------------------------------------------------------------
# RUNTIME STATISTICS
#------------------------------------------------------------------------------

# - Query/Index Statistics Collector -

#track_activities = on
#track_counts = on
#track_io_timing = off
#track_functions = none # none, pl, all
#track_activity_query_size = 1024 # (change requires restart)
#update_process_title = on
#stats_temp_directory = 'pg_stat_tmp'


# - Statistics Monitoring -

#log_parser_stats = off
#log_planner_stats = off
#log_executor_stats = off
#log_statement_stats = off


#------------------------------------------------------------------------------
# AUTOVACUUM PARAMETERS
#------------------------------------------------------------------------------

autovacuum=on
#autovacuum = on # Enable autovacuum subprocess? 'on'
                    # requires track_counts to also be on.
#log_autovacuum_min_duration = -1 # -1 disables, 0 logs all actions and
                    # their durations, > 0 logs only
                    # actions running at least this number
                    # of milliseconds.
autovacuum_max_workers=2
#autovacuum_max_workers = 3 # max number of autovacuum subprocesses
                    # (change requires restart)
autovacuum_naptime=3min
#autovacuum_naptime = 1min # time between autovacuum runs
#autovacuum_vacuum_threshold = 50 # min number of row updates before
                    # vacuum
#autovacuum_analyze_threshold = 50 # min number of row updates before
                    # analyze
autovacuum_vacuum_scale_factor=0.1
#autovacuum_vacuum_scale_factor = 0.2 # fraction of table size before vacuum
#autovacuum_analyze_scale_factor = 0.1 # fraction of table size before analyze
autovacuum_freeze_max_age=1500000000
#autovacuum_freeze_max_age = 200000000 # maximum XID age before forced vacuum
                    # (change requires restart)
#autovacuum_multixact_freeze_max_age = 400000000 # maximum Multixact age
                    # before forced vacuum
                    # (change requires restart)
autovacuum_vacuum_cost_delay=100ms
#autovacuum_vacuum_cost_delay = 20ms # default vacuum cost delay for
                    # autovacuum, in milliseconds;
                    # -1 means use vacuum_cost_delay
#autovacuum_vacuum_cost_limit = -1 # default vacuum cost limit for
                    # autovacuum, -1 means use
                    # vacuum_cost_limit


#------------------------------------------------------------------------------
# CLIENT CONNECTION DEFAULTS
#------------------------------------------------------------------------------

# - Statement Behavior -

#search_path = '"$user",public' # schema names
#default_tablespace = '' # a tablespace name, '' uses the default
#temp_tablespaces = '' # a list of tablespace names, '' uses
                    # only default tablespace
#check_function_bodies = on
#default_transaction_isolation = 'read committed'
#default_transaction_read_only = off
#default_transaction_deferrable = off
#session_replication_role = 'origin'
#statement_timeout = 0 # in milliseconds, 0 is disabled
#lock_timeout = 0 # in milliseconds, 0 is disabled
vacuum_freeze_min_age=50000000
#vacuum_freeze_min_age = 50000000
#vacuum_freeze_table_age = 150000000
#vacuum_multixact_freeze_min_age = 5000000
#vacuum_multixact_freeze_table_age = 150000000
#bytea_output = 'hex' # hex, escape
#xmlbinary = 'base64'
#xmloption = 'content'

# - Locale and Formatting -

datestyle = 'iso, mdy'
#intervalstyle = 'postgres'
timezone = 'Europe/Berlin'
#timezone_abbreviations = 'Default' # Select the set of available time zone
                    # abbreviations. Currently, there are
                    # Default
                    # Australia
                    # India
                    # You can create your own file in
                    # share/timezonesets/.
#extra_float_digits = 0 # min -15, max 3
#client_encoding = sql_ascii # actually, defaults to database
                    # encoding

# These settings are initialized by initdb, but they can be changed.
lc_messages = 'en_US.UTF-8' # locale for system error message
                    # strings
lc_monetary = 'en_US.UTF-8' # locale for monetary formatting
lc_numeric = 'en_US.UTF-8' # locale for number formatting
lc_time = 'en_US.UTF-8' # locale for time formatting

# default configuration for text search
default_text_search_config = 'pg_catalog.english'

# - Other Defaults -

#dynamic_library_path = '$libdir'
#local_preload_libraries = ''


#------------------------------------------------------------------------------
# LOCK MANAGEMENT
#------------------------------------------------------------------------------

#deadlock_timeout = 1s
max_locks_per_transaction=1500
#max_locks_per_transaction = 64 # min 10
                    # (change requires restart)
# Note: Each lock table slot uses 0000059:0000270 bytes of shared memory, and there are
max_locks_per_transaction=1500
# max_locks_per_transaction * (max_connections + max_prepared_transactions)
# lock table slots.
#max_pred_locks_per_transaction = 64 # min 10
                    # (change requires restart)


#------------------------------------------------------------------------------
# VERSION/PLATFORM COMPATIBILITY
#------------------------------------------------------------------------------

# - Previous PostgreSQL Versions -

#array_nulls = on
#backslash_quote = safe_encoding # on, off, or safe_encoding
#default_with_oids = off
#escape_string_warning = on
#lo_compat_privileges = off
#quote_all_identifiers = off
#sql_inheritance = on
#standard_conforming_strings = on
#synchronize_seqscans = on

# - Other Platforms and Clients -

#transform_null_equals = off


#------------------------------------------------------------------------------
# ERROR HANDLING
#------------------------------------------------------------------------------

#exit_on_error = off # terminate session on any error?
#restart_after_crash = on # reinitialize after backend crash?


#------------------------------------------------------------------------------
# CONFIG FILE INCLUDES
#------------------------------------------------------------------------------

# These options allow settings to be loaded from files other than the
# default postgresql.conf.

#include_dir = 'conf.d' # include files ending in '.conf' from
                    # directory 'conf.d'
#include_if_exists = 'exists.conf' # include file only if it exists
#include = 'special.conf' # include file


2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend X(58)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 LOG: pid 5524: statement: DISCARD ALL
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: send_to_where: 3 query: DISCARD ALL
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: S
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: S
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: S
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: S
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend S
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: S from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: parameter name: is_superuser value: off
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: S from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: parameter name: session_authorization value: cicnew
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: C from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend C NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: C
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d070f0 is still used. query:select z_start_walog2cvs($1,$2)
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d070f0 is still used. query:select z_start_walog2cvs($1,$2)
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d070f0 is still used for 2 times.
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d070f0 is still used. query:select z_start_walog2cvs($1,$2)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend Z
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: Z from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: Z
2014-07-02 09:31:49 DEBUG: pid 5524: pool_read_message_length: slot: 0 length: 5
2014-07-02 09:31:49 DEBUG: pid 5524: ReadyForQuery: transaction state:I
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: Ready For Query
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_connection_pool_timer: set close time 1404286309
2014-07-02 09:31:49 DEBUG: pid 5524: I am 5524 accept fd 6
2014-07-02 09:31:49 DEBUG: pid 5524: Protocol Major: 3 Minor: 0 database: cic_db user: cicnew
2014-07-02 09:31:49 DEBUG: pid 5524: pool_send_auth_ok: send pid 6965 to frontend
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_writing_transaction: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_failed_transaction: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_transaction_isolation: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_skip_reading_from_backends: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_ignore_till_sync: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend P(50)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: statement name <>
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: send_to_where: 3 query: SET extra_float_digits = 3
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 1 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 1 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 1
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend B(42)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Bind: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 2
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 2 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 2 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 2
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend E(45)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: portal name <>
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: query string = <SET extra_float_digits = 3>
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend C
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: C from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend C NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: C
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend S(53)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend Z
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: Z from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: Z
2014-07-02 09:31:49 DEBUG: pid 5524: pool_read_message_length: slot: 0 length: 5
2014-07-02 09:31:49 DEBUG: pid 5524: ReadyForQuery: transaction state:I
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: Ready For Query
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend P(50)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: statement name <>
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_has_insertinto_or_locking_clause: returns 0
2014-07-02 09:31:49 DEBUG: pid 5524: send_to_where: 2 query: select get_pg_setting('cic.oraMasterCheck')
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 1 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 1 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 1
2014-07-02 09:31:49 DEBUG: pid 5524: pool_add_sent_message: prepared statement "" already exists
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06830 is still used. query:SET extra_float_digits = 3
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06830 is still used. query:SET extra_float_digits = 3
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06830 is still used for 2 times.
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend B(42)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Bind: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 2
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 2 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 2 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 2
2014-07-02 09:31:49 DEBUG: pid 5524: pool_add_sent_message: portal "" already exists
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06830 is still used. query:SET extra_float_digits = 3
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend D(44)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Describe: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend T
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: T from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend T NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: T
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend E(45)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: portal name <>
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: query string = <select get_pg_setting('cic.oraMasterCheck')>
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend D
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: D from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend D NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: D
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend C
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: C from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend C NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: C
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend S(53)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend Z
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: Z from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: Z
2014-07-02 09:31:49 DEBUG: pid 5524: pool_read_message_length: slot: 0 length: 5
2014-07-02 09:31:49 DEBUG: pid 5524: ReadyForQuery: transaction state:I
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: Ready For Query
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend P(50)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: statement name <>
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_has_insertinto_or_locking_clause: returns 0
2014-07-02 09:31:49 DEBUG: pid 5524: send_to_where: 2 query: select $1===>'current_cicdomain'
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 1 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 1 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 1
2014-07-02 09:31:49 DEBUG: pid 5524: pool_add_sent_message: prepared statement "" already exists
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d091f0 is still used. query:select get_pg_setting('cic.oraMasterCheck')
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d091f0 is still used. query:select get_pg_setting('cic.oraMasterCheck')
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d091f0 is still used for 2 times.
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend B(42)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Bind: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 2
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 2 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 2 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 2
2014-07-02 09:31:49 DEBUG: pid 5524: pool_add_sent_message: portal "" already exists
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d091f0 is still used. query:select get_pg_setting('cic.oraMasterCheck')
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend D(44)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Describe: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend T
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: T from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend T NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: T
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend E(45)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: portal name <>
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: query string = <select $1===>'current_cicdomain'>
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend D
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: D from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend D NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: D
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend C
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: C from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend C NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: C
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend S(53)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend Z
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: Z from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: Z
2014-07-02 09:31:49 DEBUG: pid 5524: pool_read_message_length: slot: 0 length: 5
2014-07-02 09:31:49 DEBUG: pid 5524: ReadyForQuery: transaction state:I
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: Ready For Query
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend P(50)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: statement name <>
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_has_insertinto_or_locking_clause: returns 0
2014-07-02 09:31:49 DEBUG: pid 5524: send_to_where: 2 query: select z_start_walog2cvs($1,$2)
2014-07-02 09:31:49 DEBUG: pid 5524: Parse: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: detect_error: kind: 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 1
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 1 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 1 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 1
2014-07-02 09:31:49 DEBUG: pid 5524: pool_add_sent_message: prepared statement "" already exists
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06c80 is still used. query:select $1===>'current_cicdomain'
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06c80 is still used. query:select $1===>'current_cicdomain'
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06c80 is still used for 2 times.
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend B(42)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Bind: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend 2
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: 2 from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend 2 NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: 2
2014-07-02 09:31:49 DEBUG: pid 5524: pool_add_sent_message: portal "" already exists
2014-07-02 09:31:49 DEBUG: pid 5524: can_query_context_destroy: query context 0x1d06c80 is still used. query:select $1===>'current_cicdomain'
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend D(44)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Describe: waiting for master completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend T
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: T from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend T NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: T
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend E(45)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: portal name <>
2014-07-02 09:31:49 DEBUG: pid 5524: Execute: query string = <select z_start_walog2cvs($1,$2)>
2014-07-02 09:31:49 DEBUG: pid 5524: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend D
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: D from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend D NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: D
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend C
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: C from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend C NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: C
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_command_success: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessFrontendResponse: kind from frontend S(53)
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_doing_extended_query_message: done
2014-07-02 09:31:49 DEBUG: pid 5524: pool_set_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_one_backend: read kind from 0 th backend Z
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: kind: Z from 0 th backend
2014-07-02 09:31:49 DEBUG: pid 5524: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 2
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: kind from backend: Z
2014-07-02 09:31:49 DEBUG: pid 5524: pool_read_message_length: slot: 0 length: 5
2014-07-02 09:31:49 DEBUG: pid 5524: ReadyForQuery: transaction state:I
2014-07-02 09:31:49 DEBUG: pid 5524: pool_unset_query_in_progress: done
2014-07-02 09:31:49 DEBUG: pid 5524: ProcessBackendResponse: Ready For Query
2014-07-02 09:31:59 DEBUG: pid 11291: starting health checking
2014-07-02 09:31:59 DEBUG: pid 11291: health check: clearing alarm
2014-07-02 09:31:59 DEBUG: pid 11291: health_check: 0 th DB node status: 2
2014-07-02 09:31:59 DEBUG: pid 11291: pool_ssl: SSL requested but SSL support is not available
2014-07-02 09:31:59 DEBUG: pid 11291: s_do_auth: auth kind: 0
2014-07-02 09:31:59 DEBUG: pid 11291: s_do_auth: backend key data received
2014-07-02 09:31:59 DEBUG: pid 11291: s_do_auth: transaction state: I
2014-07-02 09:31:59 DEBUG: pid 11291: health_check: 1 th DB node status: 3
2014-07-02 09:31:59 DEBUG: pid 11291: health check: clearing alarm
2014-07-02 09:31:59 DEBUG: pid 11291: health check: clearing alarm
2014-07-02 09:32:29 DEBUG: pid 11291: starting health checking


No errors logged on the Master Database



TagsNo tags attached.

Activities

deepak.kothandan

2014-07-02 17:15

reporter  

pgpool.conf (31,416 bytes)

deepak.kothandan

2014-07-02 17:35

reporter   ~0000435

Please ignore the above pgpool logs

ReadyForQuery: transaction state:I
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: Ready For Query
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessFrontendResponse: kind from frontend P(50)
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: Parse: statement name <>
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_has_insertinto_or_locking_clause: returns 0
2014-07-02 10:29:46 DEBUG: pid 11925: send_to_where: 2 query: select z_start_walog2cvs($1,$2)
2014-07-02 10:29:46 DEBUG: pid 11925: Parse: waiting for master completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: detect_error: kind: 1
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_one_backend: read kind from 0 th backend 1
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: kind: 1 from 0 th backend
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: read kind from 0 th backend 1 NUM_BACKENDS: 2
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: kind from backend: 1
2014-07-02 10:29:46 DEBUG: pid 11925: pool_add_sent_message: prepared statement "" already exists
2014-07-02 10:29:46 DEBUG: pid 11925: can_query_context_destroy: query context 0x1eef1b0 is still used. query:select $1===>'current_cicdomain'
2014-07-02 10:29:46 DEBUG: pid 11925: can_query_context_destroy: query context 0x1eef1b0 is still used. query:select $1===>'current_cicdomain'
2014-07-02 10:29:46 DEBUG: pid 11925: can_query_context_destroy: query context 0x1eef1b0 is still used for 2 times.
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_command_success: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessFrontendResponse: kind from frontend B(42)
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: Bind: waiting for master completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_one_backend: read kind from 0 th backend 2
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: kind: 2 from 0 th backend
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: read kind from 0 th backend 2 NUM_BACKENDS: 2
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: kind from backend: 2
2014-07-02 10:29:46 DEBUG: pid 11925: pool_add_sent_message: portal "" already exists
2014-07-02 10:29:46 DEBUG: pid 11925: can_query_context_destroy: query context 0x1eef1b0 is still used. query:select $1===>'current_cicdomain'
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_command_success: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessFrontendResponse: kind from frontend D(44)
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: Describe: waiting for master completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_one_backend: read kind from 0 th backend T
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: kind: T from 0 th backend
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: read kind from 0 th backend T NUM_BACKENDS: 2
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: kind from backend: T
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessFrontendResponse: kind from frontend E(45)
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: Execute: portal name <>
2014-07-02 10:29:46 DEBUG: pid 11925: Execute: query string = <select z_start_walog2cvs($1,$2)>
2014-07-02 10:29:46 DEBUG: pid 11925: wait_for_query_response: waiting for backend 0 completing the query
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_one_backend: read kind from 0 th backend D
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: kind: D from 0 th backend
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: read kind from 0 th backend D NUM_BACKENDS: 2
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: kind from backend: D
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_one_backend: read kind from 0 th backend C
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: kind: C from 0 th backend
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: read kind from 0 th backend C NUM_BACKENDS: 2
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: kind from backend: C
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_command_success: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessFrontendResponse: kind from frontend S(53)
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_doing_extended_query_message: done
2014-07-02 10:29:46 DEBUG: pid 11925: pool_set_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_one_backend: read kind from 0 th backend Z
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: kind: Z from 0 th backend
2014-07-02 10:29:46 DEBUG: pid 11925: read_kind_from_backend: read kind from 0 th backend Z NUM_BACKENDS: 2
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: kind from backend: Z
2014-07-02 10:29:46 DEBUG: pid 11925: pool_read_message_length: slot: 0 length: 5
2014-07-02 10:29:46 DEBUG: pid 11925: ReadyForQuery: transaction state:I
2014-07-02 10:29:46 DEBUG: pid 11925: pool_unset_query_in_progress: done
2014-07-02 10:29:46 DEBUG: pid 11925: ProcessBackendResponse: Ready For Query
2014-07-02 10:29:48 DEBUG: pid 11919: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:29:48 DEBUG: pid 11919: s_do_auth: auth kind: 0
2014-07-02 10:29:48 DEBUG: pid 11919: s_do_auth: backend key data received
2014-07-02 10:29:48 DEBUG: pid 11919: s_do_auth: transaction state: I
2014-07-02 10:29:48 DEBUG: pid 11919: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:29:48 DEBUG: pid 11919: s_do_auth: auth kind: 0
2014-07-02 10:29:48 DEBUG: pid 11919: s_do_auth: backend key data received
2014-07-02 10:29:48 DEBUG: pid 11919: s_do_auth: transaction state: I
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: T
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: row description received
2014-07-02 10:29:48 DEBUG: pid 11919: num_fileds: 1
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: D
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: data row received
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: C
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: Command complete received
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: Z
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: Ready for query
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: T
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: row description received
2014-07-02 10:29:48 DEBUG: pid 11919: num_fileds: 1
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: D
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: data row received
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: C
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: Command complete received
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: kind: Z
2014-07-02 10:29:48 DEBUG: pid 11919: do_query: Ready for query
2014-07-02 10:30:08 DEBUG: pid 11884: starting health checking
2014-07-02 10:30:08 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:30:08 DEBUG: pid 11884: health_check: 0 th DB node status: 2
2014-07-02 10:30:08 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:30:08 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:30:08 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:30:08 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:30:08 DEBUG: pid 11884: health_check: 1 th DB node status: 2
2014-07-02 10:30:08 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:30:08 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:30:08 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:30:08 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:30:08 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:30:08 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:30:38 DEBUG: pid 11884: starting health checking
2014-07-02 10:30:38 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:30:38 DEBUG: pid 11884: health_check: 0 th DB node status: 2
2014-07-02 10:30:38 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:30:38 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:30:38 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:30:38 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:30:38 DEBUG: pid 11884: health_check: 1 th DB node status: 2
2014-07-02 10:30:38 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:30:38 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:30:38 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:30:38 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:30:38 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:30:38 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:30:48 DEBUG: pid 11919: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:30:48 DEBUG: pid 11919: s_do_auth: auth kind: 0
2014-07-02 10:30:48 DEBUG: pid 11919: s_do_auth: backend key data received
2014-07-02 10:30:48 DEBUG: pid 11919: s_do_auth: transaction state: I
2014-07-02 10:30:48 DEBUG: pid 11919: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:30:48 DEBUG: pid 11919: s_do_auth: auth kind: 0
2014-07-02 10:30:48 DEBUG: pid 11919: s_do_auth: backend key data received
2014-07-02 10:30:48 DEBUG: pid 11919: s_do_auth: transaction state: I
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: extended:0 query:SELECT pg_current_xlog_location()
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: T
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: row description received
2014-07-02 10:30:48 DEBUG: pid 11919: num_fileds: 1
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: D
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: data row received
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: C
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: Command complete received
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: Z
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: Ready for query
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: extended:0 query:SELECT pg_last_xlog_replay_location()
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: T
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: row description received
2014-07-02 10:30:48 DEBUG: pid 11919: num_fileds: 1
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: D
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: data row received
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: C
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: Command complete received
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: kind: Z
2014-07-02 10:30:48 DEBUG: pid 11919: do_query: Ready for query
2014-07-02 10:31:08 DEBUG: pid 11884: starting health checking
2014-07-02 10:31:08 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:31:08 DEBUG: pid 11884: health_check: 0 th DB node status: 2
2014-07-02 10:31:08 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:31:08 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:31:08 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:31:08 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:31:08 DEBUG: pid 11884: health_check: 1 th DB node status: 2
2014-07-02 10:31:08 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:31:08 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:31:08 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:31:08 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:31:08 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:31:08 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:31:39 DEBUG: pid 11884: starting health checking
2014-07-02 10:31:39 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:31:39 DEBUG: pid 11884: health_check: 0 th DB node status: 2
2014-07-02 10:31:39 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:31:39 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:31:39 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:31:39 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:31:39 DEBUG: pid 11884: health_check: 1 th DB node status: 2
2014-07-02 10:31:39 DEBUG: pid 11884: pool_ssl: SSL requested but SSL support is not available
2014-07-02 10:31:39 DEBUG: pid 11884: s_do_auth: auth kind: 0
2014-07-02 10:31:39 DEBUG: pid 11884: s_do_auth: backend key data received
2014-07-02 10:31:39 DEBUG: pid 11884: s_do_auth: transaction state: I
2014-07-02 10:31:39 DEBUG: pid 11884: health check: clearing alarm
2014-07-02 10:31:39 DEBUG: pid 11884: health check: clearing alarm

t-ishii

2014-07-02 18:17

developer   ~0000436

Do you know how to reproduce the problem? If you could provide minimum set of test program, that would be the best.

deepak.kothandan

2014-07-02 18:35

reporter   ~0000437

I am not sure as how the problem can be reproduced. The application imports csv files to postgres and during the import, the connection just hangs and the process that actually happens is I believe to be

1)Pgpool executes the query on backend received from frontend (<select z_start_walog2cvs($1,$2)>)
2)And backend replies to pgpool with C
3)Finally pgpool sends S(53)to front end

t-ishii

2014-07-02 19:00

developer   ~0000438

Actually,
1)Pgpool executes the query.
2)And backend replies to pgpool with C
3)Frontend sends S to pgpool
4)Pgpool sends S to backend
5)Backend replies to pgpool with Z

Anyway, because you set num_init_children to 5, it is expected that if you execute the same process 5 times, pgpool would not accept new connections any more. Am I correct?

Also I wonder if there's anything special with the z_start_walog2cvs function? I believe it reads data from a CSV file on the same host which PostgreSQL is running on.

deepak.kothandan

2014-07-02 19:12

reporter   ~0000439

Yes, the function does read a file from the same host but the parameter passed to the function varies, the parameters are passed by thee application. I even tried with num_init_children set to a max of 14 but the process failed to execute.
What does Z mean..

t-ishii

2014-07-02 19:17

developer   ~0000440

Z means "ready for query", which is the sign that backend is ready to accept new query.

deepak.kothandan

2014-07-02 19:20

reporter   ~0000441

Last edited: 2014-07-02 19:21

View 2 revisions

But then, pgpool actually does not accept any queries after this,not even through psql. Is there any other log information that you might require in order to understand the issue better.? Any other suggestion that you might provide to overcome the issue..? Also entries prepared statement""already exists and portal"already exists can also be found in the logs, do they refer to any problem..?

t-ishii

2014-07-02 19:31

developer   ~0000442

prepared statement""already exists and portal"already exist...
They are normal.

Anyway for some reason I don't know pgpool-II seems to wait for something coming from either frontend or backend. Is it possible for you to recompile pgpool with -g option of gcc and attach gdb to pgpool and take stack trace when it hangs? That might help me to find the cause of the problem.

deepak.kothandan

2014-07-02 19:37

reporter   ~0000443

Would it work if I take an strace..?

deepak.kothandan

2014-07-03 15:50

reporter   ~0000445

back trace for pgpool process

#0 0x00007f2408363273 in __select_nocancel () from /lib64/libc.so.6
0000001 0x00000000004073bb in pool_pause (timeout=<optimized out>) at main.c:2615
0000002 0x00000000004087aa in pool_sleep (second=<optimized out>) at main.c:2651
0000003 0x0000000000406569 in main (argc=<optimized out>, argv=<optimized out>) at main.c:836

worker process
#0 0x00007f240833b1b0 in __nanosleep_nocancel () from /lib64/libc.so.6
0000001 0x00007f240833b0db in sleep () from /lib64/libc.so.6
0000002 0x0000000000456ac3 in do_worker_child () at pool_worker_child.c:141
0000003 0x0000000000407949 in worker_fork_a_child () at main.c:1279
0000004 0x0000000000408090 in reaper () at main.c:2427
0000005 reaper () at main.c:2369
0000006 0x000000000040887d in pool_sleep (second=<optimized out>) at main.c:2654
0000007 0x0000000000406569 in main (argc=<optimized out>, argv=<optimized out>) at main.c:836

t-ishii

2014-07-31 19:22

developer   ~0000457

Recently we have fixed similar problem in bug 107.
Patches are attached in the report. Or you could try the newest RPM (3.3.3-4) which includes the fix.

a82singh

2015-07-02 15:17

reporter   ~0000545

Last edited: 2015-07-02 15:18

View 2 revisions

Hi t-ishii-san

i am also facing similar issue to

http://www.pgpool.net/mantisbt/view.php?id=107

how to apply the patch in the running system ?

any latest release of PGPOOL has already the fix ?

Issue History

Date Modified Username Field Change
2014-07-02 17:15 deepak.kothandan New Issue
2014-07-02 17:15 deepak.kothandan File Added: pgpool.conf
2014-07-02 17:35 deepak.kothandan Note Added: 0000435
2014-07-02 18:17 t-ishii Note Added: 0000436
2014-07-02 18:17 t-ishii Assigned To => t-ishii
2014-07-02 18:17 t-ishii Status new => assigned
2014-07-02 18:18 t-ishii Status assigned => feedback
2014-07-02 18:35 deepak.kothandan Note Added: 0000437
2014-07-02 18:35 deepak.kothandan Status feedback => assigned
2014-07-02 19:00 t-ishii Note Added: 0000438
2014-07-02 19:12 deepak.kothandan Note Added: 0000439
2014-07-02 19:17 t-ishii Note Added: 0000440
2014-07-02 19:20 deepak.kothandan Note Added: 0000441
2014-07-02 19:21 deepak.kothandan Note Edited: 0000441 View Revisions
2014-07-02 19:31 t-ishii Note Added: 0000442
2014-07-02 19:37 deepak.kothandan Note Added: 0000443
2014-07-03 15:50 deepak.kothandan Note Added: 0000445
2014-07-31 19:22 t-ishii Note Added: 0000457
2014-07-31 19:23 t-ishii Status assigned => feedback
2015-07-02 15:17 a82singh Note Added: 0000545
2015-07-02 15:18 a82singh Note Edited: 0000545 View Revisions
2015-08-04 10:03 t-ishii Status feedback => resolved