View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0000408Pgpool-IIBugpublic2018-07-01 00:142018-08-06 11:29
Reporternenominal Assigned Tot-ishii  
PriorityhighSeveritymajorReproducibilityalways
Status closedResolutionopen 
PlatformLinuxOSCentOSOS Version7.5
Product Version3.7.4 
Summary0000408: Connection hangs in DISCARD mode on the backend server
DescriptionHi,

brand new to pgpool, I've been playing with it for few weeks now but I hit an issue and I don't know if it's a bug or a miss-configuration on my side.
I've created a loadbalanced pgpool 3.7.4 with Postgresql 9.5 on CentOS 7.5 x64, stream mode. The config file is attached to issue.

For pre-production mode we've migrated an aplication to cluster to see what happens in real environment. The application is a java based and to connect to pool is using hibernate:

<property name="hibernate.c3p0.min_size">20</property>
<property name="hibernate.c3p0.max_size">60</property>
<property name="hibernate.c3p0.preferredTestQuery">select 1</property>
<property name="hibernate.c3p0.timeout">30</property>


The problem I'm facing and is that after a while the pool consumes lots of connections on the backend side and never let them go, it keeps them in DISCARD TEMP status.

On the pgpool node:

ps -uax | grep confluence_live | wc -l
41

root@dbcluster1 pgpool-II]# ps -uax | grep confluence_live
root 29944 0.0 0.0 133544 7408 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60380) idle
root 29946 0.0 0.0 133532 7400 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60439) idle
root 29953 0.0 0.0 133532 7396 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60406) idle
root 29960 0.0 0.0 133640 7600 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60402) idle
root 29966 0.0 0.0 133544 7420 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60384) idle
root 29976 0.0 0.0 133544 7392 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60392) idle
root 29980 0.0 0.0 133544 7380 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60422) idle
root 29983 0.0 0.0 133532 7368 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60388) idle
root 29987 0.0 0.0 133532 7392 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60444) idle
root 29988 0.0 0.0 133556 7428 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60420) idle
root 29990 0.0 0.0 133544 7424 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60396) idle
root 29991 0.0 0.0 135312 7608 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60442) idle
root 29995 0.0 0.0 133532 7404 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60376) idle
root 30003 0.0 0.0 133604 7504 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60416) idle
root 30006 0.0 0.0 135292 7580 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60431) idle
root 30013 0.0 0.0 133544 7472 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60394) idle
root 30014 0.0 0.0 133532 7432 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60400) idle
root 30018 0.0 0.0 133544 7440 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60438) idle
root 30028 0.0 0.0 133624 7444 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60410) idle
root 30040 0.0 0.0 133544 7440 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60452) idle
root 30043 0.0 0.0 133556 7420 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60382) idle
root 30046 0.0 0.0 135292 7568 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60450) idle
root 30056 0.0 0.1 137036 10908 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60418) idle
root 30059 0.0 0.0 133616 7460 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60404) idle
root 30072 0.0 0.0 133544 7424 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60448) idle
root 30077 0.0 0.0 133544 7440 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60445) idle
root 30080 0.0 0.0 133544 7416 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60398) idle
root 30095 0.0 0.0 133544 7380 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60378) idle
root 30097 0.0 0.0 133620 7576 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60428) idle
root 30100 0.0 0.0 135292 7576 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60426) idle
root 30108 0.0 0.0 133532 7396 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60390) idle
root 30109 0.0 0.0 133544 7384 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60434) idle
root 30112 0.0 0.0 133544 7424 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60424) idle
root 30113 0.0 0.0 133544 7404 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60414) idle
root 30116 0.0 0.1 137000 10828 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60408) idle
root 30119 0.0 0.0 135292 7632 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60430) idle
root 30120 0.0 0.0 135292 7608 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60454) idle
root 30126 0.0 0.0 133612 7448 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60386) idle
root 30130 0.0 0.0 133556 7488 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60412) idle
root 30139 0.0 0.0 133544 7396 ? S 17:02 0:00 pgpool: confluence_live confluence_live sd.lan(60436) idle

On the backend:

SELECT count(*) FROM pg_stat_activity where query like '%DISCARD%' and datname like '%confluence_live';
152

519865803;"confluence_live";18875;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";48320;"2018-06-30 18:06:07.096978+03";"";"2018-06-30 18:08:37.096676+03";"2018-06-30 18:08:37.096696+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";13653;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";45492;"2018-06-30 17:33:44.555734+03";"";"2018-06-30 18:02:07.089367+03";"2018-06-30 18:02:07.089381+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";13639;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";45456;"2018-06-30 17:33:29.556034+03";"";"2018-06-30 18:09:24.580606+03";"2018-06-30 18:09:24.580621+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";12560;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44724;"2018-06-30 17:25:29.552246+03";"";"2018-06-30 17:31:37.052716+03";"2018-06-30 17:31:37.052732+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";12559;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44720;"2018-06-30 17:25:29.54966+03";"";"2018-06-30 17:27:44.549636+03";"2018-06-30 17:27:44.54965+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";14514;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";46018;"2018-06-30 17:40:02.057574+03";"";"2018-06-30 18:08:14.596575+03";"2018-06-30 18:08:14.59659+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";15018;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";46116;"2018-06-30 17:41:14.562877+03";"";"2018-06-30 18:02:07.089305+03";"2018-06-30 18:02:07.089324+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";11281;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44218;"2018-06-30 17:18:47.033616+03";"";"2018-06-30 18:10:44.599225+03";"2018-06-30 18:10:44.599245+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";19090;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";48576;"2018-06-30 18:09:24.588288+03";"";"2018-06-30 18:10:02.080632+03";"2018-06-30 18:10:02.080656+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";14232;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";45674;"2018-06-30 17:35:52.056957+03";"";"2018-06-30 18:08:29.596445+03";"2018-06-30 18:08:29.596459+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";11183;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44114;"2018-06-30 17:17:32.036671+03";"";"2018-06-30 18:07:52.097142+03";"2018-06-30 18:07:52.097161+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";11293;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44234;"2018-06-30 17:18:59.544437+03";"";"2018-06-30 18:10:59.599018+03";"2018-06-30 18:10:59.599032+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10510;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43800;"2018-06-30 17:13:47.038883+03";"";"2018-06-30 18:10:07.09797+03";"2018-06-30 18:10:07.097992+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10386;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43640;"2018-06-30 17:11:54.536238+03";"";"2018-06-30 18:10:14.598468+03";"2018-06-30 18:10:14.598489+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";16745;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47092;"2018-06-30 17:53:29.579002+03";"";"2018-06-30 18:08:47.082454+03";"2018-06-30 18:08:47.082473+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9797;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43382;"2018-06-30 17:09:44.53371+03";"";"2018-06-30 18:02:07.089332+03";"2018-06-30 18:02:07.089346+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9789;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43366;"2018-06-30 17:09:37.03538+03";"";"2018-06-30 18:11:37.100409+03";"2018-06-30 18:11:37.100424+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9776;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43346;"2018-06-30 17:09:24.533441+03";"";"2018-06-30 18:03:14.590889+03";"2018-06-30 18:03:14.590905+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9775;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43342;"2018-06-30 17:09:24.530227+03";"";"2018-06-30 18:03:22.090433+03";"2018-06-30 18:03:22.090448+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";18690;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";48228;"2018-06-30 18:05:14.596058+03";"";"2018-06-30 18:11:29.600292+03";"2018-06-30 18:11:29.600307+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";12963;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";45086;"2018-06-30 17:30:02.057917+03";"";"2018-06-30 18:08:07.09661+03";"2018-06-30 18:08:07.096634+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9744;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43270;"2018-06-30 17:09:07.034917+03";"";"2018-06-30 18:11:17.082237+03";"2018-06-30 18:11:17.08226+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9717;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43238;"2018-06-30 17:08:47.084598+03";"";"2018-06-30 18:06:54.57753+03";"2018-06-30 18:06:54.577552+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9716;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43232;"2018-06-30 17:08:47.030779+03";"";"2018-06-30 18:09:14.59827+03";"2018-06-30 18:09:14.598288+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9715;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43230;"2018-06-30 17:08:47.030218+03";"";"2018-06-30 18:10:52.100274+03";"2018-06-30 18:10:52.10029+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9707;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43202;"2018-06-30 17:08:44.536952+03";"";"2018-06-30 17:26:54.539263+03";"2018-06-30 17:26:54.539281+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9697;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43182;"2018-06-30 17:08:37.032754+03";"";"2018-06-30 18:07:14.596595+03";"2018-06-30 18:07:14.596613+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9674;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43130;"2018-06-30 17:08:22.033872+03";"";"2018-06-30 18:10:02.080168+03";"2018-06-30 18:10:02.080186+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9659;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43110;"2018-06-30 17:08:09.542019+03";"";"2018-06-30 18:10:37.099691+03";"2018-06-30 18:10:37.099715+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9657;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43102;"2018-06-30 17:08:09.530752+03";"";"2018-06-30 18:10:02.079941+03";"2018-06-30 18:10:02.07996+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9652;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43086;"2018-06-30 17:08:07.032515+03";"";"2018-06-30 17:56:59.582874+03";"2018-06-30 17:56:59.582889+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10384;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43636;"2018-06-30 17:11:54.527468+03";"";"2018-06-30 18:11:17.082492+03";"2018-06-30 18:11:17.082512+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";11129;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44042;"2018-06-30 17:16:44.54454+03";"";"2018-06-30 18:07:32.077861+03";"2018-06-30 18:07:32.077885+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9819;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43426;"2018-06-30 17:09:59.534761+03";"";"2018-06-30 17:29:24.541767+03";"2018-06-30 17:29:24.541789+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10360;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43596;"2018-06-30 17:11:29.535833+03";"";"2018-06-30 18:06:29.595997+03";"2018-06-30 18:06:29.596011+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9609;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43030;"2018-06-30 17:07:32.092022+03";"";"2018-06-30 18:00:37.087101+03";"2018-06-30 18:00:37.08712+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9608;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43026;"2018-06-30 17:07:32.07567+03";"";"2018-06-30 18:09:07.097496+03";"2018-06-30 18:09:07.097512+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9607;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43022;"2018-06-30 17:07:32.032679+03";"";"2018-06-30 17:55:59.582619+03";"2018-06-30 17:55:59.582641+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9606;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43018;"2018-06-30 17:07:32.029913+03";"";"2018-06-30 18:07:22.096489+03";"2018-06-30 18:07:22.096504+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9605;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43014;"2018-06-30 17:07:32.029551+03";"";"2018-06-30 18:11:14.600306+03";"2018-06-30 18:11:14.600326+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";13470;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";45180;"2018-06-30 17:31:14.555174+03";"";"2018-06-30 18:02:37.091004+03";"2018-06-30 18:02:37.091019+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";15709;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";46462;"2018-06-30 17:45:29.569159+03";"";"2018-06-30 18:08:22.097387+03";"2018-06-30 18:08:22.097401+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9590;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42986;"2018-06-30 17:07:22.038702+03";"";"2018-06-30 18:09:59.598732+03";"2018-06-30 18:09:59.598752+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9563;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42920;"2018-06-30 17:07:07.032441+03";"";"2018-06-30 18:02:52.090817+03";"2018-06-30 18:02:52.090835+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9562;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42918;"2018-06-30 17:07:07.031978+03";"";"2018-06-30 18:08:09.578901+03";"2018-06-30 18:08:09.578939+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9546;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42890;"2018-06-30 17:06:54.538321+03";"";"2018-06-30 17:31:14.553492+03";"2018-06-30 17:31:14.553511+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9536;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42858;"2018-06-30 17:06:52.032863+03";"";"2018-06-30 18:11:17.083459+03";"2018-06-30 18:11:17.08348+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9537;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42860;"2018-06-30 17:06:52.033213+03";"";"2018-06-30 18:10:22.099162+03";"2018-06-30 18:10:22.099183+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";12726;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";44824;"2018-06-30 17:26:44.550777+03";"";"2018-06-30 18:09:44.598483+03";"2018-06-30 18:09:44.598503+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9527;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42834;"2018-06-30 17:06:44.537708+03";"";"2018-06-30 18:08:14.596533+03";"2018-06-30 18:08:14.596547+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9525;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42826;"2018-06-30 17:06:44.535203+03";"";"2018-06-30 18:09:07.097578+03";"2018-06-30 18:09:07.097597+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9499;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42758;"2018-06-30 17:06:29.532559+03";"";"2018-06-30 18:07:07.096487+03";"2018-06-30 18:07:07.096506+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";16720;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47062;"2018-06-30 17:53:07.078489+03";"";"2018-06-30 18:11:22.10058+03";"2018-06-30 18:11:22.100599+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9481;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42718;"2018-06-30 17:06:17.053872+03";"";"2018-06-30 18:09:24.580378+03";"2018-06-30 18:09:24.580395+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9480;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42714;"2018-06-30 17:06:17.027199+03";"";"2018-06-30 18:09:24.581375+03";"2018-06-30 18:09:24.581394+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9479;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42710;"2018-06-30 17:06:17.024721+03";"";"2018-06-30 17:29:24.541426+03";"2018-06-30 17:29:24.54145+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9466;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42690;"2018-06-30 17:06:07.031228+03";"";"2018-06-30 18:10:52.100242+03";"2018-06-30 18:10:52.100261+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";17486;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47670;"2018-06-30 17:58:37.085478+03";"";"2018-06-30 18:10:59.598931+03";"2018-06-30 18:10:59.598947+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9444;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42644;"2018-06-30 17:05:52.030569+03";"";"2018-06-30 18:08:22.097186+03";"2018-06-30 18:08:22.097199+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9443;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42642;"2018-06-30 17:05:52.030099+03";"";"2018-06-30 18:11:37.100447+03";"2018-06-30 18:11:37.100462+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9419;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42580;"2018-06-30 17:05:39.602924+03";"";"2018-06-30 18:10:02.08014+03";"2018-06-30 18:10:02.080165+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9420;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42584;"2018-06-30 17:05:39.605769+03";"";"2018-06-30 17:30:29.552402+03";"2018-06-30 17:30:29.552419+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9418;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42576;"2018-06-30 17:05:39.564633+03";"";"2018-06-30 17:26:54.539246+03";"2018-06-30 17:26:54.539264+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9417;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42572;"2018-06-30 17:05:39.524437+03";"";"2018-06-30 18:10:02.080218+03";"2018-06-30 18:10:02.080243+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9416;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42568;"2018-06-30 17:05:39.521999+03";"";"2018-06-30 18:09:59.598679+03";"2018-06-30 18:09:59.5987+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9411;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42556;"2018-06-30 17:05:37.034237+03";"";"2018-06-30 18:07:32.0778+03";"2018-06-30 18:07:32.07783+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9245;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42444;"2018-06-30 17:05:14.528637+03";"";"2018-06-30 18:11:17.082237+03";"2018-06-30 18:11:17.082265+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9415;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42564;"2018-06-30 17:05:39.51636+03";"";"2018-06-30 18:07:14.596501+03";"2018-06-30 18:07:14.59652+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8931;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42390;"2018-06-30 17:05:02.108606+03";"";"2018-06-30 18:09:24.579843+03";"2018-06-30 18:09:24.579865+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8929;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42382;"2018-06-30 17:05:02.065456+03";"";"2018-06-30 18:08:47.079417+03";"2018-06-30 18:08:47.07944+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8927;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42374;"2018-06-30 17:05:02.02298+03";"";"2018-06-30 17:31:52.052949+03";"2018-06-30 17:31:52.052964+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8926;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42370;"2018-06-30 17:05:02.014146+03";"";"2018-06-30 18:11:17.082318+03";"2018-06-30 18:11:17.08234+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9573;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42934;"2018-06-30 17:07:14.533792+03";"";"2018-06-30 18:01:07.088712+03";"2018-06-30 18:01:07.088732+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10347;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43580;"2018-06-30 17:11:17.041531+03";"";"2018-06-30 18:05:14.59468+03";"2018-06-30 18:05:14.594699+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9545;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42886;"2018-06-30 17:06:54.5345+03";"";"2018-06-30 18:08:47.080109+03";"2018-06-30 18:08:47.080128+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8897;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42314;"2018-06-30 17:04:52.034157+03";"";"2018-06-30 18:06:52.096926+03";"2018-06-30 18:06:52.096946+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8898;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42316;"2018-06-30 17:04:52.034627+03";"";"2018-06-30 18:06:22.095541+03";"2018-06-30 18:06:22.09556+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8896;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42310;"2018-06-30 17:04:52.030749+03";"";"2018-06-30 18:05:02.076013+03";"2018-06-30 18:05:02.076039+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8877;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42246;"2018-06-30 17:04:44.530683+03";"";"2018-06-30 17:47:32.058505+03";"2018-06-30 17:47:32.058528+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8878;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42248;"2018-06-30 17:04:44.531245+03";"";"2018-06-30 18:11:17.082537+03";"2018-06-30 18:11:17.082563+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8868;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42226;"2018-06-30 17:04:37.032428+03";"";"2018-06-30 17:31:52.053066+03";"2018-06-30 17:31:52.053084+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8835;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42134;"2018-06-30 17:04:24.827923+03";"";"2018-06-30 18:08:09.578893+03";"2018-06-30 18:08:09.578931+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8834;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42130;"2018-06-30 17:04:24.794103+03";"";"2018-06-30 18:05:59.594765+03";"2018-06-30 18:05:59.59478+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8832;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42122;"2018-06-30 17:04:24.756432+03";"";"2018-06-30 17:30:39.543931+03";"2018-06-30 17:30:39.543952+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8831;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42118;"2018-06-30 17:04:24.71922+03";"";"2018-06-30 17:31:37.052644+03";"2018-06-30 17:31:37.052657+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8829;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42110;"2018-06-30 17:04:24.676505+03";"";"2018-06-30 18:10:39.582516+03";"2018-06-30 18:10:39.582535+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8827;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42102;"2018-06-30 17:04:24.634204+03";"";"2018-06-30 18:10:39.580928+03";"2018-06-30 18:10:39.580943+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8826;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42098;"2018-06-30 17:04:24.627816+03";"";"2018-06-30 18:11:44.601122+03";"2018-06-30 18:11:44.601136+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8825;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42094;"2018-06-30 17:04:24.598653+03";"";"2018-06-30 18:11:29.600302+03";"2018-06-30 18:11:29.600321+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8822;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42082;"2018-06-30 17:04:24.520245+03";"";"2018-06-30 18:11:17.083096+03";"2018-06-30 18:11:17.083115+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8821;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42078;"2018-06-30 17:04:24.516687+03";"";"2018-06-30 18:10:22.098984+03";"2018-06-30 18:10:22.098998+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8803;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42030;"2018-06-30 17:04:14.569823+03";"";"2018-06-30 18:11:22.101252+03";"2018-06-30 18:11:22.101267+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8802;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42026;"2018-06-30 17:04:14.539339+03";"";"2018-06-30 18:10:59.599022+03";"2018-06-30 18:10:59.599043+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8800;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42018;"2018-06-30 17:04:14.527938+03";"";"2018-06-30 18:09:52.098299+03";"2018-06-30 18:09:52.098326+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8774;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41942;"2018-06-30 17:04:07.028718+03";"";"2018-06-30 18:10:07.098533+03";"2018-06-30 18:10:07.098547+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8775;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41946;"2018-06-30 17:04:07.029075+03";"";"2018-06-30 18:11:17.082189+03";"2018-06-30 18:11:17.082216+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";16681;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47014;"2018-06-30 17:52:32.080063+03";"";"2018-06-30 18:11:37.100414+03";"2018-06-30 18:11:37.100429+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";14296;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";45738;"2018-06-30 17:36:54.565397+03";"";"2018-06-30 18:11:17.083496+03";"2018-06-30 18:11:17.08351+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8723;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41822;"2018-06-30 17:03:47.198695+03";"";"2018-06-30 17:51:17.062879+03";"2018-06-30 17:51:17.062897+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8722;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41818;"2018-06-30 17:03:47.18534+03";"";"2018-06-30 18:06:54.5776+03";"2018-06-30 18:06:54.577619+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8721;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41814;"2018-06-30 17:03:47.147554+03";"";"2018-06-30 18:02:59.590586+03";"2018-06-30 18:02:59.590603+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8720;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41810;"2018-06-30 17:03:47.13603+03";"";"2018-06-30 17:58:52.084182+03";"2018-06-30 17:58:52.0842+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8719;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41806;"2018-06-30 17:03:47.101172+03";"";"2018-06-30 17:49:59.572967+03";"2018-06-30 17:49:59.572981+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";19108;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";48596;"2018-06-30 18:09:44.600204+03";"";"2018-06-30 18:10:22.099184+03";"2018-06-30 18:10:22.099198+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";18200;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47962;"2018-06-30 18:02:32.080533+03";"";"2018-06-30 18:10:02.080093+03";"2018-06-30 18:10:02.080116+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8716;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41794;"2018-06-30 17:03:47.061983+03";"";"2018-06-30 18:03:52.093417+03";"2018-06-30 18:03:52.093431+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8713;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41784;"2018-06-30 17:03:47.015707+03";"";"2018-06-30 18:06:22.095689+03";"2018-06-30 18:06:22.095709+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8709;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41770;"2018-06-30 17:03:44.530007+03";"";"2018-06-30 18:11:07.099641+03";"2018-06-30 18:11:07.09966+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8692;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41722;"2018-06-30 17:03:37.072173+03";"";"2018-06-30 18:05:07.094076+03";"2018-06-30 18:05:07.094095+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8690;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41710;"2018-06-30 17:03:37.02912+03";"";"2018-06-30 18:11:14.600178+03";"2018-06-30 18:11:14.600202+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8666;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41634;"2018-06-30 17:03:29.527171+03";"";"2018-06-30 18:10:44.599286+03";"2018-06-30 18:10:44.5993+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8816;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42066;"2018-06-30 17:04:22.02848+03";"";"2018-06-30 18:03:09.574781+03";"2018-06-30 18:03:09.574808+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8648;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41584;"2018-06-30 17:03:22.029096+03";"";"2018-06-30 18:03:52.09188+03";"2018-06-30 18:03:52.091895+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8647;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41582;"2018-06-30 17:03:22.028638+03";"";"2018-06-30 17:27:07.049319+03";"2018-06-30 17:27:07.049333+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";18164;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47918;"2018-06-30 18:01:54.577481+03";"";"2018-06-30 18:09:24.580227+03";"2018-06-30 18:09:24.580242+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";15059;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";46192;"2018-06-30 17:41:52.065736+03";"";"2018-06-30 18:00:22.086904+03";"2018-06-30 18:00:22.086925+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10323;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43540;"2018-06-30 17:10:59.535697+03";"";"2018-06-30 18:10:39.582571+03";"2018-06-30 18:10:39.582602+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";18217;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";47986;"2018-06-30 18:02:52.092729+03";"";"2018-06-30 18:07:37.096855+03";"2018-06-30 18:07:37.096876+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10296;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43508;"2018-06-30 17:10:39.534545+03";"";"2018-06-30 18:09:24.580249+03";"2018-06-30 18:09:24.580271+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";10295;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";43504;"2018-06-30 17:10:39.532117+03";"";"2018-06-30 18:05:59.59487+03";"2018-06-30 18:05:59.594889+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8572;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41326;"2018-06-30 17:03:09.890745+03";"";"2018-06-30 18:02:32.073101+03";"2018-06-30 18:02:32.07312+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8573;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41330;"2018-06-30 17:03:09.897543+03";"";"2018-06-30 17:29:24.541686+03";"2018-06-30 17:29:24.541699+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8569;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41318;"2018-06-30 17:03:09.822539+03";"";"2018-06-30 17:50:59.574241+03";"2018-06-30 17:50:59.574265+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8568;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41314;"2018-06-30 17:03:09.814205+03";"";"2018-06-30 18:09:37.098657+03";"2018-06-30 18:09:37.09867+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8570;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41322;"2018-06-30 17:03:09.854602+03";"";"2018-06-30 18:09:44.598529+03";"2018-06-30 18:09:44.598547+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8567;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41310;"2018-06-30 17:03:09.781421+03";"";"2018-06-30 18:03:44.592023+03";"2018-06-30 18:03:44.592042+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8565;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41302;"2018-06-30 17:03:09.739671+03";"";"2018-06-30 18:08:09.578693+03";"2018-06-30 18:08:09.578716+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8564;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41298;"2018-06-30 17:03:09.706089+03";"";"2018-06-30 18:02:52.090794+03";"2018-06-30 18:02:52.090823+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8563;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41294;"2018-06-30 17:03:09.672882+03";"";"2018-06-30 17:16:14.541147+03";"2018-06-30 17:16:14.541165+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8562;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41290;"2018-06-30 17:03:09.671705+03";"";"2018-06-30 18:08:47.080157+03";"2018-06-30 18:08:47.080175+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8561;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41286;"2018-06-30 17:03:09.639203+03";"";"2018-06-30 18:06:29.596434+03";"2018-06-30 18:06:29.596448+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8560;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41282;"2018-06-30 17:03:09.605999+03";"";"2018-06-30 18:08:09.57915+03";"2018-06-30 18:08:09.579172+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8559;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41278;"2018-06-30 17:03:09.59767+03";"";"2018-06-30 18:08:59.597051+03";"2018-06-30 18:08:59.597071+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8557;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41270;"2018-06-30 17:03:09.556753+03";"";"2018-06-30 18:10:29.599573+03";"2018-06-30 18:10:29.599589+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8555;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41260;"2018-06-30 17:03:09.513296+03";"";"2018-06-30 18:07:32.078592+03";"2018-06-30 18:07:32.078612+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8554;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41258;"2018-06-30 17:03:09.513064+03";"";"2018-06-30 18:08:52.096925+03";"2018-06-30 18:08:52.096943+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9544;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42882;"2018-06-30 17:06:54.521821+03";"";"2018-06-30 18:10:29.599689+03";"2018-06-30 18:10:29.599703+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8546;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41242;"2018-06-30 17:03:07.082294+03";"";"2018-06-30 18:00:02.072202+03";"2018-06-30 18:00:02.072222+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8543;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41230;"2018-06-30 17:03:07.027176+03";"";"2018-06-30 17:30:02.042319+03";"2018-06-30 17:30:02.042355+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8544;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41232;"2018-06-30 17:03:07.027396+03";"";"2018-06-30 18:09:29.597821+03";"2018-06-30 18:09:29.597838+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8513;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41154;"2018-06-30 17:02:59.52662+03";"";"2018-06-30 18:06:17.077065+03";"2018-06-30 18:06:17.077085+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8514;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41156;"2018-06-30 17:02:59.526972+03";"";"2018-06-30 18:04:37.094193+03";"2018-06-30 18:04:37.094208+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";15886;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";46650;"2018-06-30 17:47:59.571685+03";"";"2018-06-30 18:10:44.599238+03";"2018-06-30 18:10:44.599268+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";9453;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";42662;"2018-06-30 17:05:59.529776+03";"";"2018-06-30 18:09:44.598613+03";"2018-06-30 18:09:44.598632+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8473;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";41016;"2018-06-30 17:02:52.026369+03";"";"2018-06-30 18:06:37.095076+03";"2018-06-30 18:06:37.095093+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";18886;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";48332;"2018-06-30 18:06:17.087985+03";"";"2018-06-30 18:11:44.601112+03";"2018-06-30 18:11:44.601127+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";15899;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";46662;"2018-06-30 17:48:09.573944+03";"";"2018-06-30 18:09:29.597844+03";"2018-06-30 18:09:29.597857+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";18832;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";48264;"2018-06-30 18:05:29.595786+03";"";"2018-06-30 18:08:47.082404+03";"2018-06-30 18:08:47.082422+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8441;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";40900;"2018-06-30 17:02:44.575721+03";"";"2018-06-30 17:58:29.585031+03";"2018-06-30 17:58:29.585053+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8438;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";40888;"2018-06-30 17:02:44.527081+03";"";"2018-06-30 18:08:47.079286+03";"2018-06-30 18:08:47.079308+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8380;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";40672;"2018-06-30 17:02:38.084118+03";"";"2018-06-30 18:11:44.600936+03";"2018-06-30 18:11:44.600951+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8377;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";40660;"2018-06-30 17:02:38.028982+03";"";"2018-06-30 17:14:24.524426+03";"2018-06-30 17:14:24.524445+03";f;"idle";;;" DISCARD TEMP"
519865803;"confluence_live";8378;519862999;"confluence_live";"";"192.168.2.142";"dbcluster1.lan";40664;"2018-06-30 17:02:38.029307+03";"";"2018-06-30 18:07:32.078246+03";"2018-06-30 18:07:32.078261+03";f;"idle";;;" DISCARD TEMP"



I thing there is a connection with enabling connection_caching. If I disable the connection_caching the connections number are back to normal.

Tagsbackend, connection cache, pgpool-II

Activities

nenominal

2018-07-01 00:14

reporter  

pgpool.conf (35,418 bytes)

pengbo

2018-07-02 19:28

developer   ~0002077

Could you provide pgpool log?

Does Pgpool-II hang when you set reset_query_list = 'ABORT; DISCARD ALL'?

nenominal

2018-07-02 21:43

reporter   ~0002078

Same issue with DISCARD ALL:

[root@dbcluster1 ~]# ps -uax | grep confluence_live | wc -l
41

On db node:

SELECT count(*) FROM pg_stat_activity where query like '%DISCARD%' and datname like '%confluence_live';
121

I don't know if the log will help, I set the configuration for debug2 but for some reason none of the connected applications to the pool worked correctly, I received lots of timed out:
" org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend. "
pgpool.log (3,934,417 bytes)

nenominal

2018-07-02 22:12

reporter   ~0002079

And a really stupid question, maybe, but I didn't find anything explanatory in the documentation.

If a set connection_cache to OFF, does max_pool option became obsolete?
Curently I have num_init_children=200 and max_pool=10 and that means 2000 connections., If I set connection_cache to OFF it means only 200?

t-ishii

2018-07-03 15:46

developer   ~0002080

> If a set connection_cache to OFF, does max_pool option became obsolete?

Yes.

> Curently I have num_init_children=200 and max_pool=10 and that means 2000 connections., If I set connection_cache to OFF it means only 200?

If you have over 10 database/username pair, then yes.

nenominal

2018-07-03 18:26

reporter   ~0002081

Hi t-ishii, thanks for taking the time to answer me.
I have found some old issue related to mine but for an older versions of pgpool and it was patched.
Do you think it's possible that the patch never hit 3.7 branch?

https://www.pgpool.net/mantisbt/view.php?id=107

pengbo

2018-07-03 19:27

developer   ~0002082

I found the following log messages in pgpool.log.

 | LOG: backend throws an error message
 | DETAIL: too many connections for role "portal_facturi"

It seems that there is connection limit of role "portal_facturi".
Did you set the connections limit, for example, using "ALTER ROLE portal_facturi WITH CONNECTION LIMIT ... "?

 | Jul 1 03:30:15 dbcluster1 pgpool: 2018-07-01 03:30:15: pid 27817: ERROR: unable to read message kind
 | Jul 1 03:30:15 dbcluster1 pgpool: 2018-07-01 03:30:15: pid 27817: DETAIL: kind does not match between master(45) slot[1] (53)
 | Jul 1 03:31:15 dbcluster1 pgpool: 2018-07-01 03:31:15: pid 17969: LOG: pool_read_kind: error message from master backend:too many connections for database "portal_facturi"

It seems that the max connections of backend (master) is reached.
You have to set num_init_children * max_pool < max_connections.

nenominal

2018-07-03 21:15

reporter   ~0002083

Yes, we did a test with another application to see what happens.
The application in case have only 1 connection pool and we set the limit to that user to no more than 40 connections and because the connections where idle in the backend, the limit was reached.

i don't really know how pgpool manages the cached connections but take a look bellow:

On the pgpool server:

[root@dbcluster1 ~]# ps -uax | grep postal_facturi | wc -l
1

On the backend server:
SELECT count(*) FROM pg_stat_activity where usename like '%portal_facturi%';
11

As you can see the connection from backend way larger than pool that the application is set.
When we did the test, using that application on load, the number of concurrent connections for that user on the backend overpass the 40 limit and that was what you were seeing in the logs, sorry, I failed to mention.

nenominal

2018-07-04 23:53

reporter   ~0002091

We did a quick test with 3.6. I think that I have the same issue.
Screenshot from 2018-07-04 17-53-05.png (296,675 bytes)

t-ishii

2018-07-05 10:27

developer   ~0002092

> [root@dbcluster1 ~]# ps -uax | grep postal_facturi | wc -l
> 1
>
> On the backend server:
> SELECT count(*) FROM pg_stat_activity where usename like '%portal_facturi%';
> 11

That's normal. pgpool changes the ps status to "waiting for connection" when clients disconnects to pgpool. However as long as pooled connections from pgpool to PostgreSQL remain, PostgreSQL thinks that client is still connecting to PostgreSQL and pg_stat_activity happily shows them. That's how connection pooling works.

nenominal

2018-07-05 18:06

reporter   ~0002096

Yes, I know that, but what's with the number of connections to the backend server, that's my real problem.
Let's take the confluence application example, in my case, without PgPool, the number to the database server never goes up to 40 connections with default install.
If I add Pgpool to equation I get around 120-140 connections to backend and this is what I don't understand. How the PgPool choose this numbers? Can we calculate in someway the needed of numbers connections to the backend?

Of course, there is also the DISCARD ALL status that still persists :-)

t-ishii

2018-07-05 18:13

developer   ~0002098

Because you set num_init_children to 200.

nenominal

2018-07-05 21:56

reporter   ~0002100

Now I'm completely in the dark :-)

The new pool should sustain around 20 pairs of users/db. We did a little math and we have to migrate roughly a sum of minim pool connection of 300 and max 600 ( this is the sum of all de jdbc and hibernate connection for min_pool and max_pool for every connection)

Based on this data what's your recommendation for num_init_children and max-pool?

Thanks.

t-ishii

2018-07-05 22:07

developer   ~0002102

Assuming that (it was not clear from what you said) you want max_connections = 40, num_init_children and max_pool should satisfy following equation.

             max_pool*num_init_children <= (40 - superuser_reserved_connections) (no query canceling needed)
          max_pool*num_init_children*2 <= (40 - superuser_reserved_connections) (query canceling needed)

The formula is in the manual:
http://www.pgpool.net/docs/latest/en/html/runtime-config-connection.html#RUNTIME-CONFIG-CONNECTION-SETTINGS
I just replaced max_connections with 40.

BTW, regarding DISCARD ALL hangs, I was not able to reproduce the issue. If you could provide me a self contained test case, I could investigate it.

administrator

2018-08-06 11:29

administrator   ~0002136

No response more than one month.
Close issue.

Issue History

Date Modified Username Field Change
2018-07-01 00:14 nenominal New Issue
2018-07-01 00:14 nenominal File Added: pgpool.conf
2018-07-01 00:14 nenominal Tag Attached: backend
2018-07-01 00:14 nenominal Tag Attached: connection cache
2018-07-01 00:14 nenominal Tag Attached: pgpool-II
2018-07-02 19:28 pengbo Note Added: 0002077
2018-07-02 21:43 nenominal File Added: pgpool.log
2018-07-02 21:43 nenominal Note Added: 0002078
2018-07-02 22:12 nenominal Note Added: 0002079
2018-07-03 15:46 t-ishii Note Added: 0002080
2018-07-03 18:26 nenominal Note Added: 0002081
2018-07-03 19:27 pengbo Note Added: 0002082
2018-07-03 21:15 nenominal Note Added: 0002083
2018-07-04 23:53 nenominal File Added: Screenshot from 2018-07-04 17-53-05.png
2018-07-04 23:53 nenominal Note Added: 0002091
2018-07-05 10:27 t-ishii Note Added: 0002092
2018-07-05 18:06 nenominal Note Added: 0002096
2018-07-05 18:13 t-ishii Note Added: 0002098
2018-07-05 21:56 nenominal Note Added: 0002100
2018-07-05 22:07 t-ishii Note Added: 0002102
2018-07-09 14:32 t-ishii Assigned To => t-ishii
2018-07-09 14:32 t-ishii Status new => assigned
2018-07-25 08:16 t-ishii Status assigned => new
2018-07-25 08:17 t-ishii Status new => feedback
2018-08-06 11:28 administrator Status feedback => closed
2018-08-06 11:29 administrator Note Added: 0002136