Difference between revisions of "Pgpool-II 4.1 development"

From pgpool Wiki
Jump to: navigation, search
 
(41 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Last update: 2019/07/11
+
Last update: 2019/10/08
  
 
Each bug items assigned "SL (Severity level)" from 1-3 (1 is the most severe, 3 is the least severe) in "Status" column.
 
Each bug items assigned "SL (Severity level)" from 1-3 (1 is the most severe, 3 is the least severe) in "Status" column.
 +
 +
Red items are open items for Pgpool-II 4.1.
  
 
{| class="wikitable"
 
{| class="wikitable"
Line 33: Line 35:
 
|
 
|
 
|  
 
|  
|-style="background:beige"
+
|-style="background:orange"
| [FEATURE] Enhance performance: performance for simple query
+
| [FEATURE] Enhance performance: performance for simple query (especially for of the large
 +
INSERT and UPDATE statements)
 
| 2018/11/20
 
| 2018/11/20
 
|
 
|
Line 41: Line 44:
 
| Usama
 
| Usama
 
|
 
|
|  
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=310c5c4a289cbe6cee01abef7d2e7bc3550944fb commit]
 
|-style="background:orange"
 
|-style="background:orange"
 
| [FEATURE] Enhance performance: performance for extended query  
 
| [FEATURE] Enhance performance: performance for extended query  
Line 52: Line 55:
 
| (1) Enhance performance for COPY XXX TO STDOUT (both for simple and extended query): [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=702f7c86f9b8f82f61e47235505715891ffe1b23 commit] <br>  
 
| (1) Enhance performance for COPY XXX TO STDOUT (both for simple and extended query): [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=702f7c86f9b8f82f61e47235505715891ffe1b23 commit] <br>  
 
(2) Enhance performance for extended query message: <br> [https://www.pgpool.net/pipermail/pgpool-hackers/2019-February/003230.html [pgpool-hackers: 3230]] [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=778f611e201d6df88ed90d01e49af77daf9f2926 commit] <br> (3) Eliminate select(2) calls in certain cases to enhance performance in simple and extended query: <br> [https://www.pgpool.net/pipermail/pgpool-hackers/2019-February/003247.html [pgpool-hackers: 3247]] [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=cf5fe7eb89a11e3ada3833343c7ed6551ce7c662 commit]
 
(2) Enhance performance for extended query message: <br> [https://www.pgpool.net/pipermail/pgpool-hackers/2019-February/003230.html [pgpool-hackers: 3230]] [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=778f611e201d6df88ed90d01e49af77daf9f2926 commit] <br> (3) Eliminate select(2) calls in certain cases to enhance performance in simple and extended query: <br> [https://www.pgpool.net/pipermail/pgpool-hackers/2019-February/003247.html [pgpool-hackers: 3247]] [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=cf5fe7eb89a11e3ada3833343c7ed6551ce7c662 commit]
|-style="background:beige"
+
|-style="background:orange"
 
| rowspan="2" | 009
 
| rowspan="2" | 009
 
| [Documentation] Review and improve the current document
 
| [Documentation] Review and improve the current document
Line 61: Line 64:
 
| Hoshiai
 
| Hoshiai
 
|
 
|
|  
+
| [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=ea1998b7350de6882bea25fc3634c4f7673adbde commit1][https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=5f259f3b5e1b56763677d0b7aa736eb8772a8968 commit2][https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=b69e94e97ed4226e335e85f01bfc373c8e11db8f commit3] <br>
|-style="background:beige"
+
[https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=b69e94e97ed4226e335e85f01bfc373c8e11db8f commit4]
 +
[https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=c013bad08e67bd53d39a66835c67bc93d334d72b commit5]
 +
[https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=6d3939dac4d76eed5dcd1867fb16e8bc8215dc61 commit6]
 +
|-style="background:orange"
 
| [Documentation] Update the examples to latest version.
 
| [Documentation] Update the examples to latest version.
 
| 2018/11/20
 
| 2018/11/20
Line 70: Line 76:
 
| Peng
 
| Peng
 
|  
 
|  
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=0c9f716714dce156fe74469a933046b39896a072 commit] [http://www.pgpool.net/docs/latest/en/html/example-cluster.html doc]
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=0c9f716714dce156fe74469a933046b39896a072 commit] [http://www.pgpool.net/docs/latest/en/html/example-cluster.html doc] [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=69c6a4cd5f49384a1d719e4e784ff84855f00a9d commit]
|-style="background:beige"
+
|-style="background:orange"
 
| 010
 
| 010
 
| [FEATURE] Master watchdog sets quarantine state to primary node
 
| [FEATURE] Master watchdog sets quarantine state to primary node
Line 80: Line 86:
 
| Usama
 
| Usama
 
| [http://www.sraoss.jp/pipermail/pgpool-hackers/2018-March/002756.html [pgpool-hackers: 2756]] <br>[https://www.pgpool.net/pipermail/pgpool-general-jp/2018-March/001503.html [pgpool-general-jp: 1504]]
 
| [http://www.sraoss.jp/pipermail/pgpool-hackers/2018-March/002756.html [pgpool-hackers: 2756]] <br>[https://www.pgpool.net/pipermail/pgpool-general-jp/2018-March/001503.html [pgpool-general-jp: 1504]]
|  
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=3922c12c1f8efbc1b5f2e7def1e0ff921aafb989  Commit]
 
|-style="background:orange"
 
|-style="background:orange"
 
| 011
 
| 011
Line 111: Line 117:
 
| recovery.conf <br> pgpool_setup <br> pgppol-recovery extension
 
| recovery.conf <br> pgpool_setup <br> pgppol-recovery extension
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=fda13a93a1025b498bb2a674fb49406d9e3e509c pgpool-recovery extension] <br> [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=23fb4c1250f0464a867f2ac69006d74f134213e3 pgpool_setup]
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=fda13a93a1025b498bb2a674fb49406d9e3e509c pgpool-recovery extension] <br> [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=23fb4c1250f0464a867f2ac69006d74f134213e3 pgpool_setup]
|-style="background:beige"
+
|-style="background:orange"
 
| 015
 
| 015
 
| [FEATURE] Import PostgreSQL 12 parser.
 
| [FEATURE] Import PostgreSQL 12 parser.
Line 120: Line 126:
 
| Peng
 
| Peng
 
|  
 
|  
| In progress.
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=f694283cfd55a52750ce56697af2e5cd1d1da571 commit]
 
|-style="background:orange"
 
|-style="background:orange"
 
| 016
 
| 016
Line 151: Line 157:
 
|  
 
|  
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=854659a17b958536e80c461d55c9ba0f1032a128 commit]
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=854659a17b958536e80c461d55c9ba0f1032a128 commit]
|-style="background:beige"
+
|-style="background:orange"
 
| 020
 
| 020
 
| [FEATURE] auto failback
 
| [FEATURE] auto failback
Line 160: Line 166:
 
| Hoshiai
 
| Hoshiai
 
| [https://www.pgpool.net/pipermail/pgpool-hackers/2019-May/003328.html [pgpool-hackers: 3328]]
 
| [https://www.pgpool.net/pipermail/pgpool-hackers/2019-May/003328.html [pgpool-hackers: 3328]]
| In progress.  
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=3e2ecc970864056ff054799cac57ad5b30312c48 commit]
 
|-style="background:orange"
 
|-style="background:orange"
 
| 021
 
| 021
Line 181: Line 187:
 
| [https://www.pgpool.net/pipermail/pgpool-hackers/2019-June/003342.html [pgpool-hackers: 3342]]
 
| [https://www.pgpool.net/pipermail/pgpool-hackers/2019-June/003342.html [pgpool-hackers: 3342]]
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=46986ebc0be77e4b011b94b097789fec9e3f5b0f commit]
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=46986ebc0be77e4b011b94b097789fec9e3f5b0f commit]
|-style="background:beige"
+
|-style="background:orange"
 
| 023
 
| 023
 
| [FEATURE] Support ECDH key exchange with SSL
 
| [FEATURE] Support ECDH key exchange with SSL
Line 190: Line 196:
 
| Hoshiai
 
| Hoshiai
 
|  
 
|  
| In progress. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=51bc494aaa7fd191e14038204d18effe2efb0ec8 commit1]
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=51bc494aaa7fd191e14038204d18effe2efb0ec8 commit1] [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=f63c260d7e389bc03822721a9d66a0d6c7d22f4b commit2]
 
|-style="background:orange"
 
|-style="background:orange"
 
| 024
 
| 024
Line 211: Line 217:
 
| [https://www.pgpool.net/pipermail/pgpool-hackers/2019-June/003346.html [pgpool-hackers: 3346]]
 
| [https://www.pgpool.net/pipermail/pgpool-hackers/2019-June/003346.html [pgpool-hackers: 3346]]
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commitdiff;h=7a0471bbcc3ab06a9cab9902d91e5c4c692b3284 commit]
 
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commitdiff;h=7a0471bbcc3ab06a9cab9902d91e5c4c692b3284 commit]
 +
|-style="background:orange"
 +
| 026
 +
| [FEATURE] Add new arguments in pgpool_recovery function and failover_command/failback_command/follow_master_command.
 +
|
 +
|
 +
|
 +
| Small
 +
| Peng
 +
|
 +
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=ed90a39db3664eb7be85f192f5472cc0b59a2d8f commit]
 
|-style="background:silver"
 
|-style="background:silver"
 
| 101
 
| 101
Line 280: Line 296:
 
| Ishii
 
| Ishii
 
| [https://www.pgpool.net/mantisbt/view.php?id=448 bug448]
 
| [https://www.pgpool.net/mantisbt/view.php?id=448 bug448]
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commitdiff;h=3f5986eee360f12e6a0bb77aa46f95abf5f6bc10 cimmit]
+
| Done. [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commitdiff;h=3f5986eee360f12e6a0bb77aa46f95abf5f6bc10 commit]
 
|-style="background:silver"
 
|-style="background:silver"
 
| 108
 
| 108
Line 311: Line 327:
 
|  
 
|  
 
|  
 
|  
|-style="background:white"
+
|-style="background:silver"
 
| 111
 
| 111
 
| 0000483: online-recovery is blocked after a child process exits abnormally with replication mode and watchdog
 
| 0000483: online-recovery is blocked after a child process exits abnormally with replication mode and watchdog
Line 320: Line 336:
 
| Usama
 
| Usama
 
| [https://www.pgpool.net/mantisbt/view.php?id=483 bug483]
 
| [https://www.pgpool.net/mantisbt/view.php?id=483 bug483]
| Waiting for review->the patch did not work.
+
| Done [https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=c402060814ba9737e9572ba07eef1be7664c9679 commit].
|-style="background:white"
+
|-style="background:silver"
 
| 112
 
| 112
 
| Fix memory leak related to watchdog and auth pointed out by coverity
 
| Fix memory leak related to watchdog and auth pointed out by coverity
Line 330: Line 346:
 
| Usama
 
| Usama
 
| src/auth/pool_hba.c src/auth/pool_auth.c src/auth/auth-scram.c src/watchdog/watchdog.c src/watchdog/wd_lifecheck.c src/config/pool_config_variable.c
 
| src/auth/pool_hba.c src/auth/pool_auth.c src/auth/auth-scram.c src/watchdog/watchdog.c src/watchdog/wd_lifecheck.c src/config/pool_config_variable.c
|  
+
| Done
|-style="background:white"
+
|-style="background:silver"
 
| 113
 
| 113
 
| Fix memory leak related to watchdog and auth pointed out by coverity
 
| Fix memory leak related to watchdog and auth pointed out by coverity
Line 341: Line 357:
 
| other than :src/auth/pool_hba.c src/auth/pool_auth.c src/auth/auth-scram.c src/watchdog/watchdog.c src/watchdog/wd_lifecheck.c src/config/pool_config_variable.c
 
| other than :src/auth/pool_hba.c src/auth/pool_auth.c src/auth/auth-scram.c src/watchdog/watchdog.c src/watchdog/wd_lifecheck.c src/config/pool_config_variable.c
 
|  
 
|  
|-style="background:white"
+
|-style="background:red"
 +
| 114
 +
| [https://www.pgpool.net/pipermail/pgpool-general/2019-August/006730.html pgpool-general: 6672] Query (watchdog split brain)
 +
| 2019/08/16
 +
|
 +
|
 +
|
 +
| Usama
 +
|
 +
| Requested log sent [https://www.pgpool.net/pipermail/pgpool-general/2019-September/006753.html pgpool-general: 6695]
 +
|-style="background:silver"
 +
| 115
 +
| regression test 013.watchdog_failover_require_consensus failed
 +
| 2019/08/14
 +
|
 +
|
 +
|
 +
| Ishii
 +
|
 +
|
 +
|-style="background:red"
 +
| 116
 +
| Doc:Pgpool-II + Watchdog Setup Example (for PostgreSQL 12)
 +
| 2019/09/03
 +
|
 +
|
 +
|
 +
| Peng
 +
|
 +
|
 +
|-style="background:silver"
 +
| 117
 +
| regression test 028. 028.watchdog_enable_consensus_with_half_votes failed
 +
| 2019/09/13
 +
| 2019/09/18
 +
|
 +
|
 +
| Ishii
 +
|
 +
|
 +
|-style="background:silver"
 +
| 118
 +
| 0000545: Quorum lost and not recovered
 +
| 2019/09/09
 +
|
 +
|
 +
|
 +
| Usama
 +
| https://www.pgpool.net/mantisbt/view.php?id=545
 +
|
 +
|-style="background:red"
 +
| 119
 +
| 0000547: We need to do arping again after recovering from split-brain.
 +
| 2019/09/12
 +
|
 +
|
 +
|
 +
| Usama
 +
| https://www.pgpool.net/mantisbt/view.php?id=547
 +
|
 +
|-style="background:silver"
 +
| 120
 +
| regression test 065.bug152 failed if enable_shared_relcache is on
 +
| 2019/10/02
 +
|
 +
|
 +
|
 +
| Hoshiai
 +
|
 +
|
 +
|-style="background:silver"
 
| 201
 
| 201
 
| Feature Agreement  
 
| Feature Agreement  
Line 351: Line 437:
 
|
 
|
 
|  
 
|  
|-style="background:white"
+
|-style="background:silver"
 
| 202
 
| 202
 
| Feature Freeze  
 
| Feature Freeze  
 
|  
 
|  
| 2019/07/31
+
| 2019/08/15
 
|  
 
|  
 
|  
 
|  
Line 361: Line 447:
 
|
 
|
 
|  
 
|  
|-style="background:white"
+
|-style="background:silver"
| 202
+
| 203
 
| Code Freeze  
 
| Code Freeze  
 
|  
 
|  
Line 370: Line 456:
 
|
 
|
 
|
 
|
 +
|
 +
|
 +
|-style="background:silver"
 +
| 204
 +
| Release beta1
 +
|
 +
| 2019/09/06
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-style="background:white"
 +
| 205
 +
| RC Release
 +
|
 +
| 2019/10/11
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-style="background:white"
 +
| 206
 +
| Official Release
 +
|
 +
| 2019/10/15
 +
|
 
|  
 
|  
 +
|
 +
|
 +
|
 
|}
 
|}

Latest revision as of 08:11, 8 October 2019

Last update: 2019/10/08

Each bug items assigned "SL (Severity level)" from 1-3 (1 is the most severe, 3 is the least severe) in "Status" column.

Red items are open items for Pgpool-II 4.1.

ID Registered/start Date Target Date Priority Implementation Person in charge Overview Status
007 [FEATURE] shared relation cache 2018/11/20 2019/02/29 High Large Hoshiai [pgpool-hackers: 3124] Done. commit
008 [FEATURE] Enhance performance: performance regression test 2018/11/20 High Small Usama
[FEATURE] Enhance performance: performance for simple query (especially for of the large

INSERT and UPDATE statements)

2018/11/20 XLarge Usama Done. commit
[FEATURE] Enhance performance: performance for extended query 2019/01/17 Ishii (1) Enhance performance for COPY XXX TO STDOUT (both for simple and extended query): commit

(2) Enhance performance for extended query message:
[pgpool-hackers: 3230] commit
(3) Eliminate select(2) calls in certain cases to enhance performance in simple and extended query:
[pgpool-hackers: 3247] commit

009 [Documentation] Review and improve the current document 2018/11/20 High Extra Large Hoshiai commit1commit2commit3

commit4 commit5 commit6

[Documentation] Update the examples to latest version. 2018/11/20 High Peng Done. commit doc commit
010 [FEATURE] Master watchdog sets quarantine state to primary node 2018/11/26 Normal Small Usama [pgpool-hackers: 2756]
[pgpool-general-jp: 1504]
Done. Commit
011 [FEATURE] limiting number of frontends differently 2018/11/26 2018/12/04 Ishii [pgpool-hackers: 3153] Done. commit
012 [FEATURE] Don't load balance after a SELECT having functions specified in black function list 2018/11/29 2019/06/30 Normal Small Peng [pgpool-hackers: 3157] Done. commit
014 [FEATURE] Support for PostgreSQL 12. 2018/11/29 High Small Ishii recovery.conf
pgpool_setup
pgppol-recovery extension
Done. pgpool-recovery extension
pgpool_setup
015 [FEATURE] Import PostgreSQL 12 parser. 2018/11/29 2019/07/31 High Medium Peng Done. commit
016 [FEATURE] Statement level load balancing 2018/12/06 2019/03/31 High Large Peng Done. commit
018 [FEATURE] Add new columns to "show pool_nodes" command 2019/04/22 2019/04/24 High Medium Ishii Discussion: [pgpool-hackers: 3315] Done. Commit
019 [FEATURE][Document] Add new performance section High Medium Ishii Done. commit
020 [FEATURE] auto failback 2019/5/23 2019/7/5 Medium Hoshiai [pgpool-hackers: 3328] Done. commit
021 [FEATURE] allow to use md5 password in health_check_password and sr_check_password 2019/5/30 2019/6/10 Medium Ishii [pgpool-hackers: 3334] Done. commit
022 [FEATURE] Routing relcache queries to load balance node Medium Ishii [pgpool-hackers: 3342] Done. commit
023 [FEATURE] Support ECDH key exchange with SSL Medium Hoshiai Done. commit1 commit2
024 [FEATURE] Reduce relcahe queries Medium Ishii [pgpool-hackers: 3344] Done. commit
025 [FEATURE] Eliminate temp table relcahe query Medium Ishii [pgpool-hackers: 3346] Done. commit
026 [FEATURE] Add new arguments in pgpool_recovery function and failover_command/failback_command/follow_master_command. Small Peng Done. commit
101 0000433: IN (SELECT ...) can not be rewritten in native replication mode 2018/10/19 Peng bug433 Done. commit
Regression test should be added.
102 0000434: Segmentation fault due to a query error and Sync messages in native replication mode 2018/10/19 Hoshiai bug434 Done. commit
103 pool_passwd is corrupted. 2018/10/22 Hoshiai, Usama [pgpool-hackers: 3081] Done. commit
104 [pgpool-hackers: 3025] Compile warns 2018/10/22 Hoshiai [pgpool-hackers: 3025] Done. commit
105 0000443: Segmentation fault occurs when a certain Bind message is sent in native replication mode. 2018/11/08 Peng bug443 Done. commit
106 0000444: pgpool does not take into account parameters order in startup packet 2018/11/13 Hoshiai bug444 Done. commit
107 0000448: pgpool holds the connections as idle_in_transaction which are timed out due to idle_in_transaction setting on backend nodes 2018/11/29 Ishii bug448 Done. commit
108 [pgpool-general: 6351] kind mismatch among backends, savepoint with psqlodbc 2018/12/26 Peng [pgpool-general: 6351]
109 0000455: watchdog lifecheck process has segfalut in query mode 2019/01/21 Usama https://www.pgpool.net/mantisbt/view.php?id=455 Done. https://git.postgresql.org/gitweb/?p=pgpool2.git;a=commit;h=4cde5da1b416d909d102cfe6878c0cd5189caf86
110 Add regression test for query mode 2019/01/21 Peng
111 0000483: online-recovery is blocked after a child process exits abnormally with replication mode and watchdog 2019/04/04 Usama bug483 Done commit.
112 Fix memory leak related to watchdog and auth pointed out by coverity 2019/05/22 Usama src/auth/pool_hba.c src/auth/pool_auth.c src/auth/auth-scram.c src/watchdog/watchdog.c src/watchdog/wd_lifecheck.c src/config/pool_config_variable.c Done
113 Fix memory leak related to watchdog and auth pointed out by coverity 2019/05/22 ishii other than :src/auth/pool_hba.c src/auth/pool_auth.c src/auth/auth-scram.c src/watchdog/watchdog.c src/watchdog/wd_lifecheck.c src/config/pool_config_variable.c
114 pgpool-general: 6672 Query (watchdog split brain) 2019/08/16 Usama Requested log sent pgpool-general: 6695
115 regression test 013.watchdog_failover_require_consensus failed 2019/08/14 Ishii
116 Doc:Pgpool-II + Watchdog Setup Example (for PostgreSQL 12) 2019/09/03 Peng
117 regression test 028. 028.watchdog_enable_consensus_with_half_votes failed 2019/09/13 2019/09/18 Ishii
118 0000545: Quorum lost and not recovered 2019/09/09 Usama https://www.pgpool.net/mantisbt/view.php?id=545
119 0000547: We need to do arping again after recovering from split-brain. 2019/09/12 Usama https://www.pgpool.net/mantisbt/view.php?id=547
120 regression test 065.bug152 failed if enable_shared_relcache is on 2019/10/02 Hoshiai
201 Feature Agreement
202 Feature Freeze 2019/08/15
203 Code Freeze 2019/08/31
204 Release beta1 2019/09/06
205 RC Release 2019/10/11
206 Official Release 2019/10/15