Reducing planning time when tables have many partitions

Edit

3701

Title

CI (CFBot)

Summary

Stats (from CFBot)

Patch version: v42, Patch count: 1, First patch: +446−120, All patches: +446−120

Topic

Performance

Tags

Created

2022-06-22 08:41:43

Last modified

2025-04-08 20:06:11 (2 months ago)

Latest email

2025-04-08 09:04:16 (2 months ago)

Status

2025-03 (2025-03-01 - 2025-04-08): Committed

2025-01 (2025-01-01 - 2025-01-31): Moved to different CF

2024-11 (2024-11-01 - 2024-11-30): Moved to different CF

2024-09 (2024-09-01 - 2024-09-30): Moved to different CF

2024-07 (2024-07-01 - 2024-07-31): Moved to different CF

2024-03 (2024-03-01 - 2024-04-08): Moved to different CF

2024-01 (2024-01-01 - 2024-01-31): Moved to different CF

2023-11 (2023-11-01 - 2023-12-04): Moved to different CF

2023-09 (2023-09-01 - 2023-09-30): Moved to different CF

2023-07 (2023-07-01 - 2023-07-31): Moved to different CF

2023-03 (2023-03-01 - 2023-04-08): Moved to different CF

2023-01 (2023-01-01 - 2023-01-31): Moved to different CF

2022-11 (2022-11-01 - 2022-11-30): Moved to different CF

2022-09 (2022-09-01 - 2022-09-30): Moved to different CF

2022-07 (2022-07-01 - 2022-07-31): Moved to different CF

Target version

Authors

Yuya Watari (watari)

Reviewers

Tom Lane (tgl), Thom Brown (thom), Ashutosh Bapat (ashutoshbapat), Andrei Lepikhov (lepikhov), newtglobal postgresql_contributors (newtpostgrescontributors)Become reviewer

Committer

David Rowley (davidrowley)

Links

Emails

[PoC] Reducing planning time when tables have many partitions: First at 2022-03-18 10:24:56 by Yuya Watari <watari.yuya at gmail.com>
Latest at 2025-04-08 09:04:16 by Yuya Watari <watari.yuya at gmail.com>
Latest attachment (bench_results_v42.sql.bz2) at 2025-04-08 06:31:16 from David Rowley <dgrowleyml at gmail.com>
    Attachment (bench_results_v42.sql.bz2) at 2025-04-08 06:31:16 from David Rowley <dgrowleyml at gmail.com> (Patch: No)
    Attachment (some_edits.txt) at 2025-04-08 05:41:11 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: Yes)
    Attachment (v42-0001-Speedup-child-EquivalenceMember-lookup-in-planne.patch) at 2025-04-08 03:00:32 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (eq_member_find_duplicates.patch.txt) at 2025-04-06 23:04:29 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v40-0001-Speedup-child-EquivalenceMember-lookup-in-planne.patch) at 2025-04-05 03:55:12 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v39-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2025-04-04 15:05:05 from Tom Lane <tgl at sss.pgh.pa.us> (Patch: Yes)
    Attachment (v38-0001-Add-the-PlannerInfo-context-to-the-parameter-of-.patch) at 2025-04-04 14:30:46 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2025-04-04 08:42:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (partbench.sh.txt) at 2025-04-04 06:04:42 from David Rowley <dgrowleyml at gmail.com> (Patch: No)
    Attachment (v36-0001-Add-the-PlannerInfo-context-to-the-parameter-of-.patch) at 2025-04-03 11:34:02 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (0003-Resolve-conflict-with-commit-66c0185-20250327.patch) at 2025-03-27 05:10:17 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: Yes)
    Attachment (diff-v34-v35.txt) at 2025-03-23 23:23:44 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (diff-v33-v34.txt) at 2025-03-14 10:09:38 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2025-03-01 10:06:38 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v32-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2025-02-19 07:33:32 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (diff-v30-v31.txt) at 2025-02-11 23:29:33 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (diff-v29-v30.txt) at 2025-01-07 06:56:53 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2024-12-20 05:26:27 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (Report-memory-used-for-planning-a-query-in-EXPLAIN-A.txt) at 2024-12-11 03:16:24 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2024-12-02 08:51:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v27-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-10-15 03:20:04 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-10-01 02:35:05 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-08-29 05:34:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v24-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-02-28 11:18:18 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (sanity-check.txt) at 2024-01-17 09:33:42 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (poc-alias-reloptinfo.txt) at 2023-12-13 06:21:57 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v21-0001-PATCH-PATCH-1-2-Speed-up-searches-for-child-Equivale.patch) at 2023-11-18 23:57:34 from Alena Rybakina <lena.ribackina at yandex.ru> (Patch: Yes)
    Attachment (solved_conflict_with_self_join_removal.diff) at 2023-11-17 21:04:12 from Alena Rybakina <lena.ribackina at yandex.ru> (Patch: Yes)
    Attachment (v20-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2023-08-25 07:39:16 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (planning time measurement.ods) at 2023-07-28 09:50:57 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: No)
    Attachment (2-Yuya-kernel.svg) at 2023-07-28 04:27:40 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: No)
    Attachment (parts-problem.sql) at 2023-07-27 07:58:16 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: No)
    Attachment (v19-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-07-05 09:57:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-03-10 08:38:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-02-17 08:31:45 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-02-06 01:47:33 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-01-30 12:14:28 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-01-30 10:02:37 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-01-27 03:48:30 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2022-12-12 04:50:09 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2022-12-07 11:30:24 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v10-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2022-12-04 00:34:44 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-11-29 08:58:25 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-11-02 09:27:52 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-10-24 04:12:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure-1.png) at 2022-09-21 09:43:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v4-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-08-26 00:39:32 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (eclass_member_speedup_v3.patch) at 2022-08-16 08:26:41 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (0002-Fix-bugs.patch) at 2022-08-08 11:27:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (eclass_member_speedup.patch) at 2022-07-27 21:35:10 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2022-07-05 08:57:14 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v2-reducing-planning-time-when-tables-have-many-partitions.patch) at 2022-06-22 09:05:43 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v1-reducing-planning-time-when-tables-have-many-partitions.patch) at 2022-03-18 10:24:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)

History

When	Who	What
2025-04-08 20:06:11	David Rowley (davidrowley)	Closed in commitfest 2025-03 with status: Committed
2025-04-08 20:06:11	David Rowley (davidrowley)	Changed committer to davidrowley
2025-04-07 03:03:40	David Rowley (davidrowley)	New status: Ready for Committer
2025-04-07 02:32:14	David Rowley (davidrowley)	New status: Needs review
2025-03-31 05:48:44	Yuya Watari (watari)	New status: Waiting on Author
2025-03-12 07:23:32	newtglobal postgresql_contributors (newtpostgrescontributors)	Posted review with messageid <174176421219.294105.3395783202038263246.pgcf@coridan.postgresql.org>
2025-03-10 07:03:59	newtglobal postgresql_contributors (newtpostgrescontributors)	Added newtpostgrescontributors as reviewer
2025-03-01 10:31:45	CFbot	Patch does not need rebase anymore
2025-02-28 09:34:40	CFbot	Patch needs rebase
2025-02-19 08:01:45	CFbot	Patch does not need rebase anymore
2025-02-17 13:10:30	CFbot	Patch needs rebase
2025-02-04 16:23:44	Tom Lane (tgl)	Closed in commitfest 2025-01 with status: Moved to next CF
2025-02-04 16:23:36	Tom Lane (tgl)	Added tgl as reviewer
2024-12-27 00:23:10	Yuya Watari (watari)	New status: Needs review
2024-12-01 19:04:35	Dmitry Dolgov (erthalion)	Closed in commitfest 2024-11 with status: Moved to next CF
2024-12-01 19:04:32	Dmitry Dolgov (erthalion)	New status: Waiting on Author
2024-10-05 09:43:47	Andrey Borodin (x4m)	Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-29 05:37:22	Yuya Watari (watari)	New status: Needs review
2024-08-01 01:58:48	Corey Huinker (coreyh)	Closed in commitfest 2024-07 with status: Moved to next CF
2024-05-16 02:50:28	Yuya Watari (watari)	New status: Waiting on Author
2024-04-08 15:00:28	Andrey Borodin (x4m)	Closed in commitfest 2024-03 with status: Moved to next CF
2024-02-28 11:19:40	Yuya Watari (watari)	New status: Needs review
2024-02-01 18:42:28	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2024-01 with status: Moved to next CF
2023-11-30 04:15:26	Yuya Watari (watari)	Closed in commitfest 2023-11 with status: Moved to next CF
2023-10-02 10:56:22	Peter Eisentraut (petere)	Closed in commitfest 2023-09 with status: Moved to next CF
2023-09-20 09:52:02	Yuya Watari (watari)	New status: Waiting on Author
2023-09-12 06:20:09	David Rowley (davidrowley)	Changed authors to Yuya Watari (watari)
2023-08-04 10:56:39	Ashutosh Bapat (ashutoshbapat)	Added ashutoshbapat as reviewer
2023-08-01 20:57:38	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2023-07 with status: Moved to next CF
2023-04-09 02:31:47	Greg Stark (stark)	Closed in commitfest 2023-03 with status: Moved to next CF
2023-02-07 23:35:44	David Rowley (davidrowley)	Changed authors to David Rowley (davidrowley), Yuya Watari (watari)
2023-01-31 16:16:27	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2023-01 with status: Moved to next CF
2022-12-14 00:04:56	Ian Barwick (barwick)	Closed in commitfest 2022-11 with status: Moved to next CF
2022-12-05 15:53:20	Thom Brown (thom)	Added thom as reviewer
2022-10-24 04:16:48	Yuya Watari (watari)	New status: Needs review
2022-10-12 07:48:06	Michael Paquier (michael-kun)	Closed in commitfest 2022-09 with status: Moved to next CF
2022-10-12 07:48:04	Michael Paquier (michael-kun)	New status: Waiting on Author
2022-08-09 04:21:20	Yuya Watari (watari)	New status: Needs review
2022-08-02 18:02:47	Jacob Champion (jchampion)	Closed in commitfest 2022-07 with status: Moved to next CF
2022-07-21 11:36:20	Andrei Lepikhov (lepikhov)	Added lepikhov as reviewer
2022-07-21 11:35:58	Andrei Lepikhov (lepikhov)	New status: Waiting on Author
2022-06-22 08:42:46	Yuya Watari (watari)	Changed authors to Yuya Watari (watari)
2022-06-22 08:41:43	Yuya Watari (watari)	Attached mail thread CAJ2pMkZNCgoUKSE+_5LthD+KbXKvq6h2hQN8Esxpxd+cxmgomg@mail.gmail.com
2022-06-22 08:41:43	Yuya Watari (watari)	Created patch record

Edit