2025-08-01
Still asking: How good are query optimizers, really?
Publication
Publication
Proceedings of the VLDB Endowment , Volume 18 - Issue 12 p. 5531- 5536
This retrospective revisits our 2015 PVLDB paper How Good Are Query Optimizers, Really?, which challenged the prevailing notion that query optimization was a solved problem. By designing the Join Order Benchmark (JOB) and conducting a series of systematic experiments, we empirically disentangled the contributions of plan enumeration, cost modeling, and cardinality estimation. Our findings showed that cardinality estimation errors are widespread and often the dominant factor behind poor query plans, while cost models and enumeration strategies matter comparatively less. The benchmark and methodology helped refocus the community’s attention on cardinality estimation and led to a resurgence of research in this area, including learned and AI-based approaches. We reflect on the role of experiments and benchmarking in database research, survey developments in query optimization over the past decade, and discuss open challenges around robustness, adaptive execution, and realistic workloads.
| Additional Metadata | |
|---|---|
| doi.org/10.14778/3750601.3760521 | |
| Proceedings of the VLDB Endowment | |
| 51st International Conference on Very Large Data Bases | |
| Organisation | Centrum Wiskunde & Informatica, Amsterdam (CWI), The Netherlands |
|
Leis, V., Gubichev, A., Mirchev, A., Boncz, P., Kemper, A., & Neumann, T. (2025). Still asking: How good are query optimizers, really?. In Proceedings of the VLDB Endowment (Vol. 18, pp. 5531–5536). doi:10.14778/3750601.3760521 |
|