The physical memory layout of a tree-based index structure deteriorates over time as it sustains more updates; such that sequential scans on the physical level become non-sequential, and therefore slower. Packed Memory Arrays (PMAs) prevent this by managing all data in a sequential sparse array. PMAs have been studied mostly theoretically but suffer from practical problems, as we show in this paper. We study and fix these problems, resulting in an improved data structure: the Rewired Memory Array (RMA). We compare RMA with the main previous PMA implementations as well as state-of-the-art tree index structures and show on a wide variety of data and query distributions that RMA can reach competitive update and point lookup performance, while always providing superior scan performance – close to dense column scans.

, , ,
doi.org/10.1109/ICDE.2019.00079
IEEE International Conference on Data Engineering
Centrum Wiskunde & Informatica, Amsterdam (CWI), The Netherlands

De Leo, D., & Boncz, P. (2019). Packed Memory Arrays – Rewired. In Proceedings of the IEEE International Conference on Data Engineering (ICDE) (pp. 830–841). doi:10.1109/ICDE.2019.00079