Verifying ACID compliance is an essential part of database benchmarking, because the integrity of performance results can be undermined as the performance benefits of operating with weaker safety guarantees (at the potential cost of correctness) are well known. Traditionally, benchmarks have specified a number of tests to validate ACID compliance. However, these tests have been formulated in the context of relational database systems and SQL, whereas our scope of benchmarking are systems for graph data, many of which are non-relational. This paper presents a set of data model-agnostic ACID compliance tests for the LDBC (Linked Data Benchmark Council) Social Network Benchmark suite’s Interactive (SNB-I) workload, a transaction processing benchmark for graph databases. We test all ACID properties with a particular emphasis on isolation, covering 10 transaction anomalies in total. We present results from implementing the test suite on 5 database systems.

doi.org/10.1007/978-3-030-84924-5_1
Lecture Notes in Computer Science
Structure-aware Querying & Information Retrieval on Evolving Large Graphs
Centrum Wiskunde & Informatica, Amsterdam (CWI), The Netherlands

Waudby, J., Steer, B., Karimov, K., Marton, J., Boncz, P., & Szárnyas, G. (2021). Towards testing ACID compliance in the LDBC Social Network Benchmark. In Proceedings of the 2020 Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2020 (pp. 1–17). doi:10.1007/978-3-030-84924-5_1