Capturing Performance Assumptions using Stochastic Performance Logic

0369679 - ÚI 2013 RIV US eng C - Conference Paper (international conference)
Bulej, Lubomír - Bureš, T. - Keznikl, J. - Koubková, A. - Podzimek, A. - Tůma, P.
Capturing Performance Assumptions using Stochastic Performance Logic.
ICPE 2012. New York: ACM, 2012, s. 311-322. ISBN 978-1-4503-1202-8.
[ICPE 2012. ACM/SPEC International Conference on Performance Engineering /3./. Boston (US), 22.04.2012-25.04.2012]
R&D Projects: GA ČR GCP202/10/J042
Institutional research plan: CEZ:AV0Z10300504
Keywords : performance testing * regression benchmarking
Subject RIV: IN - Informatics, Computer Science

Compared to functional unit testing, automated performance testing is difficult, partially because correctness criteria are more difficult to express for performance than for functionality. Where existing approaches rely on absolute bounds on the execution time, we aim to express assertions on code performance in relative, hardware-independent terms. To this end, we introduce Stochastic Performance Logic (SPL), which allows making statements about relative method performance. Since SPL interpretation is based on statistical tests applied to performance measurements, it allows (for a special class of formulas) calculating the minimum probability at which a particular SPL formula holds. We prove basic properties of the logic and present an algorithm for SAT-solver-guided evaluation of SPL formulas, which allows optimizing the number of performance measurements that need to be made. Finally, we propose integration of SPL formulas with Java code using higher-level performance annotations, for performance testing and documentation purposes.
Permanent Link: http://hdl.handle.net/11104/0203688