An Automatic Tool for Benchmark Testing of Cloud Applications

Valentina Casola, Alessandra De Benedictis, Massimiliano Rak, Umberto Villano

2017

Abstract

The performance testing of cloud applications is a challenging research topic, due to the multiplicity of different possibilities to allocate application services to Cloud Service Providers (CSPs). Currently available benchmarks mainly focus on evaluating specific services or infrastructural resources offered by different CSPs, but are not always useful to evaluate complete cloud applications and to discover performance bugs. This paper proposes a methodology to define an evaluation performance process, particularly suited for cloud applications, and an automatic procedure to set up and to execute benchmark tests. The methodology is based on the evaluations of two performance indexes, and is validated by presenting a complete case study application, developed within the FP7-EU-SPECS project. The analysis of the measurement results, produced automatically, can help the developer to discover possible bottlenecks and to take actions to improve both the usability and the performance of a cloud application.

Paper Citation

in Harvard Style

Casola V., De Benedictis A., Rak M. and Villano U. (2017). An Automatic Tool for Benchmark Testing of Cloud Applications . In Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-243-1, pages 729-736. DOI: 10.5220/0006379507290736

in Bibtex Style

@conference{closer17,
author={Valentina Casola and Alessandra De Benedictis and Massimiliano Rak and Umberto Villano},
title={An Automatic Tool for Benchmark Testing of Cloud Applications},
booktitle={Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2017},
pages={729-736},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006379507290736},
isbn={978-989-758-243-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - An Automatic Tool for Benchmark Testing of Cloud Applications
SN - 978-989-758-243-1
AU - Casola V.
AU - De Benedictis A.
AU - Rak M.
AU - Villano U.
PY - 2017
SP - 729
EP - 736
DO - 10.5220/0006379507290736