Distribution Data Across Multiple Cloud Storage using Reinforcement Learning Method

Abdullah Algarni, Daniel Kudenko

2017

Abstract

Storing data on a single cloud storage service may cause several potential problems for the data owner such as service continuity, availability, performance, security, and the risk of vendor lock-in. A promising solution to tackle some of these issues is to distribute the data across multiple cloud storage services (MCSS). However, the distinguishing characteristics of different cloud providers, in terms of pricing schemes and service performance, make it difficult to optimise the cost and the performance concurrently on MCSS. This paper proposes a framework for automatically tuning the data distribution policies across MCSS from the client side based on file access patterns. The aim of this work is to optimise the average cost and the average service performance (mainly latency time) on MCSS. To achieve this goal, two different machine learning algorithms are used in this work: (1) supervised learning to predict file access patterns, and (2) reinforcement learning to control data distribution parameters based on the prediction of file access pattern. The framework was tested on a cloud storage emulator, where its was set to act like several common cloud storage services. The result of testing this framework shows a significant improvement in the cost and performance of storing data in multiple clouds, as compared to the commonly used uniform file distribution.

Paper Citation

in Harvard Style

Algarni A. and Kudenko D. (2017). Distribution Data Across Multiple Cloud Storage using Reinforcement Learning Method . In Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-220-2, pages 431-438. DOI: 10.5220/0006124804310438

in Bibtex Style

@conference{icaart17,
author={Abdullah Algarni and Daniel Kudenko},
title={Distribution Data Across Multiple Cloud Storage using Reinforcement Learning Method},
booktitle={Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2017},
pages={431-438},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006124804310438},
isbn={978-989-758-220-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Distribution Data Across Multiple Cloud Storage using Reinforcement Learning Method
SN - 978-989-758-220-2
AU - Algarni A.
AU - Kudenko D.
PY - 2017
SP - 431
EP - 438
DO - 10.5220/0006124804310438