SELF-ORGANIZING SYNCHRONICITY AND DESYNCHRONICITY USING REINFORCEMENT LEARNING

Mihail Mihaylov, Yann-Aël Le Borgne, Ann Nowé, Karl Tuyls

2011

Abstract

We present a self-organizing reinforcement learning (RL) approach for coordinating the wake-up cycles of nodes in a wireless sensor network in a decentralized manner. To the best of our knowledge we are the first to demonstrate how global synchronicity and desynchronicity can emerge through local interactions alone without the need of central mediator or any form of explicit coordination. We apply this RL approach to wireless sensor nodes arranged in different topologies and study how agents, starting with a random policy, are able to self-adapt their behavior based only on their interaction with neighboring nodes. Each agent independently learns to which nodes it should synchronize to improve message throughput and at the same with whom to desynchronize in order to reduce communication interference. The obtained results show how simple and computationally bounded sensor nodes are able to coordinate their wake-up cycles in a distributed way in order to improve the global system performance through (de)synchronicity.

Paper Citation

in Harvard Style

Mihaylov M., Le Borgne Y., Nowé A. and Tuyls K. (2011). SELF-ORGANIZING SYNCHRONICITY AND DESYNCHRONICITY USING REINFORCEMENT LEARNING . In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-8425-41-6, pages 94-103. DOI: 10.5220/0003162600940103

in Bibtex Style

@conference{icaart11,
author={Mihail Mihaylov and Yann-Aël Le Borgne and Ann Nowé and Karl Tuyls},
title={SELF-ORGANIZING SYNCHRONICITY AND DESYNCHRONICITY USING REINFORCEMENT LEARNING},
booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2011},
pages={94-103},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003162600940103},
isbn={978-989-8425-41-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - SELF-ORGANIZING SYNCHRONICITY AND DESYNCHRONICITY USING REINFORCEMENT LEARNING
SN - 978-989-8425-41-6
AU - Mihaylov M.
AU - Le Borgne Y.
AU - Nowé A.
AU - Tuyls K.
PY - 2011
SP - 94
EP - 103
DO - 10.5220/0003162600940103