Q-Routing in Cognitive Packet Network Routing Protocol for MANETs

Amal Alharbi, Abdullah Al-Dhalaan, Miznah Al-Rodhaan

2014

Abstract

Mobile Ad hoc Networks (MANET) are self-organized networks which are characterized by dynamic topologies in time and space. This creates an instable environment, where classical routing approaches cannot achieve high performance. Thus, adaptive routing is necessary to handle the random changing network topology. This research uses Reinforcement Learning approach with Q-Routing to introduce our MANET routing algorithm: Stability-Aware Cognitive Packet Network (CPN). This new algorithm extends the work on CPN to adapt it to the MANET environment with focus on path stability metric. CPN is a distributed adaptive routing protocol that uses three types of packets: Smart Packets for route discovery, Data Packets for carrying data payload, and Acknowledgments to bring back feedback information for the Reinforcement Learning reward function. The research defines a reward function as a combination of high stability and low delay path criteria to discover long-lived routes without disrupting the overall delay. The algorithm uses Acknowledgment-based Q-routing to make routing decisions which adapt on line to network changes allowing nodes to learn efficient routing policies.

Paper Citation

in Harvard Style

Alharbi A., Al-Dhalaan A. and Al-Rodhaan M. (2014). Q-Routing in Cognitive Packet Network Routing Protocol for MANETs . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014) ISBN 978-989-758-054-3, pages 234-243. DOI: 10.5220/0005082902340243

in Bibtex Style

@conference{ncta14,
author={Amal Alharbi and Abdullah Al-Dhalaan and Miznah Al-Rodhaan},
title={Q-Routing in Cognitive Packet Network Routing Protocol for MANETs},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)},
year={2014},
pages={234-243},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005082902340243},
isbn={978-989-758-054-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)
TI - Q-Routing in Cognitive Packet Network Routing Protocol for MANETs
SN - 978-989-758-054-3
AU - Alharbi A.
AU - Al-Dhalaan A.
AU - Al-Rodhaan M.
PY - 2014
SP - 234
EP - 243
DO - 10.5220/0005082902340243