METHODOLOGY FOR LEARNING VISUAL REACTIVE BEHAVIOURS IN ROBOTICS THROUGH REINFORCEMENT AND IMAGE-BASED STATES

Pablo Quintía, José E. Domenech, Cristina Gamallo, Carlos V. Regueiro

2007

Abstract

This article describes the development of a methodology for the learning of visual and reactive behaviours using reinforcement learning. With the use of artificial vision the environment is perceived in 3D, and it is possible to avoid obstacles that are invisible to other sensors that are more common in mobile robotics. Reinforcement learning reduces the need for intervention in behaviour design, and simplifies its adjustment to the environment, the robot and the task. The designed methodology is intended to be general; thus, in order to change the desired behaviour, only the reinforcement and the filtering of the image need to be changed. For the definition of the reinforcement a laser sensor is used, and for the definition of the states a fixed 3x3 grid is used. The behaviours learned were wall following, object following, corridor following and platform following. Results are presented with a Pioneer 2 AT. A Gazebo 3D simulator was used for the Learning and testing phase, and a test of the wall following behaviour was carried out in a real environment.

Paper Citation

in Harvard Style

Quintía P., E. Domenech J., Gamallo C. and V. Regueiro C. (2007). METHODOLOGY FOR LEARNING VISUAL REACTIVE BEHAVIOURS IN ROBOTICS THROUGH REINFORCEMENT AND IMAGE-BASED STATES . In Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-972-8865-83-2, pages 149-156. DOI: 10.5220/0001628901490156

in Bibtex Style

@conference{icinco07,
author={Pablo Quintía and José E. Domenech and Cristina Gamallo and Carlos V. Regueiro},
title={METHODOLOGY FOR LEARNING VISUAL REACTIVE BEHAVIOURS IN ROBOTICS THROUGH REINFORCEMENT AND IMAGE-BASED STATES},
booktitle={Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2007},
pages={149-156},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001628901490156},
isbn={978-972-8865-83-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - METHODOLOGY FOR LEARNING VISUAL REACTIVE BEHAVIOURS IN ROBOTICS THROUGH REINFORCEMENT AND IMAGE-BASED STATES
SN - 978-972-8865-83-2
AU - Quintía P.
AU - E. Domenech J.
AU - Gamallo C.
AU - V. Regueiro C.
PY - 2007
SP - 149
EP - 156
DO - 10.5220/0001628901490156