Restoration of Temporal Image Sequence from a Single Image Captured by a Correlation Image Sensor

Kohei Kawade, Akihiro Wakita, Tastuya Yokota, Hidekata Hontani, Shigeru Ando

2017

Abstract

We propose a method that restores a temporal image sequence, which describes how a scene temporally changed during the exposure period, from a given still image captured by a correlation image sensor (CIS). The restored images have higher spatial resolutions than the original still image, and the restored temporal sequence would be useful for motion analysis in applications such as landmark tracking and video labeling. The CIS is different from conventional image sensors because each pixel of the CIS can directly measure the Fourier coefficients of the temporal change of the light intensity observed during the exposure period. Given a single image captured by the CIS, hence, one can restore the temporal image sequence by computing the Fourier series of the temporal change of the light strength at each pixel. Through this temporal sequence restoration, one can also reduce motion blur. The proposed method improves the performance of motion blur reduction by estimating the Fourier coefficients of the frequencies higher than the measured ones. In this work, we show that the Fourier coefficients of the higher frequencies can be estimated based on the optical flow constraint. Some experimental results with images captured by the CIS are demonstrated.

Paper Citation

in Harvard Style

Kawade K., Wakita A., Yokota T., Hontani H. and Ando S. (2017). Restoration of Temporal Image Sequence from a Single Image Captured by a Correlation Image Sensor . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 181-191. DOI: 10.5220/0006115301810191

in Bibtex Style

@conference{visapp17,
author={Kohei Kawade and Akihiro Wakita and Tastuya Yokota and Hidekata Hontani and Shigeru Ando},
title={Restoration of Temporal Image Sequence from a Single Image Captured by a Correlation Image Sensor},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={181-191},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006115301810191},
isbn={978-989-758-227-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Restoration of Temporal Image Sequence from a Single Image Captured by a Correlation Image Sensor
SN - 978-989-758-227-1
AU - Kawade K.
AU - Wakita A.
AU - Yokota T.
AU - Hontani H.
AU - Ando S.
PY - 2017
SP - 181
EP - 191
DO - 10.5220/0006115301810191