Random Projections with Control Variates

Keegan Kang, Giles Hooker

2017

Abstract

Random projections are used to estimate parameters of interest in large scale data sets by projecting data into a lower dimensional space. Some parameters of interest between pairs of vectors are the Euclidean distance and the inner product, while parameters of interest for the whole data set could be its singular values or singular vectors. We show how we can borrow an idea from Monte Carlo integration by using control variates to reduce the variance of the estimates of Euclidean distances and inner products by storing marginal information of our data set. We demonstrate this variance reduction through experiments on synthetic data as well as the colon and kos datasets. We hope that this inspires future work which incorporates control variates in further random projection applications.

Paper Citation

in Harvard Style

Kang K. and Hooker G. (2017). Random Projections with Control Variates . In Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-222-6, pages 138-147. DOI: 10.5220/0006188801380147

in Bibtex Style

@conference{icpram17,
author={Keegan Kang and Giles Hooker},
title={Random Projections with Control Variates},
booktitle={Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2017},
pages={138-147},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006188801380147},
isbn={978-989-758-222-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Random Projections with Control Variates
SN - 978-989-758-222-6
AU - Kang K.
AU - Hooker G.
PY - 2017
SP - 138
EP - 147
DO - 10.5220/0006188801380147