Light Field Camera Project

Go back to Top Page

Super Resolution Reconstruction from Light Field Cameras

An RAW image captured from a Lytro Illum camera

Schematic diagram of the "direct method"

A sub-aperture image created by the "direct method"

We propose a method of high-resolution image synthesis for a light field camera, considering the physical pixel arrangement and sparsity of edges. We use a Lytro Illum camera to obtain 4D light field data (a set of multi-viewpoint images) through a micro-lens array. The light field data are multiplexed on a single image sensor, and thus, the data is first de-multiplexed into a set of multi-viewpoint (sub-aperture) images. However, the de-multiplexing process usually includes interpolation of the original data such as demosaicing for a color filter array and pixel resampling for the hexagonal pixel arrangement of the original sub-aperture images. If this interpolation is performed, some information is added or lost to/from the original data. In contrast, we preserve the original data as faithfully as possible, and use them directly for the super-resolution reconstruction, where the super-resolved image and the corresponding depth map are alternatively refined. We experimentally demonstrate that our method can achieve higher image quality than that with a standard Light Field Toolbox and a Lytro Desktop Application.

Project Members

Toshiaki FUJII (Professor)

Keita TAKAHASHI (Associate Professor)

Kazuki OHASHI (former graduate student: --2015.3)

Yuki UCHIDA (former graduate student: --2016.3)

Shu Fujita (graduate student)

Publications