Pubs Projects Tools About Home

Light Field Toolbox for MATLAB

This is a set of tools for working with light field (aka plenoptic) imagery in Matlab. Features include decoding, calibration, rectification, colour correction, basic filtering and visualization of light field images. New in version 0.4 are some linear depth/focus and denoising filters.

Publications

•  D. G. Dansereau, O. Pizarro, and S. B. Williams, “Decoding, calibration and rectification for lenselet-based plenoptic cameras,” in Computer Vision and Pattern Recognition (CVPR), 2013, pp. 1027–1034. Available here.

•  D. G. Dansereau, O. Pizarro, and S. B. Williams, “Linear volumetric focus for light field cameras,” ACM Transactions on Graphics (TOG), Presented at SIGGRAPH 2015, vol. 34, no. 2, p. 15, Feb. 2015. Available here.

Download

Latest release: v0.4 12-Feb-2015.

Community

There is a Google+ community for the toolbox here. Feel free to post questions, projects, feature ideas, bugs and cool light field-related news.

Datasets

The toolbox sample light field pack is here.

A small sample calibration is available here. This small example is intended as a fast test to validate the calibration code, and does not represent a very good calibration dataset. See some of the larger datasets, below, for better examples.

There are five calibration datasets accompanying our 2013 CVPR paper on decoding, calibration and rectification (link above). Datasets A and B are good example datasets for calibrating a Lytro-like camera, in that they feature dense grids imaged at close range and over diverse poses. Dataset A, Dataset B, Dataset C, Dataset D, Dataset E.

External Datasets

Gantry-captured Lego Knights, Chess and Tarot light fields are available at the Stanford Light Field Archive

Lytro Illum-captured datasets are available at the Stanford Lytro Light Field Archive.

A dataset from IRISIA is here.

A large dataset from EPFL is here.

A dataset of materials from UCSD is here.

A light field dataset from HCI Heidelberg is here.

Other Useful Tools

Know of a tool, dataset or webpage that would be useful to the light field community? Email it my way and I'll add to the list: donald (dot) dansereau (at) gmail (dot) com.

Light Field Imaging Toolkit, a MATLAB toolkit for the interactive processing of plenoptic images, available here.

cocolib / light field suite: a CUDA library for continuous optimization and light field analysis by Basian Goldluecke is here.

HCI Heidelberg have some tools for working with their benchamark dataset, as well as a blender plugin for generating light fields here.

Lytro Meltdown is a site dedicated to the Lytro cameras, and includes tools for working with Lytro files and the Lytro Communicator, for controlling the Lytros over WiFi.