Software for view synthesis

 

Last Update: June 27th 2008

 

 

This software generates novel viewpoint images.

 

  

 

  

Input images and depth maps

 

Output virtual view

 

*****************************************************************

Input files

·          View images (YUV 4:2:0 video)

·          Depth maps (YUV 4:2:0 video)

·          Camera parameter file (Text file)

·          Parameter configuration file (.cfg file)

Output file

·          Interpolated view image (YUV 4:2:0 video)

 

n      Input/output file format

   YUV 4:2:0 video files are inputted or outputted.

 

n      Camera parameter file

   Intrinsic and extrinsic parameters of real and virtual cameras are gathered in a text file. Then, each camera has to be named for identifying them. For example, cameras which correspond to the view00, view01, and view02 of Nagoya dog sequence are named as param_dog00, param_dog01, and param_dog02, respectively. Figure 1 shows an example of camera parameter file.

 

Fig.1 An example of camera parameter file.

 

 

n      View setting file

   Conventional view setting file was replaced by a configuration file (.cfg file). The following parameters which are included in this configuration file. Z_near and Z_far values of left view and Z_near and Z_far values of right view can be assigned independently.

 

 

1.     Depth type

2.     Width of view image

3.     Height of view image

4.     Znear value of left view from camera or the origin of 3D space

5.     Zfar value of left view from camera or the origin of 3D space

6.     Znear value of right view from camera or the origin of 3D space

7.     Zfar value of right view from camera or the origin of 3D space

8.     Total number of frames

9.     Camera parameter file name

10. Left real camera name

11. Virtual camera name

12. Right real camera name

13. File name of left view image

14. File name of right view image

15. File name of left depth map

16. File name of right depth map

17. File name of output virtual view image

 

 

Figure 2 shows an example of configuration file.

Fig.2 An example of configuration file.

 

Depth type

This software is equipped two types of view synthesis mode. One of them uses depth from camera and the other uses depth from the origin of 3D space.

 

********************************************************************

 

Usage of software

viewsynthesis.cfg file has to be assigned to the first command line argument. If you use this software from command prompt, please input “viewsynthesis.exe viewsynthesis.cfg” and press Enter key. Then view synthesis starts.

 

**************************************************************************

Software download

 

To download binary file [download]

This zip file includes exe file and example input files.

This binary file was generated with Visual Studio 2005 SP1, so Microsoft Visual C++ 2005 Redistributable Package is necessary unless VC2005 SP1 is installed on your computer.

You can download the Package at

http://www.microsoft.com/Downloads/details.aspx?FamilyID=32bc1bee-a3f9-4c13-9c99-220b62a191ee&displaylang=en

 

Source code is distributed as Visual Studio 2005 project file. To compile this project,

Visual Studio 2005 and OpenCV library must be installed on your computer.

 

If you are not familiar with OpenCV, refer

http://www.intel.com/technology/computing/opencv/index.htm

 

To download Visual Studio 2005 project file [download]

 

**************************************************************************

 

Acknowledgement

I would like to express my thanks to MPEG-FTV EE participants who gave us useful and kindly comments and questions concerning to the previous version of our software.

 

Kazuyoshi Suzuki

 

If you have a question, don’t hesitate to mail to