Software
for view synthesis
Last
Update: June 27th 2008
This software
generates novel viewpoint images.
Input images
and depth maps
Output
virtual view
*****************************************************************
Input files
·
View images (YUV 4:2:0
video)
·
Depth maps (YUV 4:2:0
video)
·
Camera parameter file
(Text file)
·
Parameter
configuration file (.cfg file)
Output file
·
Interpolated view
image (YUV 4:2:0 video)
n
Input/output file format
YUV 4:2:0 video files are inputted or outputted.
n
Camera parameter file
Intrinsic and extrinsic parameters of real and virtual
cameras are gathered in a text file. Then, each camera has to be named for
identifying them. For example, cameras which correspond to the view00, view01,
and view02 of
Fig.1 An example of
camera parameter file.
n
View setting file
Conventional view setting file was replaced by a
configuration file (.cfg file). The following parameters which are included in
this configuration file. Z_near and Z_far values of
left view and Z_near and Z_far values of right view can be assigned
independently.
1.
Depth type
2.
Width of view image
3.
Height of view image
4. Znear
value of left view from camera or the origin of 3D space
5. Zfar
value of left view from camera or the origin of 3D space
6. Znear
value of right view from camera or the origin of 3D space
7. Zfar
value of right view from camera or the origin of 3D space
8.
Total number of frames
9.
Camera parameter file name
10.
Left real camera name
11.
Virtual camera name
12.
Right real camera name
13.
File name of left view image
14.
File name of right view image
15.
File name of left depth map
16.
File name of right depth map
17.
File name of output virtual view image
Figure 2 shows an
example of configuration file.
Fig.2 An example of
configuration file.
Depth type
This software is
equipped two types of view synthesis mode. One of them uses depth from camera
and the other uses depth from the origin of 3D space.
********************************************************************
Usage of
software
viewsynthesis.cfg file has to be assigned to the
first command line argument. If you use this software from command prompt, please
input “viewsynthesis.exe viewsynthesis.cfg” and press Enter key. Then view
synthesis starts.
**************************************************************************
Software
download
To download binary file
[download]
This zip file includes
exe file and example input files.
This binary
file was generated with Visual Studio 2005 SP1, so Microsoft Visual C++ 2005
Redistributable Package is necessary unless VC2005 SP1 is installed on your
computer.
You can download
the Package at
Source code is
distributed as Visual Studio 2005 project file. To compile this project,
Visual Studio 2005 and
OpenCV library must be installed on your computer.
If you are not familiar
with OpenCV, refer
http://www.intel.com/technology/computing/opencv/index.htm
To download Visual
Studio 2005 project file [download]
**************************************************************************
Acknowledgement
I would like to express
my thanks to MPEG-FTV EE participants who gave us useful and kindly comments
and questions concerning to the previous version of our software.
Kazuyoshi Suzuki
If you have a question,
don’t hesitate to mail to