(Back to Session Schedule)

28th Picture Coding Symposium

Session O1  Oral Session 1: FTV
Time: 9:45 - 11:45 Wednesday, December 8, 2010
Chair: Marek Domanski (Poznan University of Technology, Poland)

O1-1 (Time: 9:45 - 10:15)
TitleFree Viewpoint Image Generation with Super Resolution
AuthorNorishige Fukushima, Yutaka Ishibashi (Graduate School of Engineering, Nagoya Institute of Technology, Japan)
Pagepp. 1 - 4
KeywordFree Viewpoint TV, Image Based Rendering, Ray Space, Light Field, Super Resolution
AbstractIn this paper, we propose a method of free viewpoint image generation with super resolution. In the conventional approach, such as nearest neighbor and linear interpolation, the synthetic image on zoomed virtual view tends to have low resolution. To overcome this problem, we combine the super resolution process with free viewpoint image generation. The experimental results show that synthesized image in the effective range has higher PSNR than the conventional method.

O1-2 (Time: 10:15 - 10:45)
TitleReducing Bitrates of Compressed Video with Enhanced View Synthesis for FTV
AuthorLu Yang, Meindert Onno Wildeboer, Tomohiro Yendo, Mehrdad Panahpour Tehrani (Nagoya University, Japan), Toshiaki Fujii (Tokyo Institute of Technology, Japan), Masayuki Tanimoto (Nagoya University, Japan)
Pagepp. 5 - 8
KeywordFree-viewpoint TV (FTV), video compression, bitrates, view synthesis, MVC
AbstractWe deal with the bitrates of view synthesis at the decoder side of FTV that would use compressed depth maps and views. The focus is to reduce bitrates required for generating the high-quality virtual view. We employ a reliable view synthesis method which is compared with standard MPEG view synthesis software. The experimental results show that the bitrates required for synthesizing high-quality virtual view could be reduced by utilizing our enhanced view synthesis technique to improve the PSNR at medium bitrates.

O1-3 (Time: 10:45 - 11:15)
TitleDepth Map Processing with Iterative Joint Multilateral Filtering
AuthorPoLin Lai (Samsung Telecommunications America, U.S.A.), Dong Tian (Mitsubishi Electric Research Laboratories, U.S.A.), Patrick Lopez (Technicolor, Research and Innovation, France)
Pagepp. 9 - 12
Keyword3D video, depth maps, joint filtering, iterative filtering, view synthesis
AbstractDepth maps estimated using stereo matching between frames from different video views typically exhibit false contours and noisy artifacts around object boundaries. In this paper, iterative joint multilateral filtering is proposed to deal with these artifacts. The proposed filter consists of multiple filter kernels. Knowing that the estimated depth maps are erroneous, besides the kernels which measure the proximity of depth samples and the similarity between depth sample values, we further develop kernels which measure similarity between the corresponding video pixel values. To increase reliability, these novel kernels operate on the color (RGB) domain instead of only on the luminance domain. Furthermore, the filter shapes are designed to adapt brightness variations. Finally, to tackle large misalignment between boundaries in depth maps and in the corresponding video frames, iterative approach is utilized. Our results demonstrate that the proposed method can significantly improve the boundaries in depth maps and can reduce false contours. With the processed depth maps, it is observed that the quality of object boundaries in synthesized views can be improved.

O1-4 (Time: 11:15 - 11:45)
TitleStereoscopic Depth Estimation Using Fuzzy Segment Matching
AuthorKrzysztof Wegner, Olgierd Stankiewicz, Marek Domański (Poznan University of Technology, Poland)
Pagepp. 13 - 16
KeywordStereo matching, depth estimation, soft segmentation, disparity calculation, fuzzy set
AbstractStereo matching techniques usually match segments or blocks of pixels. This paper proposes to match segments defined as fuzzy sets of pixels. The proposed matching method is applicable to various techniques of stereo matching as well as to different measures of differences between pixels. In the paper, embedment of this approach into the state-of-the-art depth estimation software is described. Obtained experimental results show that the proposed way of stereo matching increases reliability of various depth estimation techniques.