Abstract
Background: Aiming at free-view exploration of complicated scenes, this paper presents a method for interpolating views among multi RGB cameras. Methods: In this study, we combine the idea of cost volume, which represent 3D information, and 2D semantic segmentation of the scene, to accomplish view synthesis of complicated scenes. We use the idea of cost volume to estimate the depth and confidence map of the scene, and use a multi-layer representation and resolution of the data to optimize the view synthesis of the main object. Results: /Conclusions By applying different treatment methods on different layers of the volume, we can handle complicated scenes containing multiple persons and plentiful occlusions. We also propose the view-interpolation→multi-view reconstruction→view interpolation pipeline to iteratively optimize the result. We test our method on varying data of multi-view scenes and generate decent results.
Original language | English (US) |
---|---|
Pages (from-to) | 43-55 |
Number of pages | 13 |
Journal | Virtual Reality and Intelligent Hardware |
Volume | 2 |
Issue number | 1 |
DOIs | |
State | Published - Feb 2020 |
Externally published | Yes |
Keywords
- Cost volume
- Iterative optimization
- Multi-layer processing
- Multi-view reconstruction
- View interpolation
ASJC Scopus subject areas
- Computer Graphics and Computer-Aided Design
- Computer Science Applications
- Human-Computer Interaction