Virtual view synthesis based on triangular re-projection
-
摘要: 相比较传统的视角插值合成方法只能在基线上合成虚拟图像,提出的一种基于三角形重投影的虚拟视角合成方法,可以在已知少数几个匹配点的情况下,将场景内容自动迭代划分为一致和非一致三角形区域,通过不同策略的三角形重投影实现更加自由的视点的虚拟图像合成.划分过程中引入直线段约束可以解决直线纹理在三角形接缝处的畸变问题,保证最后的合成图像中场景表示在此处的连续性.利用设计的可信度函数,沿一定搜索路径可找到更多的新匹配点,从而带来更多的一致三角形区域.将此方法应用到虚拟彩色图像的合成,实验结果证明了此方法可以在更大视点范围内合成逼近于真实图的虚拟图像.Abstract: Traditional view interpolation can only synthesize the novel view along the base line. The proposed method based on triangular re-projection can iteratively divide the scene into consistent and inconsistent triangles given a few of initial matches, and implement free-viewpoint view synthesis by re-projecting these two groups of triangles in different strategies. The straight line constraint was introduced to direct the division along the line in order to reduce the discontinuity nearby the common side of two adjacent triangles. The new matching points were confirmed by the designed evaluation function in a special searching order. They were detected in the inconsistent regions for further division to produce more and more consistent regions. The color-image experiment proves that this method is effective to synthesize a photo-realistic image under wider changes in viewpoint.
-
Key words:
- virtual view synthesis /
- triangular re-projection /
- straight line /
- matching points
-
[1] Ince S,Konrad J.Occlusion-aware view interpolation[J].EURASIP Journal on Image and Video Processing (Special Issue on 3D Image and Video Processing),2008,Article ID 803231,1-15 [2] Rogmans S,Lu Jiangbo.Real-time stereo-based view synthesis algorithms:a unified framework and evaluation on commodity GPUs[J].Signal processing:Image Communicati-on,2009,24(1-2):49-64 [3] Seitz S M,Dyer C R.Physically-valid view synthesis by image interpolation. Proc Workshop on Representations of Visual Scenes,081867122X,1995 [4] Shi Feng,Laganiere R,Dubois E.On the use of ray-tracing for viewpoint interpolation in panoramic imagery //Ferrie F.2009 Canadian Conference on Computer and Robot Vision.Washington DC:IEEE Computer Society,2009:200-207 [5] Siu A M K,Lau R W H.Image registration for image-based rendering[J].IEEE Transactions on Image Processing,2005,14(2):241-251 [6] Ukita N,Kawata S,Ukita M K.IBR-based free-viewpoint imaging of a complex scene using few cameras //Borgefors G,Flynn P.International Conference on Pattern Recognition.Washington DC:IEEE Computer Society,2008:1-4 [7] Faugeras O,Luc R.What can two images tell us about a third one [J].International Journal of Computer Vision,1996,18(1):5-19 [8] Schmid C,Zisserman A.The geometry and matching of lines and curves over multiple views [J].International Journal of Computer Vision,2000,40(3):199-233 [9] McMillan L.A list-priority rendering algorithm for redisplaying projected surfaces. UNC-Chapel Hill Computer Science Technical Report,95-005,1995 -
点击查看大图
计量
- 文章访问数: 2529
- HTML全文浏览量: 152
- PDF下载量: 746
- 被引次数: 0
下载:
