Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video

NSSC OpenIR > 空间技术部

	Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video
	Liu, Yang; Peng, Xiaodong; Zhou, Wugen; Liu, Bo; Gerndt, Andreas; Liu, Yang (liuyang213@mails.ucas.ac.cn)
作者部门	空间技术部
发表期刊	3D Research
	2018
卷号	9 期号:2
语种	英语
摘要	In this paper, we propose a template-based 3D surface reconstruction system of non-rigid deformable objects from monocular video sequence. Firstly, we generate a semi-dense template of the target object with structure from motion method using a subsequence video. This video can be captured by rigid moving camera orienting the static target object or by a static camera observing the rigid moving target object. Then, with the reference template mesh as input and based on the framework of classical template-based methods, we solve an energy minimization problem to get the correspondence between the template and every frame to get the time-varying mesh to present the deformation of objects. The energy terms combine photometric cost, temporal and spatial smoothness cost as well as as-rigid-as-possible cost which can enable elastic deformation. In this paper, an easy and controllable solution to generate the semi-dense template for complex objects is presented. Besides, we use an effective iterative Schur based linear solver for the energy minimization problem. The experimental evaluation presents qualitative deformation objects reconstruction results with real sequences. Compare against the results with other templates as input, the reconstructions based on our template have more accurate and detailed results for certain regions. The experimental results show that the linear solver we used performs better efficiency compared to traditional conjugate gradient based solver. © 2018, 3D Research Center, Kwangwoon University and Springer-Verlag GmbH Germany, part of Springer Nature.
收录类别	EI
文献类型	期刊论文
条目标识符	http://ir.nssc.ac.cn/handle/122/6336
专题	空间技术部
通讯作者	Liu, Yang (liuyang213@mails.ucas.ac.cn)
推荐引用方式 GB/T 7714	Liu, Yang,Peng, Xiaodong,Zhou, Wugen,et al. Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video[J]. 3D Research,2018,9(2).
APA	Liu, Yang,Peng, Xiaodong,Zhou, Wugen,Liu, Bo,Gerndt, Andreas,&Liu, Yang .(2018).Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video.3D Research,9(2).
MLA	Liu, Yang,et al."Template-Based 3D Reconstruction of Non-rigid Deformable Object from Monocular Video".3D Research 9.2(2018).