Citation: | ZHAI Min, LIU Huaping, ZHANG Tianyu, et al. Space non-cooperative target 3D reconstruction and interaction based on smartphone APP[J]. Journal of Beijing University of Aeronautics and Astronautics, 2018, 44(12): 2637-2643. doi: 10.13700/j.bh.1001-5965.2018.0356(in Chinese) |
In this paper, a software system is designed and implemented, which uses space-based observation sequence to reconstruct the 3D non-cooperative target based on the thought of software defined satellites. Considering the interaction between the satellite and the ground users, the system consists of two parts:software on the satellite cloud node and an APP on the ground users. In this system, normal users can watch the 3D structure of the space targets in real time and improve their knowledge of the space. For researchers, the 3D reconstruction of non-cooperative targets is the basis for further research such as capturing and providing on-orbit services. In order to meet the further requirements of non-cooperative target orbit and pose determination, the system provides the position information of matching feature points generated in 3D reconstruction and the vector information between non-cooperative target and camera ontology. In order to solve the problem of sparse point clouds and poor visualization in 3D reconstruction using structure from motion(SFM), Poisson surface distribution reconstruction is carried out on the basis of sparse point cloud reconstruction using SFM to obtain dense and uniform grid surface. Owing to the lack of the non-cooperative space target imaging data, the ground imaging simulation is carried out to verify the algorithm. The results show that this method can be used to reconstruct the 3D non-cooperative target and the reconstruction is accurate. Meanwhile, the recovery 3D point cloud can be used to determine the orbit and attitude of the non-cooperative space target.
[1] |
NISTÉR D.An efficient solution to the five-point relative pose problem[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(6):756-771. doi: 10.1109/TPAMI.2004.17
|
[2] |
NISTÉR D.Calibration with robust use of cheirality by quasi-affine reconstruction of the set of camera projection centres[C]//8th IEEE International Conference on Computer Vision(ICCV2001).Piscataway, NJ: IEEE Press, 2001: 116-123. https://www.researchgate.net/publication/3906146_Calibration_with_robust_use_of_cheirality_by_quasi-affinereconstruction_of_the_set_of_camera_projection_centres
|
[3] |
NISTÉR D.Frame decimation for structure and motion[C]//2nd European Workshop on 3D Structure from Multiple Images of Large-Scale Environments.Berlin: Springer, 2000: 17-34. doi: 10.1007%2F3-540-45296-6_2
|
[4] |
TRIGGS B, MCLAUNCHLAN P F, HARTLEY R I, et al.Bundle adjustment-A modern synthesis[C]//International Workshop on Vision Algorithms.Berlin: Springer, 1999: 298-372. doi: 10.1007/3-540-44480-7_21
|
[5] |
LOURAKIS M I, ARGYROS A A.SBA:A software package for generic sparse bundle adjustment[J].ACM Transactions on Mathematical Software(TOMS), 2009, 36(1):1-30. http://d.old.wanfangdata.com.cn/Periodical/wjclxb200304024
|
[6] |
FURUKAWA Y, PONCE J.Accurate, dense, and robust multi-view stereopsis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376. doi: 10.1109/TPAMI.2009.161
|
[7] |
唐永鹤.基于序列图像的空间非合作目标三维重建关键技术研究[D].长沙: 国防科学技术大学, 2012: 13-36. http://cdmd.cnki.com.cn/Article/CDMD-90002-1014047858.htm
TANG Y H.Researches on 3D reconstruction technologies for non-cooperative space targets using image sequences[D].Changsha: National University of Defense Technology, 2012: 13-36(in Chinese). http://cdmd.cnki.com.cn/Article/CDMD-90002-1014047858.htm
|
[8] |
张浩鹏, 魏全茂, 张威, 等.基于序列图像的空间目标三维重建[J].北京航空航天大学学报, 2016, 42(2):273-279. http://bhxb.buaa.edu.cn/CN/abstract/abstract13775.shtml
ZHANG H P, WEI Q M, ZHANG W, et al.Sequential-image-based space object 3D reconstruction[J].Journal of Beijing University of Aeronautics and Astronautics, 2016, 42(2):273-279(in Chinese). http://bhxb.buaa.edu.cn/CN/abstract/abstract13775.shtml
|
[9] |
何豫航, 岳俊.基于CMVS/PMVS多视角密集匹配方法的研究与实现[J].测绘地理信息, 2013, 38(3):20-23. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=chxxygc201303006
HE Y H, YUE J.Research and implementation based on multi-view dense matching by applying CMVS/PMVS[J].Journal of Geomatics, 2013, 38(3):20-23(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=chxxygc201303006
|
[10] |
曾蔚, 王汇源, 刘莹奇, 等.基于IR-SFS算法空间目标红外影像3D重建[J].中国光学, 2014, 7(3):376-388. http://d.old.wanfangdata.com.cn/Periodical/zggxyyygxwz201403003
ZENG W, WANG H Y, LIU Y Q, et al.3D reconstruction of space target IR image based on IR-SFS algorithm[J].Chinese Optics, 2014, 7(3):376-388(in Chinese). http://d.old.wanfangdata.com.cn/Periodical/zggxyyygxwz201403003
|
[11] |
曹彩秀.非合作航天器位姿在轨测量方法的研究[D].北京: 北京邮电大学, 2015: 25-34. http://cdmd.cnki.com.cn/Article/CDMD-10013-1015585845.htm
CAO C X.Pose on-orbit measurement of non-cooperative spacescraft[D].Beijing: Beijing University of Posts and Telecommunications, 2015: 25-34(in Chinese). http://cdmd.cnki.com.cn/Article/CDMD-10013-1015585845.htm
|
[12] |
郑恩, 成耀天, 林靖宇.采用去抖动模糊算法的稠密三维重建[J].计算机工程与应用, 2018, 54(1):217-223. http://d.old.wanfangdata.com.cn/Periodical/jsjgcyyy201801034
ZHENG E, CHENG Y T, LIN J Y.Dense 3D reconstruction based on removing camera-shake fuzzy algorithm[J].Computer Engineering and Applications, 2018, 54(1):217-223(in Chinese). http://d.old.wanfangdata.com.cn/Periodical/jsjgcyyy201801034
|
[13] |
VALENTIN J P C, SENGUPTA S, WARRELL J, et al.Mesh based semantic modelling for indoor and outdoor scenes[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway, NJ: IEEE Press, 2013: 2067-2074. https://www.researchgate.net/publication/261129160_Mesh_Based_Semantic_Modelling_for_Indoor_and_Outdoor_Scenes
|
[14] |
LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision, 2004, 60(2):91-110. doi: 10.1023/B:VISI.0000029664.99615.94
|
[15] |
FORSYTH D.Computer vision:A modern approach[J].Prentice Hall Professional Technical Reference, 2002, 14(1):294-299. http://d.old.wanfangdata.com.cn/Periodical/ranj201402073
|
[16] |
BOLITHO M, KAZHDAN M M, BURNS R C, et al.Parallel Poisson surface reconstruction[C]//International Symposium on Visual Computing.Berlin: Springer, 2009: 678-689. doi: 10.1007%2F978-3-642-10331-5_63
|