北京航空航天大学学报 ›› 2022, Vol. 48 ›› Issue (4): 578-585.doi: 10.13700/j.bh.1001-5965.2020.0631

• 论文 • 上一篇    下一篇

颅缝早闭手术中颅骨切割方案生成方法

罗杨宇1, 贺佳宾1, 谢东升1, 陆珅宇1, 宫剑2   

  1. 1. 中国科学院自动化研究所, 北京 100190;
    2. 首都医科大学附属北京天坛医院, 北京 100070
  • 收稿日期:2020-11-12 发布日期:2022-04-27
  • 通讯作者: 罗杨宇 E-mail:yangyu.luo@ia.ac.cn
  • 基金资助:
    国家重点研发计划(2017YFE0121200)

Skull cutting plan generation method in craniosynostosis surgery

LUO Yangyu1, HE Jiabin1, XIE Dongsheng1, LU Shenyu1, GONG Jian2   

  1. 1. Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China;
    2. Beijing Tiantan Hospital, Capital Medical University, Beijing 100070, China
  • Received:2020-11-12 Published:2022-04-27

摘要: 为实现颅缝早闭手术方案制定的规范化,提出一种结合深度学习、立体视觉和点云处理技术的颅骨切割轨迹生成方法,用于建立切割方案模板库和生成新的病例切割方案。该方法将深度学习应用于颅骨外表面的实例分割中,利用Mask R-CNN对手术区域进行检测和分割,利用简化轮廓提取算法提取切割轨迹,并结合点云处理技术将切割轨迹坐标进行2D-3D映射,实现切割轨迹自动化提取;在此基础上建立典型病例模板库,通过模板匹配方法自动生成新病例的切割方案。实验证明:该轨迹提取方法可以准确高效地检测出颅骨切割轨迹,并将轨迹坐标进行3D映射,点云深度测量误差小于3 mm,达到临床可用标准;模板匹配方法也有效生成新病例的切割轨迹,符合资深医生的手术方案。

关键词: 颅缝早闭, 轨迹提取, 深度学习, 深度相机, 点云处理

Abstract: To standardize the plan generation of craniosynostosis surgery, we propose a skull cutting trajectory generation method which combines deep learning, stereo vision and point cloud processing technology to establish cutting plan template library and generate cutting trajectory for new cases. The proposed method,for the first time,uses the deep learning to segment the external surface of skull. First, it takes the advantage of Mask R-CNN to detect and segment the surgical cutting area. Then, a simplified contour extraction algorithm is explored to extract the surgical cutting trajectory. After that,the point cloud processing technology is used to map the surgical cutting trajectory to three-dimensional coordinates and realize the automatic extraction of cutting trajectory. Finally,a template library with typical cases is established and the cutting plans of new cases are automatically generated by template matching method. The experiment shows that the proposed trajectory extraction method can detect the skull surgical cutting trajectory accurately and efficiently and conduct three-dimensional mapping of trajectory coordinate.The depth measurement error of point cloud is less than 3 mm, which meets the clinical available standard. Using the template matching method,the new case's cutting trajectory can be generated effectively, which conforms to surgical plan of senior doctors.

Key words: craniosynostosis, trajectory extraction, deep learning, depth camera, point cloud processing

中图分类号: 


版权所有 © 《北京航空航天大学学报》编辑部
通讯地址:北京市海淀区学院路37号 北京航空航天大学学报编辑部 邮编:100191 E-mail:jbuaa@buaa.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发