基于生物仿真材料与增强现实技术的腔镜手术学习环境建设研究

Minimally invasive surgery(MIS) like thoracoscopic surgery and laparoscopic surgery has been accepted worldwide as the main treatment approach for many various pathologies. It is necessary skill that a surgeon must master. To prevent unnecessary errors and adverse results of MIS, proper training is of paramount importance. Apprenticeship training based on patient, which increases the surgical risk and causes ethical issue, has been gradually replaced by simulation based training. However simulators used lack realistic haptic feedback and objective assessment of performance, which need to be improved. We plan to design synthetic human tissue and augmented reality based thoracoscopic simulators. The simulators will be a mannequin combines the virtual and real worlds in the same system, allows users to practice highly realistic basic surgical skills with real thoracoscopic instruments on physical and virtual. Our research works will focus on following aspects. 1. Developing new synthetic human tissue and body parts to create a high fidelity model that mimic the appearance, structure, density, conductivity, hardness and other aspects of the live tissue. It will provide more realistic haptic feedbacks for surgical practice. 2. Combining the virtual reality (VR) thoracic cavity setting and physical module in the same system, allows the users have a more realistic virtual. 3. Developing space location technology to capture performance parameters, like position, direction and velocity of the left instrument, store user information and compare users performance with specialist’s performance and give a feedback. This AR Simulator will improve the training effects and replace the VR simulators. Also our works will provide experiences for developing other simulator for clinical skills training.

腔镜手术是近年外科学重要技术进步，是外科医生需要掌握的核心技能，但国内外缺少安全有效的培训方法，限制了此技术推广。基于患者的师徒式训练，医疗风险大，违背医学伦理，渐被基于模拟仿真的训练模式替代，但后者仿真度较低，有待改进。本研究拟建立基于生物仿真材料与增强现实技术的腔镜手术学习环境。主要研究内容：1、仿据人体各种组织特点（如韧弹性、抗撕裂、弱电磁性等），开展生物仿真材料研究，制作物理模型，使外观、触觉及内部结构更加逼真；2、采集术中影像，构建虚拟图像，开展虚拟信息实时跟踪及注册技术研究，将其融合为术野背景图像，增强视觉真实感；3、采用空间定位技术和多传感器信息融合技术相结合，测量操作动作，建立数学模型，开展标准操作评价和分析体系研究，实时比对用户与专家操作，实现评价反馈。本研究将改进现有腔镜模拟训练环境，提高培训效果，推进基于生物仿真材料与增强现实技术的腔镜手术学习环境建设研究

本项目重点研究在于建立基于生物仿真材料与增强现实技术的腔镜手术学习环境。研究内容包括：1、仿据人体肺组织的特点（ 如韧弹性、导电性等），开展生物仿真材料研究，制作肺脏物理模型，使外观、触觉及内部结构更加逼真；2、采集术中影像，构建虚拟图像，开展虚拟信息实时跟踪及注册技术研究，将其融合为术野背景图像，增强视觉真实感；3、采用空间定位技术和多传感器信息融合技术相结合，测量操作动作，建立数学模型，开展标准操作评价和分析体系研究，实时比对用户与专家操作，实现评价反馈。本研究将改进现有腔镜模拟训练环境，搭建一个高逼真、高效率的胸腔镜肺切除手术模拟训练平台，解决既往模拟训练器难以实现“身临其境”的不足，提高培训效果。该研究对于国内胸腔镜培训体系的构建具有重要的理论意义和研究价值。