Augmented reality interface for laparoscopic skills training

<body topmargin=0 leftmargin=0 marginheight=0 marginwidth=0> <table cellpadding=0 cellspacing=0 border=0><tr> <td valign="top" rowspan="2" width=200 BGCOLOR="#FFFFFF" TEXT="#080000"> <div> <B><IMG SRC="21b525c0.jpg" border=0 width="82" height="92" ALIGN="BOTTOM" HSPACE="0" VSPACE="0"></B></div> <div> <A HREF="index.htm" TARGET="_top" TITLE="The worldleading ProMIS Surgical Simulat"><B>Home</B></A></div> <div> <A HREF="promis.htm" TARGET="_top" TITLE="ProMIS surgical simulator"><B>ProMIS Basic Skills</B></A></div> <div> <A HREF="id64.htm" TARGET="_top" TITLE="SAGES/ACS FLS in ProMIS"><B>ProMIS and FLS</B></A></div> <div> <A HREF="promis.htm" TARGET="_top" TITLE="ProMIS surgical simulator"><B>ProMIS Procedures</B></A></div> <div> <A HREF="id59.htm" TARGET="_top" TITLE="ProMIS Laparoscopic Colectomy"><B>ProMIS LapColectomy</B></A></div> <div> <A HREF="id77.htm" TARGET="_top" TITLE="Create Modules and Tasks"><B>NEW! Design&Edit Tasks</B></A></div> <div> <A HREF="id25.htm" TARGET="_top" TITLE="ProMIS Validation"><B>ProMIS Validation</B></A></div> <div> <A HREF="id62.htm" TARGET="_top" TITLE="ProMISJ: a junior ProMIS"><B>ProMIS-J</B></A></div> <div> <A HREF="id52.htm" TARGET="_top" TITLE="ProMIS for industry: custom simulation s"><B>ProMIS for industry</B></A></div> <div> <A HREF="id44.htm" TARGET="_top" TITLE="ProMIS Technology"><B>ProMIS Technology</B></A></div> <div> <A HREF="id61.htm" TARGET="_top" TITLE="Downloads"><B>DOWNLOADS</B></A></div> <div> <A HREF="id56.htm" TARGET="_top" TITLE="Links"><B>Links</B></A></div> <bR> </td> <td valign="top" colspan=2 height=85 style=" border-bottom: 1px solid #CCCCCC;" BGCOLOR="#FFFFFF" TEXT="#080000"> <bR> <bR> <div> <A HREF="index.htm" TARGET="_top" TITLE="The worldleading ProMIS Surgical Simulat"><B>Home</B></A><B>   </B><A HREF="promis.htm" TARGET="_top" TITLE="ProMIS surgical simulator"><B>ProMIS™</B></A><B>  </B><A HREF="id55.htm" TARGET="_top" TITLE="About simulation"><B>About simulation</B></A><B>  </B><A HREF="id49.htm" TARGET="_top" TITLE="About Haptica"><B>About Haptica</B></A><B>   </B><A HREF="id51.htm" TARGET="_top" TITLE="Contact us"><B>Contact us</B></A><B>   </B><A HREF="http://www.promis.org" TARGET="_top" TITLE="http://www.promis.org"><B>Support</B></A></div> <bR> <div> </div> </td> </tr><tr> <td valign="top" height=395 width="100%" colspan=2 BGCOLOR="#FFFFFF" TEXT="#080000"> <div> <B>Augmented reality interface for laparoscopic skills training</B></div> <div> Gerard Lacey, Derek Young, Derek Cassidy, Fiona Slevin, Donncha Ryan </div> <div> Haptica Ltd, Dublin, Ireland.</div> <div> <B>Purpose</B></div> <div> The surgical community have developed a range of simple but effective training scenarios for laparoscopic surgical skills.  These "box trainers" allow surgeons to practice surgically relevant tasks safely.  The skills taught in box trainers have been shown to transfer to live operative performance [1] and the surgeon's hand movements have been shown to correlate well with surgical skill [2].  This abstract describes ProMIS™ an Augmented Reality (AR) training system that improves box trainer tasks by adding both objective assessment and interactive graphics to the training tasks.  </div> <div> <B>Method</B></div> <div> One method of providing objective assessment of surgical skill is to capture and analyse the movement patterns of the surgeon's instruments while completing a standardised task.  This tests both the surgeons dexterity and their familiarity with the instruments and by analysing the movement patterns the efficiency of motion can be determined.</div> <div> ProMIS™ achieves objective surgical skills assessment by capturing the 3D movement of commercial laparoscopic instruments while completing a standardised task.  The surgeon's view of training tasks is provided by a digital camera mounted within the bodyform. The position information is gathered using cameras thus a reliable and accurate non-contact measurement system is achieved.</div> <div> The main performance metrics are time taken, total path length swept by each instrument tip and the smoothness(efficiency) of the surgeons movement.  Additionally task specific metrics are calculated to measure performance associated with different regions on and above the task plate.  This is achieved because ProMIS has an accurate 3D model of the standard task and regions in space.  A software tool called ProMIS LessonMaker allows a non-technical user to create these regions and their associated metrics as part of creating customised instructional materials.</div> <div> <B>Augmented Reality in Training Tasks</B></div> <div> In addition to the capability to provide measurement ProMIS Lesson Maker uses advanced multi-media technology to allow the creation of Augmented Reality training materials.  This is the combination of 3D interactive graphics with live video.  This technology is normally associated with movie industry or fighter pilot displays  is used to add additional instruction, interactive psychomotor challenges or proximal feedback on errors  during the completion of a “standard box trainer task”</div> <bR> <div> <IMG SRC="19c4f630.png" border=0 width="335" height="99" ALIGN="BOTTOM" HSPACE="0" VSPACE="0"></div> <div> Figure 1 Superimposed graphics interacting with instruments during live video trainer task.</div> <bR> <div> <B>Results</B></div> <div> The construct validity of the ProMIS™ system has been demonstrated in 3 studies in Emory, Imperial College, London, UK and AMNCH, Dublin, Ireland [3, 4].   Interactive augmented reality content has been merged with the live video to improve the training content and efficacy.  A number centres are conducting so called “VR-OR” studies to validate the transfer of skills developed in ProMIS transfer to the OR.</div> <div> <B>Conclusions</B></div> <div> In the ProMIS™ system Augmented Reality has been shown to provide a clinically validated, flexible and engaging platform for training and objectively assessing the skills of laparoscopic surgery.  Because the system uses non contact sensing, real surgical instruments and runs on a standard PC it is a very robust and cost effective method of surgical training.</div> <div> <B>References</B></div> <div> [1] Datta, V. Bann, S. Beard, J. Mandalia, M. Darzi, A.  Comparison of bench test evaluations of surgical skill with live operating performance assessments.   J Am Coll Surg 2004 volume 199  issue 4  pp. 603-6  </div> <div> [2] Smith SG, Torkington J, Brown TJ, Taffinder NJ, Darzi A. Motion Analysis, Surg Endosc. 2002 Apr;16(4):640-5 </div> <div> [3] D.A.M. McClusky K. Van Sickle, A.G. Gallagher Relationship Between Motion Analysis, Time, Accuracy, and Errors During Performance of a Laparoscopic Suturing Task on an Augmented Reality Simulator EAES 2004 </div> <div> [4] D. Broe, P.F. Ridgway, S. Johnson, C. Tierney, K.C. Conlon, Validation of a Novel Hybrid Surgical Simulator, EAES 2004 </div> <bR> <bR> </td> </tr></table></body>