Abstract

A virtual training system has been developed to train novice surgeons on using the new jig and fixture in a knee replacement surgery. In this study, we described how a virtual hand was employed in a Virtual Knee Replacement Surgery Training System. The virtual hand is equipped with HOMER-G, a selection and manipulation technique that combines the Arm-extension and Ray-casting technique for easy selection and manipulation of virtual object with the virtual grasping capability during selection task. The virtual jig and fixture are selected using Ray-casting technique and the arm extension technique of HOMER-G will help to manipulate the object. The virtual hand’s movement is controlled by a data glove and Flock of Birds tracking device. HOMER-G has the grasping capability that makes the manipulation of object looks more natural.

Keywords:

3D interaction, 3D user interface, selection and manipulation technique, spatial interaction technique, virtual hand, virtual training,

References

1. Awang, R., 2009. Designing and prototype production of UKM TKR cutting jig for computer assisted surgery in total knee arthroplasty. M.A. Thesis, Faculty of Medicine, Universiti Kebangsaan Malaysia.
   
2. Bin, W. and D. Shuling, 2009. Dataglove calibration with constructed grasping gesture database. Proceeding of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems (VECIMS '09). May 11-13, pp: 6-11.
   
3. Bowman, D.A., 1996. Conceptual Design Space: Beyond Walk through to Immersive Design. In: Bertol, D. (Eds.), Designing Digital Space. John Wiley & Sons, New York, pp: 225-236.
   
4. Bowman, D.A. and L.F. Hodges, 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. Proceeding of the Symposium on Interactive 3D Graphics. ACM. Providence, Rhode Island, United States, pp: 25-38.
   CrossRef    
5. Choi, K.S., S. Soo and F.L. Chung, 2009. A virtual training simulator for learning cataract surgery with phacoemulsification. Comput. Biol. Med., 39(11): 1020-1031.
   CrossRef    PMid:19720372    
6. Forsberg, A., K. Herndon amd R. Zeleznik, 1996. Aperture based selection for immersive virtual environments. Proceeding of the 9th Annual ACM Symposium on User Interface Software and Technology, pp: 95-96.
   CrossRef    
7. Gallagher, A., E.M. Ritter, H. Champion, G. Higgins, M.P. Fried, G. Moses, C.D. Smith and R.M. Satava, 2005. Virtual reality simulation for the operating room: Proficiency-based training as a paradigm shift in surgical skill training. Ann. Surg., 241(2): 364-372.
   CrossRef    PMid:15650649 PMCid:PMC1356924    
8. Gibson, S., J. Samosky, A. Mor, C. Fyock, E. Grimson, T. Kanade, R. Kikinis, H. Lauer, N. McKenxie, S. Nakajima, H. Ohkami, R. Osborne and A. Sawada, 1997. Simulating Arthroscopic Knee Surgery using Volumetric Object Representations, Real-time Volume Rendering and Haptic Feedback. In: Troccaz, J., R. Mosges and E. Grimson, (Eds.), Proc. First Jiont Conf. CVRMed-MRCAS1997. LNCS, 1205: 367-378.
   
9. Jacoby, R.H., M. Ferneau and J. Humphries, 1994. Gestural interaction in a virtual environment. In: Fisher, S.S., J.O. Merritt and M.T. Bolas (Eds.), Society of Photo-optical Instrumentation Engineers (SPIE) Conference Series, Vol. 2177 of Presented at the Society of Photo-optical Instrumentation Engineers (SPIE) Conference, April. 15, pp: 355-364.
   
10. Kapit, W. and E. Lawrence, 1997. The Anatomy Coloring Book. 2nd End., Benjamin Cummings, USA.
    
11. Kavakli, M. and D. Jayarathna, 2005. Virtual hand: An interface for interactive sketching in virtual reality. Proceeding of the International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce, Nov. 28-23, pp: 28-30.
    
12. Lam, M.C. and H. Arshad, 2011. Virtual hand modeling and simulation based on unity 3d. Int. Rev. Comput. Software, 6(6): 1044-1049.
    
13. Liang, J. and M. Green, 1996. Jdcad: A highly interactive 3d modeling system. Comput. Graphics, 18(4): 499-506.
    CrossRef    
14. McCarthy, A.D. and R.J. Hollands, 1998. A commercially viable virtual reality knee arthroscopy training system. Stud. Health Technol. Inform., 50: 302-8.
    PMid:10180558    
15. Mine, M., 1995. Virtual environment interaction techniques. University of North Carolina at Chapel Hill CS Dept.
    
16. Pan, Y., H. Hanwu, L. Jinfang and Z. Dali, 2007. Data-glove based interactive training system for virtual delivery operation. Proceeding of the 2nd Workshop on Digital Media and its Application in Museum and Heritages, Dec. 10-12, pp: 10-12.
    
17. Peng Ann, H., 2007. Imaging Technologies for Orthopaedic Visualization and Simulation. In: Qin, L., H. Genant, J. Griffith and K. Leung (Eds.), Advanced Bioimaging Technologies in Assessment of the Quality of Bone and Scaffold Materials. Springer, Berlin, Heidelberg, pp: 51-64.
    
18. Pheng-Ann, H., C. Chun-Yiu, W. Tien-Tsin, X. Yang-Sheng, C. Yim-Pan, C. Kai-Ming and T. Shiu-Kit, 2004. A virtual-reality training system for knee antroscopic surgery. IEEE T. Inf. Technol. B., 8(2): 217-227.
    CrossRef    
19. Pohlenz, P., A. Gröbe, A. Petersik, N. Von Sternberg, B. Pflesser, A. Pommert, K.H. Höhne, U. Tiede, I. Springer and M. Heiland, 2010. Virtual dental surgery as a new educational tool in dental school. J. Cranio-Maxillofacial Surg., 38(8): 560-564.
    CrossRef    PMid:20303282    
20. Posneck, A., E. Nowatius, C. Trantakis, H. Cakmak, H. Maass, U. Kuhnapfel, A. Dietx and G. Straus, 2005. A virtual training system in endoscopic sinus surgery. Int. Congr. Ser., 1281(0): 527-530.
    CrossRef    
21. Pouliquen, M., B. Alain, M. Jacques and C. Laurent, 2007. Virtual hands and virtual reality multimodal platform to design safer industrial systems. Comput. Ind., 58(1): 46-56.
    CrossRef    
22. Poupyrev, I., M. Billinghurst, S. Weghorst and T. Ichikawa, 1996. The Go-Go interaction technique: Non-linear mapping for direct manipulation in Vr. Proceeding of the 9th Annual ACM Symposium on User Interface Software and Technology, pp: 79-80.
    CrossRef    
23. Ramli, I.S., H. Arshad, N.H.M. Yahaya and A.B. Sulong, 2010. Development of visualization application (Vjbk) for newly designed jig and fixture for computer-assisted knee replacement surgery. Proceeding of the 14th International Business Information Management Conference (IBIMA), pp:882-890.
    
24. Rudman, D.T., D. Stredney, D. Sessanna, R. Yagel, R. Crawfis, D. Heskamp, C.V. Edmond Jr and G.J. Wiet, 1998. Functional endoscopic sinus surgery training simulator. Laryngo-scope, 108(11): 1643-1647.
    CrossRef    PMid:9818819    
25. Sabri, H., B. Cowan, B. Kapralos, M. Porte, D. Backstein and A. Dubrowskie, 2010. Serious games for knee replacement surgery procedure education and training. Proc. Soc. Behav. Sci., 2(2): 3483-3488.
    CrossRef    
26. Sankar, J., U. Jayaram, Y. Wang, H. Tirumali, K. Lyons and P. Hart, 1999. Vade: A virtual assembly design environment. IEEE Comput. Graph., 19(6): 44-50.
    CrossRef    
27. Slack, R. and G. Bates, 1998. Functional endoscopic sinus surgery. Am. Fam. Phys., 58(3): 707-718.
    
28. Sourina, O., A. Sourin and H.T. Sen, 2000. Virtual orthopedic surgery training on personal computer. Int. J. Inform. Technol., 6(1): 16-29.
    
29. Wan, H.G., F.F. Chen and X.X. Han, 2009. A 4-layer flexible virtual hand model for haptic interaction. Proceeding of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems (VECIMS '09), May. 11-13, pp: 185-190.
    CrossRef    
30. Wan, H., L. Yang, G. Shuming and P. Qunsheng, 2004. Realistic virtual hand modeling with applications for virtual grasping. Proceeding of the ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry, pp: 81-87.
    CrossRef    
31. Weghorst, S., C. Airola, P. Oppenheimer, C.V. Edmond, T. Patience, D. Heskamp and J. Miller, 1998. Validation of the madigan ESS simulator. Stud. Health Technol., 50: 399-405.
    
32. Xie, Y., H. Pheng Ann, J. Zhang, P. Liu, T. Zhu and J. Li, 2011. A simulation system for training telerobotic spine surgery. Proceeding of the International Conference on Electric Information and Control Engineering (ICEICE), April 15-17, pp: 102-105.
    

Competing interests

The authors have no competing interests.

Open Access Policy

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Copyright

The authors have no competing interests.