Easy-to-Use Augmented Reality Neuronavigation Using a Wireless Tablet PCDeng W.a, b · Li F.a, b · Wang M.a, b · Song Z.a, b
aDigital Medical Research Center, Shanghai Medical School, Fudan University, and bShanghai Key Laboratory of Medical Imaging Computing and Computer-Assisted Intervention, Shanghai, PR China
Do you have an account?
- Rent for 48h to view
- Buy Cloud Access for unlimited viewing via different devices
- Synchronizing in the ReadCube Cloud
- Printing and saving restrictions apply
Rental: USD 8.50
Cloud: USD 20.00
Article / Publication Details
Background/Aims: Augmented reality (AR) technology solves the problem of view switching in traditional image-guided neurosurgery systems by integrating computer-generated objects into the actual scene. However, the state-of-the-art AR solution using head-mounted displays has not been widely accepted in clinical applications because it causes some inconvenience for the surgeon during surgery. Methods: In this paper, we present a Tablet-AR system that transmits navigation information to a movable tablet PC via a wireless local area network and overlays this information on the tablet screen, which simultaneously displays the actual scene captured by its back-facing camera. With this system, the surgeon can directly observe the intracranial anatomical structure of the patient with the overlaid virtual projection images to guide the surgery. Results: The alignment errors in the skull specimen study and clinical experiment were 4.6 pixels (approx. 1.6 mm) and 6 pixels (approx. 2.1 mm), respectively. The system was also used for navigation in 2 actual clinical cases of neurosurgery, which demonstrated its feasibility in a clinical application. Conclusions: The easy-to-use Tablet-AR system presented in this study is accurate and feasible in clinical applications and has the potential to become a routine device in AR neuronavigation.
© 2013 S. Karger AG, Basel
- Gumprecht HK, Widenka DC, Lumenta CB: BrainLab VectorVision Neuronavigation System: technology and clinical experiences in 131 cases. Neurosurgery 1999;44:97-104, discussion 104-105.
- Grunert P, Darabi K, Espinosa J, Filippi R: Computer-aided navigation in neurosurgery. Neurosurg Rev 2003;26:73-99.
- Cleary K, Peters TM: Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 2010;12:119-142.
- Iseki H, Masutani Y, Iwahara M, et al: Volumegraph (overlaid three-dimensional image-guided navigation). Clinical application of augmented reality in neurosurgery. Stereotact Funct Neurosurg 1997;68:18-24.
Schnaider M, Schwald B, Seibert H, Weller T: Medarpa - A medical augmented reality system for minimal-invasive interventions. Stud Health Technol Inform 2003;94:312-314.
- Marmulla R, Hoppe H, Muhling J, Eggers G: An augmented reality system for image-guided surgery. Int J Oral Max Surg 2005;34:594-596.
- Kockro RA, Tsai YT, Ng I, et al: Dex-ray: augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery 2009;65:795-807.
- Roberts DW, Strohbehn JW, Hatch JF, Murray W, Kettenberger H: A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. J Neurosurg 1986;65:545-549.
- Sielhorst T, Feuerstein M, Navab N: Advanced medical displays: a literature review of augmented reality. J Display Technol 2008;4:451-467.
Birkfellner W, Huber K, Watzinger F, et al: Development of the varioscope AR - a see-through HMD for computer-aided surgery. Proceedings of the IEEE and ACM Int Symp on Augmented Reality, 2000, pp 54-59.
Salb T, Brief J, Welzel T, et al: INPRES (Intraoperative Presentation of Surgical Planning and Simulation Results) - augmented reality for craniofacial surgery. Stereoscopic Displays and Virtual Reality Systems X. Proceedings of the SPIE 2003, vol 5006, pp 453-460.
Sudra G, Marmulla R, Salb T, et al: First clinical tests with the augmented reality system INPRES; in Medicine Meets Virtual Reality 13: The Magical Next Becomes the Medical Now. Amsterdam, IOS Press, 2005, vol 111, pp 532-537.
Figl M, Ede C, Birkfellner W, Hummel J, Seemann R, Bergmann H: Automatic calibration of an optical see through head mounted display for augmented reality applications in computer assisted interventions. Med Imaging 2004;5367:59-64.
Salb T, Brief J, Burgert O, et al: INPRES - Intraoperative Presentation of Surgical Planning and Simulation Results. Int J Comput Assist Radiol Surg 2001;1230:1142.
Bichlmeier C, Navab N: Virtual window for improved depth perception in medical AR. International Workshop on Augmented Reality Environments for Medical Imaging and Computer-aided Surgery (AMI-ARCS), Copenhagen, 2006.
Sielhorst T, Bichlmeier C, Heining S, Navab N: Depth perception - a major issue in medical AR: evaluation study by twenty surgeons. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2006. Copenhagen, 2006, pp 364-372.
Bichlmeier C, Wimme F, Heining SM, Navab N: Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality. IEEE 2007, pp 129-138.
- Rolland JP, Fuchs H: Optical versus video see-through head-mounted displays in medical visualization. Presence (Camb) 2000;9:287-309.
Wesarg S, Firle EA, Schwald B, Seibert H, Zogal P, Roeddiger S: Accuracy of needle implantation in brachytherapy using a medical AR system - a phantom study. Med Imaging 2004;5367:341-352.
- Liao H, Inomata T, Sakuma I, Dohi T: 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng 2010;57:1476-1486.
Klein G, Drummond T: Sensor fusion and occlusion refinement for tablet-based AR. ISMAR 2004: 3rd IEEE and ACM International Symposium on Mixed and Augmented Reality 2004, pp 38-47.
Stork A, Santos P, Gierlinger T, et al: IMPROVE: an innovative application for collaborative mobile mixed reality design review. Proceedings of Virtual Concept 2006.
- Papagiannakis G, Singh G, Magnenot-Thalmann N: A survey of mobile and wireless technologies for augmented reality systems. Comput Animat Virtual Worlds 2008;19:3-22.
- Wang MN, Song ZJ: Guidelines for the placement of fiducial points in image-guided neurosurgery. Int J Med Robot Comp 2010;6:142-149.
- Wang MN, Song ZJ: Distribution templates of the fiducial points in image-guided neurosurgery. Neurosurgery 2010;66:143-150.
Donald Hearn, Baker MP: Computer Graphics with OpenGL, ed 3, rev. Prentice Hall, 2003.
- Krishnan R, Hermann E, Wolff R, Zimmermann M, Seifert V, Raabe A: Automated fiducial marker detection for patient registration in image-guided neurosurgery. Comput Aided Surg 2003;8:17-23.
- Eggers G, Muhling J, Marmulla R: Image-to-patient registration techniques in head surgery. Int J Oral Max Surg 2006;35:1081-1095.
Wiles AD, Thompson DG, Frantz DD: Accuracy assessment and interpretation for optical tracking systems. Medical Imaging 2004: Visualization, Image-Guided Procedures, and Display. Proceedings of the SPIE, San Diego, 2004, pp 421-432.
- Navab N, Heining SM, Traub J: Camera Augmented Mobile C-Arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 2010;29:1412-1423.
Bäthis H, Shafizadeh S, Banerjee M, Banerjee M, Bracke B: iPod-based navigation in TKR and THR - first experience and results of the pilot study. 11th Annu Meet Int Soc Comput Assist Orthop Surg, London, June 2011.
- Bertelsen A, Irarrazaval P, Cadiz RF: Volume visualization using a spatially aware mobile display device. Comput Med Imaging Graph 2012;36:66-71.
- Rassweiler JJ, Muller M, Fangerau M, et al: iPad-assisted percutaneous access to the kidney using marker-based navigation: initial clinical experience. Eur Urol 2012;61:628-631.
Article / Publication Details
Copyright / Drug Dosage / DisclaimerCopyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.