Skip to main content

Main menu

  • Home
  • Content
    • Current Issue
    • Advance Online Publication
    • Archive
  • About Us
    • About ISASS
    • About the Journal
    • Author Instructions
    • Editorial Board
    • Reviewer Guidelines & Publication Criteria
  • More
    • Advertise
    • Subscribe
    • Alerts
    • Feedback
  • Join Us
  • Reprints & Permissions
  • Sponsored Content
  • Other Publications
    • ijss

User menu

  • My alerts

Search

  • Advanced search
International Journal of Spine Surgery
  • My alerts
International Journal of Spine Surgery

Advanced Search

  • Home
  • Content
    • Current Issue
    • Advance Online Publication
    • Archive
  • About Us
    • About ISASS
    • About the Journal
    • Author Instructions
    • Editorial Board
    • Reviewer Guidelines & Publication Criteria
  • More
    • Advertise
    • Subscribe
    • Alerts
    • Feedback
  • Join Us
  • Reprints & Permissions
  • Sponsored Content
  • Follow ijss on Twitter
  • Visit ijss on Facebook
Research ArticleOther & Special Categories

Do-It-Yourself Augmented Reality Heads-Up Display (DIY AR-HUD): A Technical Note

Jang W. Yoon, Michael Spadola, Rachel Blue, Anissa Saylany, Nikhil Sharma, Hasan S. Ahmad, Vivek Buch, Karthik Madhavan, H. Isaac Chen, Michael P. Steinmetz, William C. Welch and Neil R. Malhotra
International Journal of Spine Surgery August 2021, 15 (4) 826-833; DOI: https://doi.org/10.14444/8106
Jang W. Yoon
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD, MSC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael Spadola
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rachel Blue
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anissa Saylany
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
BA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nikhil Sharma
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hasan S. Ahmad
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
BS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vivek Buch
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karthik Madhavan
2Department of Neurosurgery, University of Miami, Miami, Florida
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
H. Isaac Chen
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael P. Steinmetz
3Department of Neurosurgery, Cleveland Clinic Lerner College of Medicine, Cleveland, Ohio
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William C. Welch
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Neil R. Malhotra
1Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Figure 1
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1

    The components necessary to create the augmented reality heads-up display (AR-HUD) system. This shows the connection from the Ziehm through a digital visual interface (DVI)- high-definition multimedia interface (HDMI) converter to the Moverio BT-35E glasses via an HDMI cable with the battery pack that would fit inside the user's pocket during the procedure.

  • Figure 2
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 2

    View of the image that is displayed within the augmented reality heads-up display (AR-HUD) system as seen from the operator's perspective (black line is not on actual display; it is only used to cover up patient identity).

  • Figure 3
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 3

    Case 1. C6-C7 cervical arthroplasty was successfully performed using an augmented reality heads-up display (AR-HUD) system under fluoroscopic guidance (panel A) for a C6-7 dis herniation (panel B). The placement of the Caspar pins (panel C) parallel to the endplates is important to allow symmetric distraction during cervical arthroplasty. AR-HUD allows for continuous visualization of x-ray images while malleting Caspar pin into the vertebral body. In addition, during the placement of trials and artificial discs into the disc space with the thecal sac exposed, AR-HUD allows the surgeon to view the lateral x-ray images without taking his eyes off his hands. Post-operative imaging shows successful placement of arthroplasty (panel D).

  • Figure 4
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 4

    Case 2. L1-L3 direct lateral interbody fusion and extension of fusion from T10-L5 using an augmented reality heads-up display (AR-HUD) system (panel A). Pre-operative imaging shows prior hardware from a previous surgery (panel B). During the pedicle screw placements with fluoroscopic guidance, lateral x-ray images are displayed within the surgeon's field of view; therefore, the surgeon can easily adjust or continue the trajectory of pedicle probe (or a screw) into the pedicle (panel C). Notice that in A, the attending surgeon is placing a pedicle screw with his back turned to the monitor. He is able to see the lateral x-ray images while looking straight at his hand without turning his body to see the monitor. This continuous overlay of x-ray images into the surgeon's field of view obviates the need for diverting his/her attention. Panel D shows post-operative imaging with successful extension of prior fusion.

  • Figure 5
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 5

    Case 3. Extension of prior T10-L4 fusion (panel B) to pelvis with L5-S1 posterior lumbar interbody fusion using an augmented reality heads-up display (AR-HUD) system (panel A). When the resident is learning how to place a pedicle screw, it requires careful supervision from an experienced spine surgeon to teach proper technique to the resident. In A, the attending surgeon is standing on the right and the resident is on the left. The attending surgeon is able to view the x-ray images on AR-HUD while the resident is placing an S1 pedicle screw under lateral x-ray guidance (panel C). In addition, AR-HUD allows for continuous visualization of x-ray images during discectomy, endplate preparation, and the placement of an interbody cage through Kambin's triangle. Panel D shows post-operative imaging of successful extension of fusion.

PreviousNext
Back to top

In this issue

International Journal of Spine Surgery
Vol. 15, Issue 4
1 Aug 2021
  • Table of Contents
  • Index by author

Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on International Journal of Spine Surgery.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Do-It-Yourself Augmented Reality Heads-Up Display (DIY AR-HUD): A Technical Note
(Your Name) has sent you a message from International Journal of Spine Surgery
(Your Name) thought you would like to see the International Journal of Spine Surgery web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Do-It-Yourself Augmented Reality Heads-Up Display (DIY AR-HUD): A Technical Note
Jang W. Yoon, Michael Spadola, Rachel Blue, Anissa Saylany, Nikhil Sharma, Hasan S. Ahmad, Vivek Buch, Karthik Madhavan, H. Isaac Chen, Michael P. Steinmetz, William C. Welch, Neil R. Malhotra
International Journal of Spine Surgery Aug 2021, 15 (4) 826-833; DOI: 10.14444/8106

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Do-It-Yourself Augmented Reality Heads-Up Display (DIY AR-HUD): A Technical Note
Jang W. Yoon, Michael Spadola, Rachel Blue, Anissa Saylany, Nikhil Sharma, Hasan S. Ahmad, Vivek Buch, Karthik Madhavan, H. Isaac Chen, Michael P. Steinmetz, William C. Welch, Neil R. Malhotra
International Journal of Spine Surgery Aug 2021, 15 (4) 826-833; DOI: 10.14444/8106
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • ABSTRACT
    • INTRODUCTION
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Hemivertebra Resection and Spinal Arthrodesis by Single-Stage Posterior Approach in Congenital Scoliosis and Kyphoscoliosis: Results at 9.6 Years Mean Follow-up
  • Prevalence and Significance of Vitamin D Deficiency in Patients Undergoing Corrective Surgery for Adolescent Idiopathic Scoliosis
  • Adult Congenital Spine Deformity: Clinical Features and Motivations for Surgical Treatment
Show more Other & Special Categories

Similar Articles

Keywords

  • spine
  • minimally invasive surgery
  • MIS
  • nerve surgery
  • orthopedic
  • 3D imaging
  • augmented reality
  • image-guided surgery
  • intraoperative imaging
  • navigation
  • heads-up display

Content

  • Current Issue
  • Latest Content
  • Archive

More Information

  • About IJSS
  • About ISASS
  • Privacy Policy

More

  • Subscribe
  • Alerts
  • Feedback

Other Services

  • Author Instructions
  • Join ISASS
  • Reprints & Permissions

© 2025 International Journal of Spine Surgery

International Journal of Spine Surgery Online ISSN: 2211-4599

Powered by HighWire