J. Edward Swan II

Calibration and Interaction in Optical See-Through Augmented Reality using Leap Motion

Kenneth R. Moser, Sujan Anreddy, and J. Edward Swan II. Calibration and Interaction in Optical See-Through Augmented Reality using Leap Motion. In Research Videos, IEEE International Conference on Virtual Reality (IEEE VR 2016), pp. 332, Mar 2016. DOI: 10.1109/VR.2016.7504791.
https://www.youtube.com/watch?v=CLe7JkoKpto

Download

[PDF] 

Abstract

The growing prevalence of hand and gesture tracking technology has led to an increased availability of consumer level devices, such as the Leap Motion controller, and also facilitated the inclusion of similar hardware into forth coming head mounted display offerings, including the Microsoft HoloLens and Moverio Pro BT-2000. In this video, we demonstrate the utility of the Leap Motion for calibrating optical see-through augmented reality systems by employing a variation on Tuceryan and Navab's Single Point Active Alignment Method [3]. We also showcase a straightforward method for calibrating the coordinate frame of the Leap Motion to a secondary tracking system by employing absolute orientation algorithms [2, 1, 4], allowing us to properly transform and visualize hand and finger tracking data from the user's viewpoint. Our combined display and coordinate frame calibration techniques produce a viable mechanism for not only intuitive interaction with virtual objects but also the creation of natural occlusion between computer generated content and the user themselves. We believe that these techniques will be pivotal in the development of novel consumer applications for next generation head mounted display hardware.

BibTeX

@InProceedings{IEEEVR16-lmv, 
  author =      {Kenneth R. Moser and Sujan Anreddy and J. Edward {Swan~II}}, 
  title =       {Calibration and Interaction in Optical See-Through Augmented Reality 
                 using Leap Motion}, 
  booktitle =   {Research Videos, IEEE International Conference on Virtual Reality 
                 (IEEE VR 2016)}, 
  location =    {Clemson, South Carolina, USA}, 
  date =        {March 19--23}, 
  month =       {Mar}, 
  year =        2016,
  pages =       {332},
  note =        {DOI: <a target="_blank"
                 href="https://doi.org/10.1109/VR.2016.7504791">10.1109/VR.2016.7504791</a>.} 
  abstract = { 
The growing prevalence of hand and gesture tracking technology has led 
to an increased availability of consumer level devices, such as the 
Leap Motion controller, and also facilitated the inclusion of similar 
hardware into forth coming head mounted display offerings, including 
the Microsoft HoloLens and Moverio Pro BT-2000. In this video, we 
demonstrate the utility of the Leap Motion for calibrating optical 
see-through augmented reality systems by employing a variation on 
Tuceryan and Navab's Single Point Active Alignment Method [3]. We also 
showcase a straightforward method for calibrating the coordinate frame 
of the Leap Motion to a secondary tracking system by employing 
absolute orientation algorithms [2, 1, 4], allowing us to properly 
transform and visualize hand and finger tracking data from the user's 
viewpoint. Our combined display and coordinate frame calibration 
techniques produce a viable mechanism for not only intuitive 
interaction with virtual objects but also the creation of natural 
occlusion between computer generated content and the user 
themselves. We believe that these techniques will be pivotal in the 
development of novel consumer applications for next generation head 
mounted display hardware. 
}, 
  wwwnote =              {<a target="_blank" href="https://www.youtube.com/watch?v=CLe7JkoKpto"> 
                          https://www.youtube.com/watch?v=CLe7JkoKpto</a>}, 
}