Exploration of Medical Volume Data in Projective Augmented Reality: An Interactive Demonstration

Bornemann, Kai; Heinrich, Florian; Lawonn, Kai; Hansen, Christian

by Kai Bornemann, Florian Heinrich, Kai Lawonn, Christian Hansen

Abstract:

This article describes the implementation and usage of a prototype to explore medical volume data in projective augmented reality (AR). To allow real-time rendering of the data, a volume ray casting algorithm is implemented on the GPU. Furthermore, the volume data is distorted to be superimposed correctly from the user's perspective. To allow exploration of the dataset, the user can use an HTC Vive Controller to show or hide structures with either clipping or windowing. In the future, the proposed prototype might be used for diagnosis, planning and computer assisted surgery. First tests indicate that this setup increases spatial understanding of the volume data compared to conventional computer monitors.

View PDF

Reference:

Exploration of Medical Volume Data in Projective Augmented Reality: An Interactive Demonstration (Kai Bornemann, Florian Heinrich, Kai Lawonn, Christian Hansen), In Proceedings of the Conference on Mensch Und Computer, 2020. (event-place: Magdeburg, Germany)

Bibtex Entry:

@inproceedings{bornemann_exploration_2020,
	address = {Magdeburg},
	series = {{MuC} '20},
	title = {Exploration of {Medical} {Volume} {Data} in {Projective} {Augmented} {Reality}: {An} {Interactive} {Demonstration}},
	isbn = {9781450375405},
	url = {https://doi.org/10.1145/3404983.3410415},
	abstract = {This article describes the implementation and usage of a prototype to explore medical volume data in projective augmented reality (AR). To allow real-time rendering of the data, a volume ray casting algorithm is implemented on the GPU. Furthermore, the volume data is distorted to be superimposed correctly from the user's perspective. To allow exploration of the dataset, the user can use an HTC Vive Controller to show or hide structures with either clipping or windowing. In the future, the proposed prototype might be used for diagnosis, planning and computer assisted surgery. First tests indicate that this setup increases spatial understanding of the volume data compared to conventional computer monitors.},
	booktitle = {Proceedings of the {Conference} on {Mensch} {Und} {Computer}},
	author = {Bornemann, Kai and Heinrich, Florian and Lawonn, Kai and Hansen, Christian},
	year = {2020},
	note = {event-place: Magdeburg, Germany},
	keywords = {Interaction Techniques, medical volume data, projective augmented reality},
	pages = {507--509}
}