by Marko Rak, Johannes Steffen, Anneke Meyer, Christian Hansen, Klaus-Dietz Tönnies
Abstract:
Background and Objective: We propose an automatic approach for fast vertebral body segmentation in three-dimensional magnetic resonance images of the whole spine. Previous works are limited to the lower thoracolumbar section and often take minutes to compute, which is problematic in clinical routine, for study data sets with numerous subjects or when the cervical or upper thoracic spine is to be analyzed. Methods: We address these limitations by a novel graph cut formulation based on vertebra patches extracted along the spine. For each patch, our formulation incorporates appearance and shape information derived from a task-specific convolutional neural network as well as star-convexity constraints that ensure a topologically correct segmentation of each vertebra. When segmenting vertebrae individually, ambiguities will occur due to overlapping segmentations of adjacent vertebrae. We tackle this problem by novel non-overlap constraints between neighboring patches based on so-called encoding swaps. The latter allow us to obtain a globally optimal multi-label segmentation of all vertebrae in polynomial time. Results: We validated our approach on two data sets. The first contains T1- and T2-weighted whole spine images of 64 subjects with varying health conditions. The second comprises 23 T2-weighted thoracolumbar images of young healthy adults and is publicly available. Our method yielded Dice coefficients of 93.8 ± 2.6\% and 96.0 ± 1.0\% for both data sets with a run time of 1.35 ± 0.08 s and 0.90 ± 0.03 s per vertebra on consumer hardware. A complete whole spine segmentation took 32.4 ± 1.92 s on average. Conclusions: Our results are superior to those of previous works at a fraction of their run time, which illustrates the efficiency and effectiveness of our whole spine segmentation approach.
Reference:
Combining convolutional neural networks and star convex cuts for fast whole spine vertebra segmentation in MRI (Marko Rak, Johannes Steffen, Anneke Meyer, Christian Hansen, Klaus-Dietz Tönnies), In Computer Methods and Programs in Biomedicine, volume 177, 2019.
Bibtex Entry:
@article{rak_combining_2019,
title = {Combining convolutional neural networks and star convex cuts for fast whole spine vertebra segmentation in {MRI}},
volume = {177},
issn = {0169-2607},
url = {http://www.sciencedirect.com/science/article/pii/S0169260718307417},
doi = {https://doi.org/10.1016/j.cmpb.2019.05.003},
abstract = {Background and Objective: We propose an automatic approach for fast vertebral body segmentation in three-dimensional magnetic resonance images of the whole spine. Previous works are limited to the lower thoracolumbar section and often take minutes to compute, which is problematic in clinical routine, for study data sets with numerous subjects or when the cervical or upper thoracic spine is to be analyzed. Methods: We address these limitations by a novel graph cut formulation based on vertebra patches extracted along the spine. For each patch, our formulation incorporates appearance and shape information derived from a task-specific convolutional neural network as well as star-convexity constraints that ensure a topologically correct segmentation of each vertebra. When segmenting vertebrae individually, ambiguities will occur due to overlapping segmentations of adjacent vertebrae. We tackle this problem by novel non-overlap constraints between neighboring patches based on so-called encoding swaps. The latter allow us to obtain a globally optimal multi-label segmentation of all vertebrae in polynomial time. Results: We validated our approach on two data sets. The first contains T1- and T2-weighted whole spine images of 64 subjects with varying health conditions. The second comprises 23 T2-weighted thoracolumbar images of young healthy adults and is publicly available. Our method yielded Dice coefficients of 93.8 ± 2.6\% and 96.0 ± 1.0\% for both data sets with a run time of 1.35 ± 0.08 s and 0.90 ± 0.03 s per vertebra on consumer hardware. A complete whole spine segmentation took 32.4 ± 1.92 s on average. Conclusions: Our results are superior to those of previous works at a fraction of their run time, which illustrates the efficiency and effectiveness of our whole spine segmentation approach.},
journal = {Computer Methods and Programs in Biomedicine},
author = {Rak, Marko and Steffen, Johannes and Meyer, Anneke and Hansen, Christian and Tönnies, Klaus-Dietz},
year = {2019},
keywords = {Graph cuts, Magnetic resonance, Neural networks, Spine analysis, Vertebra segmentation},
pages = {47 -- 56}
}