Computer Vision in Healthcare ApplicationsView this Special Issue
Research Article | Open Access
New Directions in 3D Medical Modeling: 3D-Printing Anatomy and Functions in Neurosurgical Planning
This paper illustrates the feasibility and utility of combining cranial anatomy and brain function on the same 3D-printed model, as evidenced by a neurosurgical planning case study of a 29-year-old female patient with a low-grade frontal-lobe glioma. We herein report the rapid prototyping methodology utilized in conjunction with surgical navigation to prepare and plan a complex neurosurgery. The method introduced here combines CT and MRI images with DTI tractography, while using various image segmentation protocols to 3D model the skull base, tumor, and five eloquent fiber tracts. This 3D model is rapid-prototyped and coregistered with patient images and a reported surgical navigation system, establishing a clear link between the printed model and surgical navigation. This methodology highlights the potential for advanced neurosurgical preparation, which can begin before the patient enters the operation theatre. Moreover, the work presented here demonstrates the workflow developed at the National University Hospital of Iceland, Landspitali, focusing on the processes of anatomy segmentation, fiber tract extrapolation, MRI/CT registration, and 3D printing. Furthermore, we present a qualitative and quantitative assessment for fiber tract generation in a case study where these processes are applied in the preparation of brain tumor resection surgery.
Three-dimensional (3D) modeling and rapid prototyping technologies have recently shown great utility in a wide variety of applications in medicine and surgery [1, 2]. In principle, the 3D recapitulation of patient-specific anatomical features provides surgeons with an immediate and intuitive understanding of even the most complex anatomical morphologies, enabling accurate planning and emulation of a host of surgical procedures [3, 4]. Indeed, the employment of these 3D anatomical models is additionally being considered for a host of implantation procedures, such as dental crowning, craniofacial reconstruction, and tissue regeneration via biological scaffolds [5–7].
Kodama et al. reported the birth of 3D rapid prototyping in 1981 , and the first use of the technology in support of surgical planning was reported by Anderl et al. in 1994 . Since then, improvements in medical imaging modalities, such as CT and MRI, have driven both the clinical interest and academic development of 3D rapid prototyping in a medical context. Modern rapid prototyping enables the construction of anatomical models with layer thicknesses on the order of microns, and with concurrent advancements in medical image contrast segmentation, these models are able to recapitulate external and internal anatomical morphologies to high degrees of precision. The utilization of rapid prototyping models incurs a host of benefits to many surgical fields, which include improving surgical planning, enhancing diagnostic quality, decreasing patient exposure time to general anesthesia, decreasing patient blood loss, and shortening wound exposure time .
With the aims of improving surgical outcomes, reducing future costs, and developing thorough clinical guidelines for enhancing surgical planning and assessment, the National University Hospital of Iceland, Landspitali, established an in-house service for 3D rapid prototyping in 2007. Since its introduction, this service has allowed physicians and surgeons from different specialities to submit requests for a host of 3D models to be made available within 24 hours of submission. This process was simultaneously employed in research activities to study both the anthropometry of human muscles  and the use of rapid prototyping as preparation for complex brain surgeries in combination with neurosurgical navigation systems . Since then, the National University Hospital of Iceland has fabricated over 200 surgical models for patient cases in the fields of cardiac, orthopedic, and neurosurgery (Figure 1(a)). The overwhelming success of this 3D rapid prototyping service has led to its solidification as an essential service within the hospital, and the rapid prototyping service continues to expand its impact on an increasing number of assisted surgical cases .
In neurosurgery, one technique that has likewise been increasingly used for preoperative planning is diffusion tensor imaging (DTI) tractography or fiber tracking. Tractography is a noninvasive technique that allows for the in vivo localization of fiber tracts in the brain. Tractography uses DTI, which is based on magnetic resonance imaging (MRI), to map brain connectivity, which can provide neurosurgeons with the opportunity to visualize nerve fiber tracts before surgery . More specifically, this technique may be applied to that of functional MRI (fMRI), which has shown great utility in the context of surgical planning. fMRI utilizes hemodynamic responses within the brain to implicate regional recruitment with a variety of cortical functions, such as motor control and language processing . Unfortunately, the routine integration of surgical planning, DTI, and preoperative fMRI has been primarily limited by concerns regarding acquisition and registration reliability. Nonetheless, there is much promise in this regard—evidenced most relevantly in the reconstruction of cotricospinal tracts for preoperative tumor planning [16, 17]. The purpose of this paper is to detail a novel approach to neurosurgical planning via the use of 3D printing, which combines patient-specific anatomy from traditional computer tomography (CT) and MRI images, with brain function derived from the in vivo localization of fiber tracts in the brain using DTI.
2. Material and Methods
The procedure of creating the 3D-printed models based on CT, MRI, and DTI data can be seen in Figure 1(b).
2.1. CT and MRI Acquisition
CT data were acquired from a Philips/Brilliance 64, the Head scan protocol was set to 119 mA X-ray for the tube current and 120 KV for tube voltage, and the slice thickness is typically between 0.6 and 1 mm.
MRI data were acquired from a 1.5T Siemens Avanto and the head coil used was Head Matrix Coil from Siemens. Both anatomical images and DTI were acquired for this process. The DTI protocol included a spin echo-echo planar imaging- (SE-EPI-) based DTI sequence with 20 diffusion directions, two repetitions to boost the SNR and b value (b is the diffusion sensitivity) equal to 1000 s/mm2. The anatomical image protocol included a T1-weighted 3D magnetization-prepared rapid acquisition gradient echo sequence (MP-RAGE).
2.2. DTI: Fiber Tract Extrapolation
The fiber tracts of major interest for this process are the so called eloquent fiber tracts; these tracks are easily clinically assessed and are most important for the patient outcome. In total, five fiber tracts were extrapolated from both software platforms: (i)Corpus callosum: the corpus callosum is located in the center of the brain and forms the largest white matter bundle. Its role is to transfer information between the left and right cerebral hemispheres .(ii)Motor tracts: they originate in the motor cortex area and descends down to the brain stem and spinal cord to control α-motor neurons. They can control posture, reflexes, and muscle tone as well as conscious voluntary movements .(iii)Sensory tracts: they are responsible for the sense of touch. They receive incoming messages for touch and limb movements from the body .(iv)Optic tracts: they transfer the information from the retina to the visual cortex of the brain [23, 24].(v)Broca’s area to Wernicke’s area: arcuate Fasciculus is the prominent fiber tracts that connect these two areas that play a role in our language and speech .
StealthViz is a surgical planning software application. It allows import of Digital Imaging and Communications in Medicine (DICOM) datasets that can be reviewed in 2D and with 3D volume rendering, multimodality image fusion, and segmentation of structures with manual and semiautomatic tools. The software performs white matter tractography. It enables realignment of diffusion-weighted gradient, coregistration with other anatomical and functional datasets, and tensor calculations. The fiber tracking uses deterministic FACT algorithm . The workflow is the following: (i)Import data: the MRI data are imported in DICOM format. Anatomical and diffusion tensor images are merged and the diffusion tensor positioned in the correct anatomical position.(ii)Segmentation: StealthViz allows segmentation with five different tools; pick region tool, brush tool, lasso tool, magic wand, and blow. A brain tumor can be segmented by using a blow tool which marks the region of interest on one cross section. The process can be iterated on several slices and those marked regions can be interpolated creating a 3D object of the tumor.(iii)Fiber tracking: to trace tracts in StealthViz a start box (and eventually a middle and end box) can placed on specific regions of interest in the brain, called seeding point, for example, in our application, we start in the region of corpus callosum. Then, the software computed all the fibers that go through the designed box. Different combinations of the boxes can be used to find the tracts of interest. Tracks that are not of interest can be removed. Calculated fiber tracts are visualized within the structural images both in 2D and in 3D.(iv)Calculate as 3D object: when the tractography planning is completed and approved by neurosurgeon, the tracts are converted in 3D objects and saved in a DICOM format. In this phase, an error margin of 1 mm is added to each fiber tract.(v)Export planning: results can be exported as a one file or separated files (each for every track) to the surgical navigation system or to a USB flash memory.
NordicBrainEx is DICOM compatible and can analyze DTI data acquired with all major MRI scanners. DTI datasets acquired with two different b values (one and six or more DWI where ) can be analyzed in nordicBrainEx. The DTI analysis in nordicBrainEx generates parametric maps of various attributes of the diffusion tensor, including eigenvector color map (cDTI), fractional anisotropy index (FA), mean diffusivity (ADC), tensor eigenvalues (), and trace weighted (TraceW). The fiber tracking is performed by using FACT . The workflow is the following: (i)Import data: an automatic registration allows to place DTI data correctly according with the structural images.(ii)Fiber tracking: to perform tractography planning 5 different geometrical shapes can be selected for fiber tracking; ellipsoid, cube, polygon, free hand, or scatter. These geometrical shapes are used to define volume of interest (VOI) and find the tracts of interest. On a defined VOI, three logical operators are available: (1) AND which only visualize fibers passing through that VOI, (2) OR which will only visualize fibers passing through this and any other VOIs defined, or (3) NOT that will disregard all fibers passing through that VOI. When finished tracking, one fiber, for example, corpus callosum, can be saved individually.(iii)Export planning: results can be exported as separated files (each for every track) to the surgical navigation system or to a USB flash memory.
2.3. Quality Assessment: Anatomical Accuracy and Incorrectly Displayed Fibers
It is known that the different surgical planning software for fiber tracks may provide different results even though they are based on the same reconstruction algorithm . For this reason, we performed a comparison between the software available in our institution to find the optimal one for rapid prototyping application. The assessment is based on anatomic accuracy and incorrectly displayed fibers for each fiber tract. These comparisons are done by grading the fiber-tracking results. Table 1 shows the grading for incorrectly displayed fibers and Table 2 shows the grading for anatomic accuracy. The grades vary from 1 (best) up to 4 (worst). A white matter atlas was used as a reference for the evaluation [28, 29].
2.4. Segmentation and Registration
The next step is to combine the anatomical data such as the skull and other regions of interest with the tracks from the DTI software. We use for this propose the software MIMICS  that is a platform for medical image processing. The process can be divided in three steps:
Step 1. CT data are imported in MIMICS and the skull bone is segmented. This operation is threshold based; where a range of HU (typically, from 600 to 2000) values are selected that allow to display the bone tissue. Next we apply region growing to assemble the entire connected pixel within the defined threshold in a so called mask. Now a 3D object can be created directly from the mask and further modification (such as opening the skull model to see inside) can be applied on the 3D object using CAD tools. Finally the 3D model can be saved as standard tessellation language (STL) file which is a format compatible with 3D Printing technologies.
Step 2. The next step is to import the tractography DICOM files to MIMICS. The 5 tracks of interest are superimposed on the anatomy (MRI data) but appearing brighter compared to those of the surrounding tissue (Figure 2(a)); therefore, the threshold-based segmentation of each tracts is easy. The five 3D objects associated with each tracks were created in the same way as described in step 1. In order to improve the quality of the 3D objects for 3D printing, we applied some morphological operations on the mask in order to smoothen details equal or below to 0.25 mm and closing distance equal to 2.5 mm (holes or gaps of 0.25 mm or less are filled). Finally, the 3D model can be saved as STL file.
Step 3. The final step is to combine Tracts, MRI, and CT data within the same 3D object. First, we imported the MRI T1-weighted images to MIMICS. Soft tissues like tumor are better visualized with MRI, and therefore, the segmentation and creation of the 3D object for this region of interest is done in this phase using the same threshold-based procedure described above. Next, we import the STL files of the skull and fiber tracts. Fiber tracts were positioned in a semiautomatic way on the 2D structural images by projecting the contours from the 3D object of the tracts. Next, we imported the STL file of the skull. Since the CT and MRI data have different coordinate system, the skull 3D object is registered manually using a 3D-positioning panel. When the skull is in the right position, then the necessary connections (bridges drawn manually) between tumor, fiber tracts, and skull are built in order to create a 3D model that can be printed. Finally, the skull, tumor, fiber tracts, and the bridges are combined in one 3D object using Boolean operations, and the results are saved as STL (Figure 2(b)).
2.5. Navigation System and Rapid Prototyping
The 3D model of Figure 2 is finally printed using a ProJet® (3D systems, Rock Hill, USA) printer using a material called VisiJet®M3-X which is an organic colorless mixture that allow rendering of small details (mm scale). After print, the model is hardened with an infrared light.
The computer model can be exported to the surgical navigation system as DICOM set, StealthStation® , which works as a GPS system determining the position of surgical instruments in relation to patient images by automatically fusing CT and MRI scans. Then, a registration is done with patient anatomy; so, there is a linkage between the patient and the system. In this application, we use the 3D-printed model instead of the real patient; in this way advanced preparation of the surgery can start before the patient enters the operation theatre.
We validate this process collaborating to a neurosurgical planning of a 29-year-old female having a low-grade glioma located on the frontal lobe.
The five fiber tracts that we focused on in this study can be seen in Figure 3, it shows the side views tractography planning from the two surgical planning software platforms: Figures 3(a) and 3(b) for StealthViz and Figures 3(c) and 3(d) for nordicBrainEx. It can be noticed that the pathways for the tracts are similar but not the identical; indeed, there are remarkable differences in thickness and ending morphology between the software platforms that may be important in relation to the pathological area of interest. In order to assess the results from the two fiber tracts planning, we use image comparison software called XERO viewer ; here, the fiber tracts, superimposed on the MRI data, were viewed simultaneously and visually assessed. Figure 4 shows the comparison of corpus callosum. To be noticed, the surface of corpus callosum is shown in Figure 4(b) that displays a false positive. Moreover, the fiber tract from StealthViz goes out of white matter in the brain and it is difficult to assess the exact position. Based on comparison, slice by slice and tract by tract, we assess the two tractography planning based on anatomic accuracy and incorrectly displayed fibers [28, 29]. The quantitative results are displayed in Table 3 where for this study case, the tractography plane made with nordicBrainEx has a better score and was chosen for the next step. Figure 5 shows the computer model (a) and 3D-printed model (b) resulting from the nordicBrainEx surgical planning.
DTI planning and 3D-printed models were used with the neurosurgical navigation system  to prepare the surgical operation where the tumor was removed from the frontal lobe. The operation was successful, and advanced planning provided with DTI planning and 3D models allowed the neurosurgeons to be better prepared during surgery.
Three-dimensional models and navigation systems for neurosurgery can be combined to improve surgical planning and surgeon training [12, 32]. The work reported herein demonstrates that preoperative planning using diffusion tensor imaging (DTI) tractography and 3D models is feasible and can be employed in the preparation of complex operations. Additionally, it is likely that this process can shorten operation times, contribute to better patient safety, and be used for training surgeons.
Even though DTI tractography is not a fully reliable method, it can still provide the neurosurgeons with an overview of fiber tract position, and it has been shown that the use of DTI improves tumor resection results and decreases postoperative deficits [14, 33]. Altogether, this work demonstrates that the reported 3D-printing process may be integrated with DTI planning and add valuable information for neurosurgical planning—especially in association with surgical navigation systems.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
The authors would like to thank the Icelandic Innovation Fund RANNIS, the company Össur, and the University Hospital Landspitali, for providing financial and technical support to this project.
- T. Akiba, T. Morikawa, and T. Ohki, “Simulation of thoracoscopic surgery using 3-dimensional tailor-made virtual lung,” The Journal of Thoracic and Cardiovascular Surgery, vol. 143, no. 5, pp. 1232–1234, 2012.
- T. Akiba, T. Morikawa, and T. Ohki, “Thoracoscopic lung segmentectomy simulated by a tailor-made virtual lung: computed bronchography and angiography,” The Thoracic and Cardiovascular Surgeon, vol. 61, no. 2, pp. 151–153, 2013.
- B. G. Leshnower, D. L. Miller, F. G. Fernandez, A. Pickens, and S. D. Force, “Video-assisted thoracoscopic surgery segmentectomy: a safe and effective procedure,” The Annals of Thoracic Surgery, vol. 89, no. 5, pp. 1571–1576, 2010.
- P. Gargiulo and G. Á. Björnsson, “Integrated medical modeling service to optimize planning for mandibular distraction osteogenesis and maxillofacial surgeries: 5 years’ experience,” Anaplastology, vol. 2, no. 121, pp. 2161–1173, 2013.
- K. Watabnabe, K. Uese, O. Higuchi et al., “Three-dimensional computed tomographic findings of bilateral tracheal bronchus,” Pediatric Cardiology, vol. 30, no. 1, pp. 87-88, 2009.
- Y. M. Zhong, R. B. Jaffe, M. Zhu, W. Gao, A. M. Sun, and Q. Wang, “CT assessment of tracheobronchial anomaly in left pulmonary artery sling,” Pediatric Radiology, vol. 40, no. 11, pp. 1755–1762, 2010.
- R. Read, J. S. Cyr, J. Marek, G. Whitman, and A. Hopeman, “Bronchial anomaly of the right upper lobe,” The Annals of Thoracic Surgery, vol. 50, no. 6, pp. 980-981, 1990.
- H. Kodama, “Automatic method for fabricating a three-dimensional plastic model with photo-hardening polymer,” Review of Scientific Instruments, vol. 52, no. 11, pp. 1770–1773, 1981.
- H. Anderl, D. Zur Nedden, W. Mu et al., “CT-guided stereolithography as a new tool in craniofacial surgery,” British Journal of Plastic Surgery, vol. 47, no. 1, pp. 60–64, 1994.
- P. A. Webb, “A review of rapid prototyping (RP) techniques in the medical and biomedical sector,” Journal of Medical Engineering & Technology, vol. 24, no. 4, pp. 149–153, 2000.
- C. Ugo, K. J. Edmunds, and P. Gargiulo, “3D false color computed tomography for diagnosis and follow-up of permanent denervated human muscles submitted to home-based functional electrical stimulation,” European Journal of Translational Myology, vol. 25, no. 2, p. 5133, 2015.
- P. Gargiulo, S. B. Sævarsdóttir, B. Baldvinsdóttir, and I. H. Ólafsson, “Use of 3 dimensional models and navigation system in preparation for brain surgery,” Biomedizinische Technik, vol. 58, no. 1, p. 1, 2013.
- H. Halldórsson, A. J. Arason, M. Sigurðardóttir et al., “Recurrent tumor growth in the right maxilla--a rare case of an inflammatory myofibroblastic tumor,” Laeknabladid, vol. 101, no. 1, pp. 19–23, 2015.
- D. Leclercq, C. Delmaire, N. Menjot de Champfleur, J. Chiras, and S. Lehéricy, “Diffusion tractography: methods, validation and applications in patients with neurosurgical lesions,” Neurosurgery Clinics of North America, vol. 22, no. 2, pp. 253–268, 2011.
- K. Kośla, B. Bryszewski, D. Jaskólski, N. Błasiak-Kołacińska, L. Stefańczyk, and A. Majos, “Reorganization of language areas in patient with a frontal lobe low grade glioma–fMRI case study,” Polish Journal of Radiology, vol. 80, no. 1, p. 290, 2015.
- D. Frey, V. Strack, E. Wiener, D. Jussen, P. Vajkoczy, and T. Picht, “A new approach for corticospinal tract reconstruction based on navigated transcranial stimulation and standardized fractional anisotropy values,” NeuroImage, vol. 62, no. 3, pp. 1600–1609, 2012.
- V. A. Coenen, T. Krings, L. Mayfrank et al., “Three-dimensional visualization of the pyramidal tract in a neuronavigation system during brain tumor surgery: first experiences and technical note,” Neurosurgery, vol. 49, no. 1, pp. 86–93, 2001.
- Medronic, “StealthViz with StealthDTI application reference guide,” Medronic, 2008–2011.
- NordicNeuroLab AS, “nordicBrainEx Tutorial - DTI Module,” NordicNeuroLab AS, 2015.
- A. Fitsiori, D. Nguyen, A. Karentzos, J. Delavelle, and M. I. Vargas, “The corpus callosum: white matter or terra incognita,” The British Journal of Radiology, vol. 84, no. 997, pp. 5–18, 2011.
- Bioon.com, “Basic motor pathway,” February 2017, http://www.bioon.com/bioline/neurosci/course/basmot.html.
- Study.com, “Sensory cortex: definition & function - video & lesson transcript,” February 2017, http://study.com/academy/lesson/sensory-cortex-definition-function.html.
- Healthline.com, “Optic nerve function, anatomy & definition | body maps,” February 2017, http://www.healthline.com/human-body-maps/optic-nerve.
- A. D. Friederici, “Pathways to language: fiber tracts in the human brain,” Trends in Cognitive Sciences, vol. 13, no. 4, pp. 175–181, 2009.
- F.-C. Yeh, T. D. Verstynen, Y. Wang, J. C. Fernández-Miranda, and W.-Y. I. Tseng, “Deterministic diffusion fiber tracking improved by quantitative anisotropy,” PloS One, vol. 8, no. 11, article e80713, 2013.
- G. C. Feigl, W. Hiergeist, C. Fellner et al., “Magnetic resonance imaging diffusion tensor tractography: evaluation of anatomic accuracy of different fiber tracking software packages,” World Neurosurgery, vol. 81, no. 1, pp. 144–150, 2014.
- M. Catani and M. Thiebaut de Schotten, “A diffusion tensor imaging tractography atlas for virtual in vivo dissections,” Cortex, vol. 44, no. 8, pp. 1105–1132, 2008.
- K. Oishi, A. V. Faria, P. C. M. van Zijl, and S. Mori, MRI Atlas of Human White Matter, Elsevier Academic Press, China, 2010.
- “MIMICS software,” February 2017, http://biomedical.materialise.com/mimics.
- “Xero viewer software,” February 2017, http://agfahealthcare.com/he/usa/en/binaries/XERO%20sheet%202013_tcm561-113934.pdf.
- “Medtronic,” http://www.medtronic.com/us-en/healthcare-professionals/products/neurological/surgical-navigation-systems/stealthstation.html.
- P. Gargiulo, “3D modelling and monitoring of denervated muscle under functional electrical stimulation treatment and associated bone structural change,” European Journal of Translational Myology/Basic Applied Myology, vol. 21, no. 1, pp. 31–94, 2011.
- O. Ciccarelli, M. Catani, H. Johansen-Berg, C. Clark, and A. Thompson, “Diffusion-based tractography in neurological disorders: concepts, applications, and future developments,” Lancet Neurology, vol. 7, no. 8, pp. 715–727, 2008.
Copyright © 2017 Paolo Gargiulo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.