Development and Validation of the Random Forest Model via Combining CT-PET Image Features and Demographic Data for Distant Metastases among Lung Cancer Patients

Bi, Lijun; Guo, Yi

doi:https://doi.org/10.1155/2022/7793533

Journal of Healthcare Engineering

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusion Data Availability Conflicts of Interest Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 7793533 | https://doi.org/10.1155/2022/7793533

Development and Validation of the Random Forest Model via Combining CT-PET Image Features and Demographic Data for Distant Metastases among Lung Cancer Patients

Lijun Bi¹and Yi Guo²

Academic Editor: Jinshan Tang

Received28 Jun 2022

Revised18 Nov 2022

Accepted26 Nov 2022

Published13 Dec 2022

Abstract

The work aimed at developing and validating a random forest model of CT-PET image features combined with demographic data to diagnose distant metastases among lung cancer patients. This study involved lung cancer patients from The Cancer Genome Atlas lung adenocarcinoma (TCGA-LUAD) dataset, the lung PET-CT dataset, the lung squamous cell carcinoma (LSCC) dataset, and the National Cancer Institute’s Clinical Proteomic Tumor Analysis Consortium lung adenocarcinoma (CPTAC-LUAD) dataset and collected the information on 178 CT, 178 PET, and the patients’ age, history of smoking, and gender. We conducted image processing and feature extraction. Finally, 4 computed tomography (CT) image features and 2 positron emission tomography (PET) image features were extracted. Four prediction models based on CT image features, PET image features, and demographic data were developed, and the area under the receiver operating characteristic (ROC) curve was used to evaluate the performance of prediction models. A total of 178 eligible samples were randomly divided into a training set (n = 134) and a testing set (n = 44) at a ratio of 3 : 1, with 2021 as a random number. ROC analyses illustrated that the predictive performance for distant metastases of combining CT-PET image features and demographic data for training and testing were 0.923 (95% confidence interval (CI): 0.873–0.973) and 0.873 (95% CI: 0.757–0.990). In addition, the predictive performance of the combined model in the testing set was significantly better than that of the CT-demographic data model (0.716, 95% CI: 0.531–0.902), PET-demographic data model (0.802, 95% CI: 0.633–0.970), and CT-PET model (0.797, 95% CI: 0.666–0.928). The random forest model via combining CT-PET image features and demographic data could have great performance in predicting distant metastases among lung cancer patients.

1. Introduction

Lung cancer, one of the most common cancers, has been recognized as the leading cause of cancer-related deaths all over the world, and an estimated 2.20 million new cases and 1.76 million deaths occur each year [1]. Several studies showed that metastasis was a major cause of deaths in most patients with cancer [2, 3]. The distant metastases of advanced lung cancer are very extensive and could spread in various parts of the body, such as the lungs, liver, brain, and bone, which pose a serious threat to the life and health of patients [4]. Not only that, the treatment method for lung cancer patients is also associated with the staging of distant metastases [5]. Therefore, accurate determination of the distant stage for lung cancer plays an important role in evaluating tumor prognosis for patients.

Nowadays, the diagnosis of distant metastasis in lung cancer is mainly based on digital imaging, such as computed tomography (CT) [4], magnetic resonance imaging (MRI) [6], positron emission tomography (PET) [7], and ¹⁸F-fluorodeoxyglucose PET/CT (¹⁸FDG PET/CT) [8]. Aided diagnosis has important research significance and application value in accurately screening lesions, reducing the rate of missed diagnosis and misdiagnosis, reducing labor intensity, and improving the efficiency of reading films [9]. At present, several studies have developed risk prediction models to estimate the risk of lung cancer patients [10, 11] and pointed out sociodemographic information related to risk of lung cancer, including age, history of smoking, and gender.

As far as we know, most studies have only used these digital imaging technologies to diagnose distant metastases in lung cancer patients until now [7, 12], and there are few studies that combine demographic information to make a diagnosis. In addition, in the early diagnosis and curative effect evaluation of lung cancer, PET/CT fusion image with high sensitivity and specificity could not only realize the function of molecular imaging and anatomical imaging fusion, which is a kind of “positive” whole-body imaging method, but also reflect the pathological changes and organization structure and pathological changes of the lesion area [13, 14]. Herein, this study mainly aimed to develop and validate a random forest model of PET/CT image features combined with demographic data to diagnose distant metastases among lung cancer patients.

2. Materials and Methods

2.1. Data Sources and Collection

The patients’ information in this study was obtained from The Cancer Genome Atlas Lung Adenocarcinoma (TCGA-LUAD) dataset (n = 12), the lung PET-CT dataset (n = 132), the lung squamous cell carcinoma (LSCC) dataset (n = 6), and the National Cancer Institute’s Clinical Proteomic Tumor Analysis Consortium lung adenocarcinoma (CPTAC-LUAD) dataset (n = 2). A total of 178 CT and 178 PET were collected in this study. Simultaneously, the patients’ demographic information, such as age, history of smoking, and gender, was also extracted from these datasets.

2.2. Feature Extraction

In this study, all images were resized to 512 × 512 (Figure 1), and then, lung masks were extracted and made according to HU values of −900∼−700. Ndimage was used to fill possible gaps in the lungs, and skimage morphology was used to expand and ensure coverage of all lung areas. CT images, PET images, and their corresponding masks obtained from preprocessing were extracted by pyradiomics, including 18 first-order statistics, 10 two-dimensional shape features, and 75 texture features including (the gray-level co-occurrence matrix (GLCM, 24), the gray-level run length matrix (GLRLM, 16), the gray-level size zone (GLSZM, 16), the neighborhood gray-tone difference matrix (NGTDM, 5), and the gray-level difference method (GLDM, 14)). The features of CT and PET images were screened by Lasso regression, and finally, 4 CT image features and 2 PET image features were screened out.

2.3. Statistical Analysis

Measurement data were tested for normality by the Shapiro Test, the continuous variables of normal distribution were expressed by the mean ± SD, and the comparison between groups was tested by the T test. The measurement data of non-normal distribution were expressed by the median and interquartile distance, and the Mann–Whitney U test was used to compare between groups. Counting data were described by the number of cases and the composition ratio N (%), and the comparison between groups adopted the χ² test or Fisher’s exact probability method. Missing data were interpolated multiple times (Supplementary Table 1), SAS 9.4 statistical analysis software and Python analysis were used, and all statistical tests were conducted by two-sided tests. The difference between the tests was statistically significant at .

In the present study, 178 samples were randomly divided into a training set for developing prediction models and a test set for validating the models at a ratio of 3 : 1, with 2021 as a random number. Then, sensitivity analysis of demographic data was carried out. We constructed four prediction models based on CT image features, PET image features, and demographic data: (1) the random forest model of CT image features combined with demographic data, (2) the random forest model of PET image features combined with demographic data, (3) the random forest model of CT combined with PET, and (4) the random forest model of CT-PET image characteristics combined with demographic data. The flowchart of the analysis method is shown in Figure 2. The area under the receiver operating characteristic (ROC) curve was used to evaluate the performance of the prediction models.

3. Results

3.1. Patient Characteristics

A total of 178 eligible samples were enrolled, with 134 samples in the training set and 44 samples in the testing set. The average age was 64.56 and 62.41 years in the training and test datasets, respectively. There was no significant difference in demographic data between the training set and the testing set, which showed that our data balance is comparable (Supplementary Table 2).

After screening by Lasso regression, we screened out 4 CT and 2 PET image features, of which 4 CT image features included first-order 10 percent, first-order robust mean absolute deviation, GLCM joint average, and NGTDM strength; 2 PET image features contained GLDM low gray-level emphasis and NGTDM strength. Subsequently, we compared demographic data, 4 CT image features, and 2 PET image features in the training set (Table 1). In the comparison between groups, we found that the number of smokers in the M0 stage was 78 (71.56%) more than that in the M1 stage (10 (40.00%)). Among the image features, the value of low gray-level emphasis extracted from PET in M1 (0.30 (0.23, 0.33)) was greater than the value in M0 (0.18 (0.07, 0.32)).

3.2. Development and Visualization of the Prediction Model

Demographic data (age, history of smoking, and gender) were included in the three prediction models. In the CT-related random forest model, we included CT image features (first-order 10 percent, first-order robust mean absolute deviation, GLCM joint average, and NGTDM strength) and demographic data; GLDM low gray-level emphasis, NGTDM strength, and demographic data were included in the PET-related random forest model. CT-PET image features were included in the CT-PET random forest model. Additionally, we also established a random forest model by combining CT-PET image features with demographic data.

The performance of random forest models in the training set and testing set is shown in Table 2. The area under the curve (AUC) of the CT-PET demographic data model was 0.923 (95% CI: 0.873–0.973) in the training set, which was higher than that of the CT demographic data model (0.880, 95% CI: 0.807–0.953), PET demographic data model (0.917, 95% CI: 0.865–0.969), and CT-PET model (0.904, 95% CI: 0.850–0.959). Similar results were observed in the testing set. These results also indicated that CT-PET combining demographic data was the best model to predict the M stage among the four prediction models established by using the random forest. The ROC curves and the confusion matrix of four models are shown in Figures 3 and 4, respectively. Furthermore, Figure 5 also depicts the variable importance of features for the random forest model of CT PET-demographic data. GLDM low gray-level emphasis, which was extracted from PET, was the most important of the nine factors, followed by age and the history of smoking in demography.

4. Discussion

Lung cancer is still one of the leading causes of cancer death worldwide, with distant metastasis accounting for the majority of deaths [15]. Not only that, early detection of distant metastases in lung cancer patients could provide an effective basis for the formulation of clinical treatment, which is also the focus of current clinical research [16]. In the present study, we aimed at developing a random forest model to diagnose distant metastases in lung cancer patients by combining the characteristics of CT-PET images with demographic data. The performance of this prediction model was internally validated at the same time. Our results indicated that the random forest model created by combining CT-PET images and demographic data was effective in predicting distant metastases in lung cancer patients. Age, history of smoking, gender, first-order 10 percent, first-order robust mean absolute deviation, GLCM joint average, NGTDM strength (CT), GLDM low gray-level emphasis, and NGTDM strength (PET) were important factors for predicting distant metastases in lung cancer patients.

In recent years, with the rapid development of imaging technology, CT, PET, and PET/CT examinations have been gradually applied to the diagnosis of malignant tumors, which can provide more information related to anatomical structure and tissue metabolism, and have higher value in the qualitative diagnosis of lesions [17–19]. Despite the fact that CT examination could intuitively reflect the morphological characteristics of lesions and carry out accurate anatomical positioning, it has great limitations in diagnosing distant metastases in patients based on morphology [20]. Several studies have pointed out that PET/CT, as a tool that can effectively integrate anatomical, morphological, and biological information of lesions, has gradually become widely used in clinical practice [21, 22]. In the study by Yu et al., they confirmed that ¹⁸F-FDG PET/CT has a good diagnostic performance for distant metastasis staging in patients with non-small-cell lung cancer (NSCLC) at initial staging [23]. More importantly, some demographic data were also considered, as this could influence the morbidity and distant metastases of lung cancer.

In this study, we extracted the characteristics of CT images (first-order 10 percent, first-order robust mean absolute deviation, GLCM joint average, and NGTDM strength) and PET images (GLDM low gray-level emphasis and NGTDM strength) and collected the patients’ demographic data (age, history of smoking, and gender). Thus, we constructed four prediction models: combining CT image features and demographic data; combining PET image features and demographic data; combining CT and PET image features; and combining CT image features, PET image features, and demographic data. Through ROC curve analysis, we found that the model combining CT and PET image features and demographic data may have a better predictive performance in predicting distant metastases in lung cancer patients than those models combining CT image features and demographic data, combining PET image features and demographic data, and combining CT and PET image features. Previous studies have revealed that age, history of smoking, and gender are associated with the distant metastasis risk of lung cancer patients [24, 25]. In a study examining the effects of smoking on brain metastases in lung cancer patients, Wu et al. showed that the incidence of brain metastases was significantly higher in smokers than in those who had never smoked [26]. The potential reason was that nicotine, as the main cigarette ingredient, might promote brain metastases by distorting the polarity of M2 microglia, which in turn accelerates the growth of metastatic tumors. Our results were consistent with those of previous research studies, in which the variable importance of features in the random forest model showed that age, gender, and history of smoking in demography were the important risk factors. To the best of our knowledge, this is the first study to assess the value of CT-PET imaging combined with demographic data for diagnosis of distant metastases in lung cancer patients. We believed that the finding could provide clinicians with more convenience in diagnosing distant metastases of lung cancer and making personalized treatment strategies.

The study has several limitations. First, the study had a relatively small sample size, which might have limited statistical power. Second, owing to all patients’ information being derived from the TCGA-LUAD, lung PET-CT, LSCC, and CPTAC-LUAD datasets, we did not collect data on the race and types of lung cancer, which might be associated with the distant metastases of lung cancer [27]. More research studies are needed to explore this association. Third, there was no external validation, and larger datasets are needed to further confirm our findings.

5. Conclusion

In conclusion, our study displayed that the random forest model created by combining CT-PET image features and demographic data could have great performance in predicting distant metastases in lung cancer patients. The developed model may provide supplementary guidance for clinicians in the choice of therapeutic strategies and personalized monitoring for lung cancer patients.

Data Availability

The data utilized to support the findings are available from the corresponding authors upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this article.

Supplementary Materials

Supplementary Table 1: missing value filling and sensitivity analysis. Supplementary Table 2: balance test. (Supplementary Materials)

References

A. A. Thai, B. J. Solomon, L. V. Sequist, J. F. Gainor, and R. S. Heist, “Lung cancer,” The Lancet, vol. 398, no. 10299, pp. 535–554, 2021.
View at: Publisher Site | Google Scholar
G. Bergers and S. M. Fendt, “The metabolism of cancer cells during metastasis,” Nature Reviews Cancer, vol. 21, no. 3, pp. 162–180, 2021.
View at: Publisher Site | Google Scholar
L. Jin, B. Han, E. Siegel, Y. Cui, A. Giuliano, and X. Cui, “Breast cancer lung metastasis: molecular biology and therapeutic implications,” Cancer Biology & Therapy, vol. 19, no. 10, pp. 858–868, 2018.
View at: Publisher Site | Google Scholar
H. Zhou, D. Dong, B. Chen et al., “Diagnosis of distant metastasis of lung cancer: based on clinical and radiomic features,” Translational Oncology, vol. 11, no. 1, pp. 31–36, 2018.
View at: Publisher Site | Google Scholar
J. Li, W. Xu, F. Kong, X. Sun, and X. Zuo, “Meta-analysis: accuracy of 18FDG PET-CT for distant metastasis staging in lung cancer patients,” Surgical Oncology, vol. 22, no. 3, pp. 151–155, 2013.
View at: Publisher Site | Google Scholar
Y. Ohno, T. Yoshikawa, Y. Kishida et al., “Diagnostic performance of different imaging modalities in the assessment of distant metastasis and local recurrence of tumor in patients with non-small cell lung cancer,” Journal of Magnetic Resonance Imaging, vol. 46, no. 6, pp. 1707–1717, 2017.
View at: Publisher Site | Google Scholar
W. Voigt, “Advanced PET imaging in oncology: status and developments with current and future relevance to lung cancer care,” Current Opinion in Oncology, vol. 30, no. 2, pp. 77–83, 2018.
View at: Publisher Site | Google Scholar
J. Wu, T. Aguilera, D. Shultz et al., “Early-stage non-small cell lung cancer: quantitative imaging characteristics of (18)F fluorodeoxyglucose PET/CT allow prediction of distant metastasis,” Radiology, vol. 281, no. 1, pp. 270–278, 2016.
View at: Publisher Site | Google Scholar
B. Al Mohammad, P. C. Brennan, and C. Mello-Thoms, “A review of lung cancer screening and the role of computer-aided detection,” Clinical Radiology, vol. 72, no. 6, pp. 433–442, 2017.
View at: Publisher Site | Google Scholar
Z. Lyu, N. Li, S. Chen et al., “Risk prediction model for lung cancer incorporating metabolic markers: development and internal validation in a Chinese population,” Cancer Medicine, vol. 9, no. 11, pp. 3983–3994, 2020.
View at: Publisher Site | Google Scholar
K. Ten Haaf, J. Jeon, M. C. Tammemägi et al., “Risk prediction models for selection of lung cancer screening candidates: a retrospective validation study,” PLoS Medicine, vol. 14, no. 4, Article ID e1002277, 2017.
View at: Publisher Site | Google Scholar
D. E. Smith, J. Fernandez Aramburu, A. Da Lozzo, J. A. Montagne, E. Beveraggi, and A. Dietrich, “Accuracy of positron emission tomography and computed tomography (PET/CT) in detecting nodal metastasis according to histology of non-small cell lung cancer,” Updates Surg, vol. 71, no. 4, pp. 741–746, 2019.
View at: Publisher Site | Google Scholar
Y. Han, Y. Ma, Z. Wu et al., “Histologic subtype classification of non-small cell lung cancer using PET/CT images,” European Journal of Nuclear Medicine and Molecular Imaging, vol. 48, no. 2, pp. 350–360, 2021.
View at: Publisher Site | Google Scholar
A. Teramoto, A. Yamada, T. Tsukamoto et al., “Decision support system for lung cancer using PET/CT and microscopic images,” Advances in Experimental Medicine & Biology, vol. 1213, pp. 73–94, 2020.
View at: Publisher Site | Google Scholar
S. Blandin Knight, P. A. Crosbie, H. Balata, J. Chudziak, T. Hussell, and C. Dive, “Progress and prospects of early detection in lung cancer,” Open Biol, vol. 7, no. 9, Article ID 170070, 2017.
View at: Publisher Site | Google Scholar
W. C. Lee, A. Reuben, X. Hu et al., “Multiomics profiling of primary lung cancers and distant metastases reveals immunosuppression as a common characteristic of tumor cells with metastatic plasticity,” Genome Biology, vol. 21, no. 1, p. 271, 2020.
View at: Publisher Site | Google Scholar
Z. Wang, Q. Qu, K. Cai, and T. Xu, “CT image examination based on virtual reality analysis in clinical diagnosis of gastrointestinal stromal tumors,” Journal of Healthcare Engineering, vol. 2021, Article ID 9996565, 10 pages, 2021.
View at: Publisher Site | Google Scholar
J. M. Werner, P. Lohmann, G. R. Fink, K. J. Langen, and N. Galldiks, “Current landscape and emerging fields of PET imaging in patients with brain tumors,” Molecules, vol. 25, no. 6, p. 1471, 2020.
View at: Publisher Site | Google Scholar
F. Li, J. Hu, H. Jiang, and Y. Sun, “Diagnosis of lymph node metastasis on rectal cancer by PET-CT computer imaging combined with MRI technology,” Journal of Infection and Public Health, vol. 13, no. 9, pp. 1347–1353, 2020.
View at: Publisher Site | Google Scholar
S. Sheikhbahaei, E. Mena, A. Yanamadala et al., “The value of FDG PET/CT in treatment response assessment, follow-up, and surveillance of lung cancer,” American Journal of Roentgenology, vol. 208, no. 2, pp. 420–433, 2017.
View at: Publisher Site | Google Scholar
D. Dudoignon, D. A. Pattison, D. Legallois, R. J. Hicks, and N. Aide, “The utility of pharmacological and radiological interventions to optimize diagnostic information from PET/CT,” Cancer Imaging, vol. 20, no. 1, p. 68, 2020.
View at: Publisher Site | Google Scholar
R. Fonti, M. Conson, and S. Del Vecchio, “PET/CT in radiation oncology,” Seminars in Oncology, vol. 46, no. 3, pp. 202–209, 2019.
View at: Publisher Site | Google Scholar
B. Yu, X. Zhu, Z. Liang, Y. Sun, W. Zhao, and K. Chen, “Clinical usefulness of ¹⁸F-FDG PET/CT for the detection of distant metastases in patients with non-small cell lung cancer at initial staging: a meta-analysis,” Cancer Management and Research, vol. 10, pp. 1859–1864, 2018.
View at: Publisher Site | Google Scholar
H. Shen, G. Deng, Q. Chen, and J. Qian, “The incidence, risk factors and predictive nomograms for early death of lung cancer with synchronous brain metastasis: a retrospective study in the SEER database,” BMC Cancer, vol. 21, no. 1, p. 825, 2021.
View at: Publisher Site | Google Scholar
B. Wang, S. Chen, H. Xiao et al., “Analysis of risk factors and gene mutation characteristics of different metastatic sites of lung cancer,” Cancer Medicine, vol. 11, no. 1, pp. 268–280, 2022.
View at: Publisher Site | Google Scholar
S. Y. Wu, F. Xing, S. Sharma et al., “Nicotine promotes brain metastasis by polarizing microglia and suppressing innate immune function,” Journal of Experimental Medicine, vol. 217, no. 8, Article ID e20191131, 2020.
View at: Publisher Site | Google Scholar
P. de Groot and R. F. Munden, “Lung cancer epidemiology, risk factors, and prevention,” Radiologic Clinics of North America, vol. 50, no. 5, pp. 863–876, 2012.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 Lijun Bi and Yi Guo. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

345

Downloads

441

Citations