Quality assessment of the MRI-radiomics studies for MGMT promoter methylation prediction in glioma: a systematic review and meta-analysis.

Saved in:
Bibliographic Details
Title: Quality assessment of the MRI-radiomics studies for MGMT promoter methylation prediction in glioma: a systematic review and meta-analysis.
Authors: Doniselli, Fabio M.1,2 (AUTHOR), Pascuzzo, Riccardo1 (AUTHOR) riccardo.pascuzzo@istituto-besta.it, Mazzi, Federica1 (AUTHOR), Padelli, Francesco1 (AUTHOR), Moscatelli, Marco1 (AUTHOR), Akinci D'Antonoli, Tugba3 (AUTHOR), Cuocolo, Renato4 (AUTHOR), Aquino, Domenico1 (AUTHOR), Cuccarini, Valeria1 (AUTHOR), Sconfienza, Luca Maria2,5 (AUTHOR)
Source: European Radiology. Sep2024, Vol. 34 Issue 9, p5802-5815. 14p.
Subjects: O6-Methylguanine-DNA Methyltransferase, Magnetic resonance imaging, Decision making, Radiomics, Methyltransferases
Abstract: Objectives: To evaluate the methodological quality and diagnostic accuracy of MRI-based radiomic studies predicting O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status in gliomas. Methods: PubMed Medline, EMBASE, and Web of Science were searched to identify MRI-based radiomic studies on MGMT methylation in gliomas published until December 31, 2022. Three raters evaluated the study methodological quality with Radiomics Quality Score (RQS, 16 components) and Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis Or Diagnosis (TRIPOD, 22 items) scales. Risk of bias and applicability concerns were assessed with QUADAS-2 tool. A meta-analysis was performed to estimate the pooled area under the curve (AUC) and to assess inter-study heterogeneity. Results: We included 26 studies, published from 2016. The median RQS total score was 8 out of 36 (22%, range 8–44%). Thirteen studies performed external validation. All studies reported AUC or accuracy, but only 4 (15%) performed calibration and decision curve analysis. No studies performed phantom analysis, cost-effectiveness analysis, and prospective validation. The overall TRIPOD adherence score was between 50% and 70% in 16 studies and below 50% in 10 studies. The pooled AUC was 0.78 (95% CI, 0.73–0.83, I2 = 94.1%) with a high inter-study heterogeneity. Studies with external validation and including only WHO-grade IV gliomas had significantly lower AUC values (0.65; 95% CI, 0.57–0.73, p < 0.01). Conclusions: Study RQS and adherence to TRIPOD guidelines was generally low. Radiomic prediction of MGMT methylation status showed great heterogeneity of results and lower performances in grade IV gliomas, which hinders its current implementation in clinical practice. Clinical relevance statement: MGMT promoter methylation status appears to be variably correlated with MRI radiomic features; radiomic models are not sufficiently robust to be integrated into clinical practice to accurately predict MGMT promoter methylation status in patients with glioma before surgery. Key Points: • Adherence to the indications of TRIPOD guidelines was generally low, as was RQS total score. • MGMT promoter methylation status prediction with MRI radiomic features provided heterogeneous diagnostic accuracy results across studies. • Studies that included grade IV glioma only and performed external validation had significantly lower diagnostic accuracy than others. [ABSTRACT FROM AUTHOR]
Copyright of European Radiology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
Description
Abstract:Objectives: To evaluate the methodological quality and diagnostic accuracy of MRI-based radiomic studies predicting O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status in gliomas. Methods: PubMed Medline, EMBASE, and Web of Science were searched to identify MRI-based radiomic studies on MGMT methylation in gliomas published until December 31, 2022. Three raters evaluated the study methodological quality with Radiomics Quality Score (RQS, 16 components) and Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis Or Diagnosis (TRIPOD, 22 items) scales. Risk of bias and applicability concerns were assessed with QUADAS-2 tool. A meta-analysis was performed to estimate the pooled area under the curve (AUC) and to assess inter-study heterogeneity. Results: We included 26 studies, published from 2016. The median RQS total score was 8 out of 36 (22%, range 8–44%). Thirteen studies performed external validation. All studies reported AUC or accuracy, but only 4 (15%) performed calibration and decision curve analysis. No studies performed phantom analysis, cost-effectiveness analysis, and prospective validation. The overall TRIPOD adherence score was between 50% and 70% in 16 studies and below 50% in 10 studies. The pooled AUC was 0.78 (95% CI, 0.73–0.83, I2 = 94.1%) with a high inter-study heterogeneity. Studies with external validation and including only WHO-grade IV gliomas had significantly lower AUC values (0.65; 95% CI, 0.57–0.73, p < 0.01). Conclusions: Study RQS and adherence to TRIPOD guidelines was generally low. Radiomic prediction of MGMT methylation status showed great heterogeneity of results and lower performances in grade IV gliomas, which hinders its current implementation in clinical practice. Clinical relevance statement: MGMT promoter methylation status appears to be variably correlated with MRI radiomic features; radiomic models are not sufficiently robust to be integrated into clinical practice to accurately predict MGMT promoter methylation status in patients with glioma before surgery. Key Points: • Adherence to the indications of TRIPOD guidelines was generally low, as was RQS total score. • MGMT promoter methylation status prediction with MRI radiomic features provided heterogeneous diagnostic accuracy results across studies. • Studies that included grade IV glioma only and performed external validation had significantly lower diagnostic accuracy than others. [ABSTRACT FROM AUTHOR]
ISSN:09387994
DOI:10.1007/s00330-024-10594-x