Evaluating Radiomics Research Reporting Assessment Tools to Improve Quality and Generalizability

As computational capabilities in healthcare continue to advance, the realm of texture analysis within medical imaging, known as radiomics, offers a promising avenue for uncovering novel imaging biomarkers aiding precision medicine [1].
Nevertheless, clinical translation faces significant hurdles, primarily stemming from the heterogeneity of research questions and inconsistent quality of radiomics reporting, leading to a scarcity of studies that are comparable, reproducible, or generalizable [2]. This challenge is exemplified in our systematic review focusing on radiomics biomarkers in post-radiation stage III/ IV non-small cell lung cancer [3].

Among the commonly utilized tools for radiomics assessment are the well-established Radiomics Quality Score (RQS) [4] and the CheckList for EvaluAtion of Radiomics (CLEAR) frameworks [5]. In our investigation, we amalgamated these frameworks into a singular comprehensive checklist, denoted as CLEAR-RQS, aiming to enhance standardization and clarity. However, our evaluation of RQS, CLEAR, and CLEAR-RQS unveiled significant variability in radiomics reporting quality, resulting in notable disparities in article rankings.
A recent addition to the landscape is the METRICS (METhodological RadiomICs Score) framework, developed by an international panel through Delphi consensus and endorsed by the European Society of Medical Imaging Informatics (EuSoMII) [6]. This newly introduced scoring tool holds promise as an enhanced approach to assessing radiomics methodologies.

The existence of multiple frameworks catering to radiomics researchers and educators instills optimism for expediting the translation of radiomics into clinical practice by offering avenues for refining methodologies, developing standardization, and fostering collaboration, all essential for driving progress and ultimately leading to improved patient outcomes.

  1. Limkin, E.J., et al., Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology. Annals of Oncology, 2017. 28(6): p. 1191-1206.
  2. Malcolm, J.A., et al., Current state of radiomic research in pancreatic cancer: focusing on study design and reproducibility of findings. Eur Radiol, 2023. 33(10): p. 6659-6669.
  3. Tran, K., et al., Post-radiotherapy stage III/IV non-small cell lung cancer radiomics research: a systematic review and comparison of CLEAR and RQS frameworks. Eur Radiol, 2024.
  4. Lambin, P., et al., Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol, 2017. 14(12): p. 749-762.
  5. Kocak, B., et al., CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII. Insights Imaging, 2023. 14(1): p. 75.
  6. Kocak, B., et al., METhodological RadiomICs Score (METRICS): a quality scoring tool for radiomics research endorsed by EuSoMII. Insights into Imaging, 2024. 15(1): p. 8.

Key points:

  • There is heterogenous and low radiomics research quality in postradiotherapy stage III/IV nonsmall cell lung cancer.
  • Barriers to reproducibility are small cohort size, nonvalidated studies, missing technical parameters, and lack of data, code, and model sharing.
  • CLEAR (CheckList_for_EvaluAtion_of_Radiomics_research), RQS (Radiomics_Quality_Score), and the amalgamated CLEAR-RQS tool are useful frameworks for assessing radiomics research quality and may provide a valuable resource for educational purposes in the field of radiomics.

Article: Post-radiotherapy stage III/IV non-small cell lung cancer radiomics research: a systematic review and comparison of CLEAR and RQS frameworks

Authors: Kevin Tran, Daniel Ginzburg, Wei Hong, Ulrike Attenberger & Hyun Soo Ko

WRITTEN BY

  • Hyun Soo Ko

    Department of Cancer Imaging, The Peter MacCallum Cancer Centre, Melbourne, Australia The Sir Peter MacCallum Department of Oncology, The University of Melbourne, Melbourne, Australia Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany

  • Kevin Tran

    Department of Cancer Imaging, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia; Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, VIC, Australia

Latest posts

Become A Member Today!

You will have access to a wide range of benefits that can help you advance your career and stay up-to-date with the latest developments in the field of radiology. These benefits include access to educational resources, networking opportunities with other professionals in the field, opportunities to participate in research projects and clinical trials, and access to the latest technologies and techniques. 

Check out our different membership options.

If you don’t find a fitting membership send us an email here.

Membership

for radiologists, radiology residents, professionals of allied sciences (including radiographers/radiological technologists, nuclear medicine physicians, medical physicists, and data scientists) & professionals of allied sciences in training residing within the boundaries of Europe

  • Reduced registration fees for ECR 1
  • Reduced fees for the European School of Radiology (ESOR) 2
  • Option to participate in the European Diploma. 3
  • Free electronic access to the journal European Radiology 4
  • Content e-mails for all ESR journals
  • Updates on offers & events through our newsletters
  • Exclusive access to the ESR feed in Juisci

€ 11 /year

Yes! That is less than €1 per month.

Free membership

for radiologists, radiology residents or professionals of allied sciences engaged in practice, teaching or research residing outside Europe as well as individual qualified professionals with an interest in radiology and medical imaging who do not fulfil individual or all requirements for any other ESR membership category & former full members who have retired from all clinical practice
  • Reduced registration fees for ECR 1
  • Option to participate in the European Diploma. 3
  • Free electronic access to the journal European Radiology
  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters
  • Exclusive access to the ESR feed in Juisci

€ 0

The best things in life are free.

ESR Friends

For students, company representatives or hospital managers etc.

  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters

€ 0

Friendship doesn’t cost a thing.

The membership type best fitting for you will be selected automatically during the application process.

Footnotes:

01

Reduced registration fees for ECR 2025:
Provided that ESR 2024 membership is activated and approved by August 31, 2024.

02
Not all activities included
03
Examination based on the ESR European Training Curriculum (radiologists or radiology residents).
04
European Radiology, Insights into Imaging, European Radiology Experimental.