EuSoMII Radiomics Auditing Group Initiative: Review of RQS applications

When the Radiomics Quality Score (RQS) was presented to the scientific community back in 2017, its authors aimed to introduce a tool for a rapid and effective evaluation of radiomics studies’ scientific/clinical merit. Conceived as a quality seal to be published alongside presented results and newly proposed radiomics models, the RQS has instead mostly been adopted by researchers as a scoring system to retrospectively evaluate the published literature (predominantly focused on specific radiomics applications). Working within the Radiomics Auditing Group Initiative (EuSoMII), we analyzed 44 of these topic-specific RQS-based systematic reviews to obtain a more comprehensive assessment of the literature and turn the spotlight onto the still open and pressing methodological challenges. Indeed, while the limitations of RQS must be acknowledged (e.g., unbalanced towards handcrafted radiomics, relatively low reproducibility, nonlinear scoring system), we also recognize that it has become the de facto standard for estimating the methodological quality of radiomics studies. As we looked at the evidence, we discovered that irrespective of which field of application (e.g., oncological vs. non-oncological, neuroimaging vs. body imaging), the overall methodological quality of radiomics studies is not satisfactory (with a median RQS of 21%). Some could argue that radiomics is still in its infancy; and at such a stage, exploratory and preliminary studies are somewhat expected to suffer from limitations, representing the lowest level of the evidence pyramid. While this view is partly shareable, we should remember that we are currently working on the premises upon which future studies will be designed. If the foundations are not sufficiently robust, it will be much harder to build a scientifically sound and reliable future for radiomics.

Key points

  • Radiomics is a promising high-throughput method that may generate novel imaging biomarkers to improve clinical decision-making process, but it is an inherently complex analysis and often lacks reproducibility and generalizability.
  • The Radiomics Quality Score serves a necessary role as the de facto reference tool for assessing radiomics studies.
  • External auditing of radiomics studies, in addition to the standard peer-review process, is valuable to highlight common limitations and provide insights to improve future study designs and practical applicability of the radiomics models.

Article: Systematic review of the radiomics quality score applications: an EuSoMII Radiomics Auditing Group Initiative

Authors: Gaia Spadarella, Arnaldo Stanzione, Tugba Akinci D’Antonoli, Anna Andreychenko, Salvatore Claudio Fanni, Lorenzo Ugga, Elmar Kotter & Renato Cuocolo


  • Arnaldo Stanzione

    Department of Advanced Biomedical Science, University of Naples “Federico II”, Naples, Italy

Latest posts

Become A Member Today!

You will have access to a wide range of benefits that can help you advance your career and stay up-to-date with the latest developments in the field of radiology. These benefits include access to educational resources, networking opportunities with other professionals in the field, opportunities to participate in research projects and clinical trials, and access to the latest technologies and techniques. 

Check out our different membership options.

If you don’t find a fitting membership send us an email here.


for radiologists, radiology residents, professionals of allied sciences (including radiographers/radiological technologists, nuclear medicine physicians, medical physicists, and data scientists) & professionals of allied sciences in training residing within the boundaries of Europe

  • Reduced registration fees for ECR 1
  • Reduced fees for the European School of Radiology (ESOR) 2
  • Option to participate in the European Diploma. 3
  • Free electronic access to the journal European Radiology 
  • Content e-mails for all ESR journals4
  • Updates on offers & events through our newsletters
  • Exclusive access to the ESR feed in Juisci

€ 11 /year

Yes! That is less than €1 per month.

Free membership

for radiologists, radiology residents or professionals of allied sciences engaged in practice, teaching or research residing outside Europe as well as individual qualified professionals with an interest in radiology and medical imaging who do not fulfil individual or all requirements for any other ESR membership category & former full members who have retired from all clinical practice
  • Reduced registration fees for ECR 1
  • Option to participate in the European Diploma. 3
  • Free electronic access to the journal European Radiology
  • Content e-mails for all ESR journals 4
  • Updates on offers & events through our newsletters
  • Exclusive access to the ESR feed in Juisci

€ 0

The best things in life are free.

ESR Friends

For students, company representatives or hospital managers etc.

  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters

€ 0

Friendship doesn’t cost a thing.

The membership type best fitting for you will be selected automatically during the application process.



Reduced registration fees for ECR 2025:
Provided that ESR 2024 membership is activated and approved by August 31, 2024.

Not all activities included
Examination based on the ESR European Training Curriculum (radiologists or radiology residents).
European Radiology, Insights into Imaging, European Radiology Experimental.