Radiology artificial intelligence, a systematic evaluation of methods (RAISE): a systematic review protocol

The review was prospectively registered on PROSPERO and adheres to the PRISMA protocols. We decided to undertake the systematic review because while there is huge hype around potential clinical applications of artificial intelligence (AI) in radiology, there is a chasm between the promise and the implementation. We also felt that many papers in the field deal with a narrow range of use cases and apply a narrow pallet of AI techniques to these use cases.

There will, however, be limitations to the paper, including a wide variety of papers will make the data too heterogeneous to perform a meta-analysis and a large number of included papers will only allow for a high-level overview.

It was our opinion that many of the AI in radiology papers are varied in quality and that while reporting systems for AI studies are now being developed, few methodological systematic reviews dealing with the scientific methods applied actually exist. Many narrative reviews have the potential for bias, we hoped to minimise this risk by publishing our protocol. Furthermore, we are doing two “sister” reviews of the paediatric and adult literature; the paediatric paper is about to be submitted for peer review with the adult paper soon behind. We also have made our search terms and the questions used for extraction available so other researchers can build on our findings.

The main goal of the paper is described in the conclusion:

We hope to raise awareness of among the radiology community of the questions being asked as well as the methods being used to answer them with the radiology AI literature and give an overview of techniques for those with an engineering or computer science background looking to contribute to the field.

Hopefully, readers will enjoy reading the protocol and the subsequent systematic reviews.

Key points

  • This study presents a comprehensive methodology for a systematic review of the current state of Radiology Artificial Intelligence.
  • Detailed characteristics of studies will be collected and analysed, including nature of task, disease, modality, subspecialty and data processing.
  • Subgroup analysis will be performed to highlight differences in design characteristics between task, subspecialty modality and for trends in algorithm use over time.

Article: Radiology artificial intelligence, a systematic evaluation of methods (RAISE): a systematic review protocol

Authors: Brendan Kelly, Conor Judge, Stephanie M. Bollard, Simon M. Clifford, Gerard M. Healy, Kristen W. Yeom, Aonghus Lawlor & Ronan P. Killeen


  • Brendan Kelly

    ICAT HRB/Wellcome Trust Academic Fellow/PhD Candidate, Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland Honorary Clinical Lecturer and Specialist Registrar in Radiology, St Vincent’s University Hospital, Dublin, Dublin, Ireland 2019/2020 Fulbright Scholar to Stanford University, California, USA

Latest posts

Become A Member Today!

You will have access to a wide range of benefits that can help you advance your career and stay up-to-date with the latest developments in the field of radiology. These benefits include access to educational resources, networking opportunities with other professionals in the field, opportunities to participate in research projects and clinical trials, and access to the latest technologies and techniques. 

Check out our different membership options.

If you don’t find a fitting membership send us an email here.


for radiologists, radiology residents, professionals of allied sciences (including radiographers/radiological technologists, nuclear medicine physicians, medical physicists, and data scientists) & professionals of allied sciences in training residing within the boundaries of Europe

  • Reduced registration fees for ECR 1
  • Reduced fees for the European School of Radiology (ESOR) 2
  • Exclusive option to participate in the European Diploma. 3
  • Free electronic access to the journal European Radiology 4
  • Content e-mails for all ESR journals
  • Updates on offers & events through our newsletters

€ 11 /year

Yes! That is less than €1 per month.

Free membership

for radiologists, radiology residents or professionals of allied sciences engaged in practice, teaching or research residing outside Europe as well as individual qualified professionals with an interest in radiology and medical imaging who do not fulfil individual or all requirements for any other ESR membership category & former full members who have retired from all clinical practice
  • Reduced registration fees for ECR 1
  • Free electronic access to the journal European Radiology
  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters

€ 0

The best things in life are free.

ESR Friends

For students, company representatives or hospital managers etc.

  • Content e-mails for all 3 ESR journals 4
  • Updates on offers & events through our newsletters

€ 0

Friendship doesn’t cost a thing.

The membership type best fitting for you will be selected automatically during the application process.



Reduced registration fees for ECR 2024:
Provided that ESR 2023 membership is activated and approved by August 31, 2023 (excl. "Members in Training Offer").

Reduced registration fees for ECR 2025:
Provided that ESR 2024 membership is activated and approved by August 31, 2024.

Not all activities included
Examination based on the ESR European Training Curriculum (radiologists or radiology residents).
European Radiology, Insights into Imaging, European Radiology Experimental.