Article In: dblp

PROMPTHEUS: a human-centered pipeline to streamline Systematic Literature Reviews with Large Language Models

Information

João Pedro Fernandes Torres; Catherine Mulligan; Catarina Moreira — 2024 — MDPI

Key information

Authors:

João Pedro Fernandes Torres; Catherine Mulligan; Joaquim Jorge (Joaquim Armando Pires Jorge); Catarina Moreira

Published in

2024

Abstract

The growing volume of academic publications poses significant challenges for researchers conducting timely and accurate systematic literature reviews (SLR), particularly in fast-evolving fields like artificial intelligence. This growth of academic literature also makes it increasingly difficult for lay people to access scientific knowledge effectively, meaning academic literature is often misrepresented in the popular press and, more broadly, in society. Traditional SLRs are labor-intensive and error-prone, and they struggle to keep up with the rapid pace of new research. To address these issues, we developed PROMPTHEUS: an AI-driven pipeline solution that automates the systematic literature review (LR) process using large language models (LLMs). We aimed to enhance efficiency by reducing the manual workload while maintaining the precision and coherence required for comprehensive literature synthesis. PROMPTHEUS automates key SLR stages, including systematic searches, data extraction, and topic modeling using BERTopic and summarization with transformer models. Evaluations across five research domains demonstrated that PROMPTHEUS reduces review time, achieves high precision, and provides coherent topic organization, offering a scalable and effective solution for conducting literature reviews in an increasingly crowded research landscape.

Publication details

Authors in the community:

Publisher

MDPI

Link to the publisher's version

https://www.mdpi.com/2078-2489/16/5/420

Title of the publication container

Information

Volume

16

Issue

5

Fields of Science and Technology (FOS)

electrical-engineering-electronic-engineering-information-engineering - Electrical engineering, electronic engineering, information engineering

Keywords

  • systematic literature review
  • automatic literature reviews
  • topic modeling
  • large language models

Publication language (ISO code)

eng - English

Rights type:

Open access