A Knowledge Graph-Based RAG-GLLM Approach for LiteratureReview and Knowledge Discovery
Yancong Xie, Yuanyuan Song, Richard Watson · Journal of the Association for Information Systems · 2025
AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.
Methodology & findings
Study design
Research-in-progress using conceptual design, development planning, and early prototyping of a knowledge graph-based RAG-GLLM system for literature review automation
Main result
The proposed knowledge graph-based RAG-GLLM approach "combines structured knowledge representation with generative reasoning" and "provides persistent context, reduce[s] hallucination, and enable[s] analysis across five levels of literature review, from concepts to themes." The research presents early prototyping results demonstrating the feasibility of this methodological foundation for scholarly literature reviews.
Research paradigm
Design science / computational methodology
Author conclusions
The authors conclude that "our research-in-progress outlines the conceptual design, development plan, and early prototyping results, contributing a methodological foundation for scalable, reliable, and theory-informed literature reviews in Information Systems research."
Limitations
- The paper explicitly acknowledges that current RAG-GLLM applications "remain focused on fact retrieval rather than higher-level conceptual integration" and notes that GLLMs suffer from "hallucination, limited context windows, and weak evidential grounding" when applied to scholarly contexts
- The work is presented as research-in-progress with only early prototyping results, not yet fully validated.
Open questions raised
- The paper identifies that current RAG-GLLM applications remain focused on fact retrieval rather than higher-level conceptual integration, and that traditional and computational approaches are being pushed to their limits by the rapid growth of academic publications.
- The paper identifies the gap that current RAG applications are "focused on fact retrieval rather than higher-level conceptual integration" and addresses the challenge of conducting literature reviews given "the rapid growth of academic publications" that pushes "traditional and computational approaches to their limits."
- The paper identifies gaps in applying GLLMs to scholarly contexts: current RAG applications focus on fact retrieval rather than higher-level conceptual integration; there is a need for approaches that address hallucination, limited context windows, and weak evidential grounding in literature review processes.
Explore related topics
Related papers
- PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and ExplanationAndrea C. Tricco · 2018 · 40,391 citations
- Rayyan—a web and mobile app for systematic reviewsMourad Ouzzani · 2016 · 24,664 citations
- Cochrane Handbook for Systematic Reviews of Interventions2019 · 14,420 citations
- Guidance for conducting systematic scoping reviewsMicah D.J. Peters · 2015 · 7,472 citations
- Updated methodological guidance for the conduct of scoping reviewsMicah D.J. Peters · 2020 · 6,688 citations
- Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resourcesMichael Gusenbauer · 2019 · 2,116 citations