← Browse all papers
Research theme
AI Peer Review
The AI Peer Review theme comprises 266 papers in this corpus published between 1981 and 2026. Work here is dominated by Empirical Study, Experimental, Design Science. 5 open research gaps have been surfaced in this area.
Methodology profile
- Empirical Study45 (17%)
- Experimental33 (12%)
- Design Science29 (11%)
- Position Paper29 (11%)
- Literature Review26 (10%)
- Case Study22 (8%)
Research domains
- Peer Review262 (98%)
- Academic Writing2 (1%)
- Human-AI Collaboration1 (0%)
- Research Integrity1 (0%)
Frequent sub-topics
evaluative misalignment in LLM-assisted policy analysis and qualitative coding · 1LLM-based reviewer matching using deep retrieval and deep thinking with information-gain rewards · 1peer review challenges and AI integration in Latin American publishing · 1LLM clinical decision support in oncology multidisciplinary tumor boards · 1LLM-radiologist collaboration in medical reporting · 1ChatGPT evaluation of student essays compared to human assessment · 1RAG-based evidence assessment for peer review · 1bias in LLM-assisted peer review · 1
Open research gaps
- The authors identify several gaps: limited integration of disparate simulation models, lack of comparisons between different modeling approaches, rare empirical testing of model predictions, and the n
- The paper identifies the need for further development and validation of AI systems for automating peer reviews, exploration of practical implementation challenges, and analysis of the implications for
- Need for access to historical review data prior to 2021 from NeurIPS and ARR to establish longer-term trends
- Expansion to non-English languages and scientific domains beyond computer science/machine learning
- Development of additional review quality measurements beyond substantiveness, actionability, and grounding (e.g., relationships between reviews and papers, alignment between review texts and scores, f
Representative papers
- AI-assisted peer reviewAlessandro Checco · 2021 · 261 citations
- Fighting reviewer fatigue or amplifying bias? Considerations and recommendations for use of ChatGPT and other large language models in scholarly peer reviewMohammad Hosseini · 2023 · 209 citations
- Artificial intelligence to support publishing and peer review: A summary and reviewKayvan Kousha · 2023 · 137 citations
- Ethical Dilemmas in Using AI for Academic Writing and an Example Framework for Peer Review in Nephrology Academia: A Narrative ReviewJing Miao · 2023 · 93 citations
- Artificial Intelligence in Peer Review: Enhancing Efficiency While Preserving IntegrityBohdana Doskaliuk · 2025 · 59 citations
- Death of a reviewer or death of peer review integrity? the challenges of using AI tools in peer reviewing and the need to go beyond publishing policiesVasiliki Mollaki · 2024 · 53 citations
- Human-in-the-Loop AI Reviewing: Feasibility, Opportunities, and RisksIddo Drori · 2024 · 38 citations
- Peer Review in the Age of Generative AIAtreyi Kankanhalli · 2024 · 37 citations