Human-AI Collaboration in Peer Review Manuscript
Advances in medical education, research, and ethics (AMERE) book series · 2024
AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.
This is an AI analysis. Read the peer-reviewed original at the publisher: https://doi.org/10.4018/979-8-3693-3828-5.ch003
Methodology & findings
Study design
Literature review examining the collaboration between human reviewers and AI in the academic peer review process
Main result
The review points out how "AI has the potential to enhance the efficiency of manuscript assessment and address challenges such as increasing submission volumes and a shortage of reviewers." Current AI tools support "tasks such as plagiarism detection, formatting checks, and initial quality control, while more complex tasks requiring human empathy and robust judgment remain challenging for AI."
Reports effect sizes.
Research paradigm
interpretivist
Author conclusions
The authors conclude that while "AI can potentially improve the speed and precision of the review process," it "also presents ethical and legal concerns, including biases, data privacy, and copyright issues." They emphasize that "These concerns require thorough examination and the development of comprehensive ethical guidelines."
Limitations
- The abstract indicates that "more complex tasks requiring human empathy and robust judgment remain challenging for AI" and that concerns about "biases, data privacy, and copyright issues" require "thorough examination and the development of comprehensive ethical guidelines," suggesting limitations in current AI capabilities and regulatory frameworks.
Open questions raised
- The need for comprehensive ethical guidelines addressing biases, data privacy, and copyright issues in AI-assisted peer review; the development of AI systems capable of handling complex tasks requiring human empathy and robust judgment.
- The paper identifies the need for comprehensive ethical guidelines addressing AI biases, data privacy concerns, and copyright issues in peer review processes.
- The development of comprehensive ethical guidelines for AI in peer review, and further exploration of how to balance AI efficiency gains with human judgment in complex manuscript assessment tasks.
Explore related topics
Related papers
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher · 2009 · 83,271 citations
- PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and ExplanationAndrea C. Tricco · 2018 · 40,391 citations
- Cochrane Handbook for Systematic Reviews of Interventions2019 · 14,420 citations
- PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviewsMatthew J. Page · 2021 · 10,956 citations
- Updated methodological guidance for the conduct of scoping reviewsMicah D.J. Peters · 2020 · 6,688 citations
- What Is the Impact of ChatGPT on Education? A Rapid Review of the LiteratureChung Kwan Lo · 2023 · 1,725 citations