12,637 papers · updated 18 Sept 2026livingmeta.ai
← Browse all papers
AI evidence extraction

AiraXiv: An AI-Driven Open-Access Platform for Human and AI Scientists

Junshu Pan, Panzhong Lu, Yixuan Weng, Qiyao Sun, Fang Guo, Zijie Yang et al. · ArXiv.org · 2026

AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.

9/10
Relevance
D
Evidence
0
Citations
0.00
FWCI

Methodology & findings

Study design

Real-world deployment and case study evaluation.

Primary method

Design science research with real-world deployment validation; iterative platform development integrating user feedback from ICAIS 2025 deployment

Main result

AiraXiv successfully enabled rapid feedback and quality evolution in its deployment as the official infrastructure for ICAIS 2025. The platform "reduced the traditional 9-month conference cycle to 1.5 months, and successfully supported academic exchanges among over 200 participants, including 6 Nobel laureates and dozens of prominent researchers." Furthermore, "accepted and rejected papers by human experts exhibit a clear separation in AI scores, with accepted papers achieving higher median scores (>4.5) and rejected papers clustering around a median of approximately 3.0," and "resubmitted versions of manuscripts generally achieved higher median AI scores compared to initial submissions, suggesting that authors were able to effectively interpret and act upon the automated feedback to refine their work."

Research paradigm

Design science / socio-technical systems research

Author conclusions

"We introduced AiraXiv, an AI-driven, open-access preprint platform for iterative scholarly communication by both human and AI scientists." The authors conclude that "These results suggest that AI-assisted, community-feedback publishing can reduce review bottlenecks, accelerate iteration, and broaden valuable scientific outputs," and they "hope AiraXiv serves as a foundation for an open, fast, and inclusive scientific ecosystem in the AI era, while continuing to evolve through future community participation, system extension, and broader research collaboration."

Risk of bias

Potential bias from limited deployment scope (single conference); AI reviewer bias across domains; vulnerability to adversarial feedback; selection bias toward AI-generated papers in submission landscape.; Limited deployment scope: Only one real-world deployment (ICAIS 2025) conducted; generalizability unclear; Selection bias: Conference participants (200+) may not represent broader research community; Potential model overconfidence and hallucination in reviews; Self-selection bias of authors submitting to novel platform

Limitations

  • The authors state that "AI-assisted reviewing signals in our work are imperfect and may be biased or unstable across domains, which can mislead readers if interpreted as final judgments." Additionally, "the end-to-end author-reader feedback loop may be vulnerable to low-quality, adversarial, or coordinated feedback, which requires robust moderation and abuse prevention mechanisms." Finally, "we have only validated AiraXiv in limited real-world deployments, and broader evidence is needed to understand long-term community dynamics, incentive alignment, and the generalization of our work."

Open questions raised

  • The authors identify the need for:
  • scaling across diverse fields
  • strengthening governance and auditability
  • defending against adversarial content
  • understanding long-term community dynamics and incentive alignment
  • improving AI review quality and inference efficiency
Code: https://airaxiv.comExtracted from: pdf

Explore related topics

Scholarly PublishingScholarly InfrastructureDesign Science

Related papers

← Browse all papers