AI evidence extraction

CycleResearcher: Improving Automated Research via Automated Review

Yixuan Weng, Minjun Zhu, Guangsheng Bao, Hongbo Zhang, Jindong Wang, Yue Zhang et al. · arXiv (Cornell University) · 2024

AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.

9/10

Relevance

2/4

Quality (LMQS)

Evidence

Citations

This is an AI analysis. Read the peer-reviewed original at the publisher: https://doi.org/10.48550/arxiv.2411.00816

Methodology & findings

Study design

Mixed-methods: (1) Dataset construction from ICLR 2024 papers and accepted papers from major ML conferences (ICLR, NeurIPS, ICML, ACL, EMNLP, CVPR, ICCV); (2) Supervised fine-tuning of open-source LLMs (Mistral-Nemo-12B, Qwen2.5-Instruct-72B, Mistral-Large-2 123B) on Review-5k and Research-14k datasets; (3) Iterative reinforcement learning using Simple Preference Optimization (SimPO); (4) Automated evaluation using proxy mean absolute error (MAE) and decision accuracy metrics; (5) Human evaluation by three NLP experts with publication records; (6) Rejection sampling analysis..

Sample

N = 5691, 14 groups

Primary method

Proxy Mean Absolute Error (Proxy MAE) and Proxy Mean Squared Error (Proxy MSE) for evaluation; Unbiased estimator approach: r'_i = mean(R \\ r_i); SimPO (Simple Preference Optimization) for policy model training; DPO (Direct Preference Optimization) framework; Reinforcement learning with preference-pair dataset construction; Supervised fine-tuning on structured datasets; Rejection sampling for output selection; Random sampling with temperature 0.4 for generation; Accuracy and Macro F1 metrics for decision accuracy; Detection performance metrics: Accuracy and F1 Score

Main result

The study demonstrates that "CycleReviewer achieves promising performance with a 26.89% reduction in mean absolute error (MAE) compared to individual human reviewers in predicting paper scores." Additionally, "the papers generated by the CycleResearcher model achieved a score of 5.36 in simulated peer reviews, showing some competitiveness in terms of simulated review scores compared to the preprint level of 5.24 from human experts, while still having room for improvement compared to the accepted paper level of 5.69."

Reports effect sizes.

Research paradigm

Positivist/Empiricist - computational validation of AI model performance through quantitative metrics and human evaluation

Author conclusions

The authors conclude: "Our results demonstrate that CycleReviewer achieves promising performance with a 26.89% reduction in mean absolute error (MAE) compared to individual human reviewers in predicting paper scores, indicating the potential of LLMs to effectively assist expert-level research evaluation." They further state: "This work represents a significant step toward fully automated scientific inquiry, providing ethical safeguards and exploring AI-driven research capabilities." Regarding CycleResearcher, they note that "the papers generated by the CycleResearcher model achieved a score of 5.36 in simulated peer reviews, showing some competitiveness in terms of simulated review scores compared to the preprint level of 5.24 from human experts, while still having room for improvement."

Risk of bias

Fabricated experimental results rather than genuine empirical data; Limited domain generalization beyond machine learning papers; Human evaluation limited to 3 experts with potential selection bias; Training data from specific conferences (ICLR, ICML, NeurIPS, ACL, EMNLP, CVPR, ICCV) may not represent all research domains; Potential circular evaluation bias: CycleReviewer trained on human reviews then used to evaluate CycleResearcher output; Fabricated experimental results rather than real empirical data; Limited to machine learning domain papers only (generalizability risk); Training data sourced from single conference (ICLR 2024) for reviews; Small human evaluation sample (3 experts, 20 papers each); Proxy evaluation metrics rely on human reviewers as ground truth, but human reviewers themselves have disagreement; Temporal distribution of test set (chronologically later papers) may not fully capture generalization; Potential selection bias in papers available on ArXiv with LaTeX files; Dataset bias: Review-5k and Research-14k drawn primarily from machine learning conferences (ICLR, ICML, NeurIPS, ACL, EMNLP, CVPR, ICCV) with potential domain-specific biases; Evaluation metric bias: Proxy MAE/MSE approach may not capture full complexity of expert review; Selection bias: Human evaluators (3 NLP experts) selected based on research interests, potentially limiting diversity; Fabricated experimental results introduce artificial outcomes not representative of real research; Small human evaluation sample: Only 20 papers evaluated (10 per model) by 3 experts; Temporal bias: Test set constructed chronologically, may not reflect broader generalization

Limitations

The authors acknowledge that "the generalizability across research domains remains a challenge for current LLMs." Additionally, they state: "In the virtual RL environment, to accelerate training, we require the experimental results to be fabricated instead of conducting actual experiments," indicating that "the experimental results generated by CycleResearcher in this work are fabricated and do not represent real experimental data." The human evaluation revealed that "CycleResearcher's performance still remained below the average scores for both ICLR 2024 submissions (5.54) and accepted papers (6.44), suggesting room for further improvement."

Open questions raised

Full automation of actual experiment execution rather than fabricated results
Generalization across diverse research domains beyond machine learning
Improvement to match accepted paper quality standards (current 5.36 vs. accepted 5.69)
Integration of more complex reasoning and mathematical calculations in generated papers
Cross-domain research automation capabilities
Generalizability across research domains beyond machine learning

Data: Review-5k; Research-14k; Review-5k: 4,991 papers from ICLR 2024 with reviews (4,189 training, 782 testing); Research-14k: 12,696 training and 802 test samples from accepted papers from ICLR, NeurIPS, ICML, ACL, EMNLP, CVPR, ICCV (2022-2024); Available at: https://wengsyx.github.io/Researcher/Code: CycleResearcher; GitHub (implied): https://wengsyx.github.io/Researcher/; Code, dataset, and model weights available at: https://wengsyx.github.io/Researcher/Extracted from: pdfAgreement 52%

Explore related topics

Systematic Review Automation Literature Discovery Experimental