AI evidence extraction

The Future of Intelligent Tutoring Systems for Writing

Michelle Banawan, Reese Butterfuss, Karen S. Taylor, Katerina Christhilf, Claire Hsu, Connor O’Loughlin et al. · 2023

AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.

6/10

Relevance

2/4

Quality (LMQS)

Evidence

Citations

3.98

FWCI

Top 10%

Impact

This is an AI analysis. Read the peer-reviewed original at the publisher: https://doi.org/10.1007/978-3-031-36033-6_23

Methodology & findings

Study design

Narrative literature review with critical analysis of existing intelligent tutoring systems for writing.

Main result

The paper finds that "ITSs are automated learning platforms that simulate tutor-tutee interaction while providing detailed feedback, assessments, and personalized learning, often through content adaptation that leverages the tutees' strengths and addresses their specific needs." The chapter demonstrates that "when ITSs are designed such that their educational and theoretical anchors are clear and well-implemented in their components (i.e., domain, student, tutor, and interface models), writing instruction becomes more effective and results in the achievement of positive learning outcomes."

Research paradigm

Interpretivist/Design Science

Author conclusions

The authors conclude that "if the design of intelligent writing tools adheres to the underlying architecture of paradigmatic ITSs, writing instruction can become more personalized relative to the evolving context of the students." They further state that "incorporating intelligent tutoring principles within digital writing technologies has strong potential to improve performance for the learning and teaching of writing. In their present form, digital writing tools have yet to fully optimize the canonical and cutting-edge features of modern ITSs when it comes to AI-enabled domain, pedagogical, tutoring, and intelligent interface designs. Despite their known benefits, there is still untapped potential and much room for improvement to serve as an impetus for subsequent work in this area."

Risk of bias

Selection bias: Selective overview of writing tools rather than comprehensive systematic review; No quantitative synthesis or meta-analysis of effectiveness claims; Reliance on published literature without systematic quality assessment; Limited discussion of failed or ineffective ITS implementations for writing

Limitations

The authors state that "The scope of possible knowledge domains that might be integrated within writing ITSs is incredibly vast, and designing a complete domain model is nearly impossible." Additionally, they note that "ITSs, digital writing tools included, do not always lead to positive learning outcomes, especially in the absence of teacher regulation and intervention." Furthermore, "Future writing systems have the potential to improve system interaction when navigating the system, recovering from errors, and receiving feedback" but current systems still face "challenges of (1) personalized instruction adapted to evolving student attributes, (2) provision of appropriate and relevant instruction contingent on the domain and student, (3) provision of formative and summative feedback, (4) appropriate design of user interface elements to facilitate learning, and (5) tensions between classroom instruction and adaptive instruction."

Open questions raised

Need for comprehensive and adaptive ITS components that dynamically inform each other in writing domains
Development of domain models encompassing language knowledge, world knowledge, and writing task knowledge
More sophisticated student models capturing diverse learning contexts, L1/L2 differences, and heterogeneous learning requirements
Enhanced user interface design with dialogue-based interfaces, empathic chatbots, animated pedagogical agents, and augmented reality
Resolution of tensions between classroom instruction and adaptive instruction
Better integration of advanced AI, NLP, and HCI features in writing ITSs

Data: No datasets are made available. The paper references existing tools and systems but does not provide datasets.Code: No code repositories are mentioned or made available.Extracted from: pdfAgreement 81%

Explore related topics

Human-AI Collaboration Literature Review