Transforming or Undermining Learning using GenAI: A Systematic Literature Review and Design Science Study
William Tam, Khushbu Tilvawala, David Sundaram · Journal of the Association for Information Systems · 2026
AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.
Methodology & findings
Study design
Design science research method combining systematic literature review for observation, systems thinking approach for theorizing conceptual artifacts, design of system artifacts using prompt engineering and simulations, and evaluation through interviews and literature review..
Primary method
Design science research method combined with systems thinking approach
Main result
The study found that "the key conceptual and systems artifacts from this study would be of value to university students, recent graduates, educators, and employers, enabling them to mitigate the dark side and enhance the bright side of GenAI-based learning." The research explored how GenAI tools can "sustain and positively transform their learning" while addressing both beneficial and harmful aspects of technology integration.
Research paradigm
Design science research with systems thinking approach
Author conclusions
The authors conclude that their research "contributes to GenAI and learning research by offering a novel, holistic lens that attempts to support sustained, adaptive, lifelong, and unsupervised learning" and that the developed artifacts "would be of value to university students, recent graduates, educators, and employers, enabling them to mitigate the dark side and enhance the bright side of GenAI-based learning."
Risk of bias
Selection bias in literature review (search strategy and inclusion/exclusion criteria not detailed in abstract); Limited empirical validation of artifacts (evaluation through interviews and literature review only, not yet through rigorous empirical studies); Potential confirmation bias in systems thinking approach for theorizing artifacts; No control group or comparative evaluation mentioned
Limitations
- The authors acknowledge that "Future work will involve validation of the proposed artifacts through in-depth empirical studies," indicating that the current study lacks comprehensive empirical validation of the designed artifacts.
Open questions raised
- The authors identify the need for validation of the proposed artifacts through in-depth empirical studies as a future research direction.
- The authors identify the need for validation of proposed artifacts through in-depth empirical studies in future work. They also highlight the gap between exploratory design and rigorous empirical evaluation of GenAI-based learning tools.
- Future work will involve validation of the proposed artifacts through in-depth empirical studies to strengthen the evidence base for GenAI-based learning interventions.
Explore related topics
Related papers
- What Is the Impact of ChatGPT on Education? A Rapid Review of the LiteratureChung Kwan Lo · 2023 · 1,725 citations
- ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?Jürgen Rudolph · 2023 · 1,674 citations
- A comprehensive AI policy education framework for university teaching and learningCecilia Ka Yuk Chan · 2023 · 1,160 citations
- ChatGPT for Education and Research: Opportunities, Threats, and StrategiesMd. Mostafizer Rahman · 2023 · 904 citations
- ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishingBrady Lund · 2023 · 769 citations
- ChatGPT in higher education: Considerations for academic integrity and student learningMiriam Sullivan · 2023 · 740 citations