AI evidence extraction

Leveraging ChatGPT for Enhancing Critical Thinking Skills

Ying Guo, Daniel Lee · Journal of Chemical Education · 2023

AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.

6/10

Relevance

Evidence

223

Citations

198.53

FWCI

Top 10%

Impact

This is an AI analysis. Read the peer-reviewed original at the publisher: https://doi.org/10.1021/acs.jchemed.3c00505

Methodology & findings

Study design

Mixed methods case study involving a ChatGPT-based activity implemented in introductory chemistry courses at Georgia Gwinnett College, with three implementation stages: account setup/orientation, essay creation, and output revision/validation.

Main result

The study found that "The results showed significant improvements in students' confidence to ask insightful questions, analyze information, and comprehend complex concepts. Students reported that ChatGPT provided diverse perspectives and challenged their current ways of thinking." Additionally, students "expressed an increased utilization of ChatGPT to enhance critical thinking skills and a willingness to recommend it to others."

Reports effect sizes.

Research paradigm

Mixed methods (quantitative and qualitative)

Author conclusions

The authors concluded that "this study provides valuable insights for leveraging AI technologies like ChatGPT to foster critical thinking skills in higher education," while emphasizing that "Future research should focus on training educators in integrating ChatGPT effectively and ensuring student awareness of privacy and security considerations."

Risk of bias

No control group mentioned - selection bias and lack of comparative design; Self-reported improvements - response bias; Single institution study - limited generalizability; No mention of blinding or objective outcome assessment; Volunteer participation likely - selection bias; No demographic stratification analysis mentioned; Potential social desirability bias in student responses about willingness to recommend; No randomization described; Potential confirmation bias in reporting positive outcomes

Limitations

The study acknowledges that "challenges included low-quality student comments and difficulties in validating information sources." The abstract also indicates limitations related to implementation, noting the need for "comprehensive training for educators and access to reliable resources."

Open questions raised

Future research should focus on training educators in integrating ChatGPT effectively and ensuring student awareness of privacy and security considerations.
Strategies for addressing low-quality student comments and improving information validation skills
Future research directions include:

Data: not_statedCode: not_statedExtracted from: pdf

Explore related topics

AI Literacy Training Doctoral Training Case Study