AI evidence extraction

Generative AI and the future of higher education: a threat to academic integrity or reformation? Evidence from multicultural perspectives

Abdullahi Yusuf, Nasrin Pervin, ‪Marcos Román-González‬ · International Journal of Educational Technology in Higher Education · 2024

AI-generated evidence extraction, verified across multiple analytical personas. Not a substitute for the peer-reviewed original.

9/10

Relevance

2/4

Quality (LMQS)

Evidence

399

Citations

40.44

FWCI

Top 10%

Impact

This is an AI analysis. Read the peer-reviewed original at the publisher: https://doi.org/10.1186/s41239-024-00453-6

Methodology & findings

Study design

Embedded mixed-methods design with quantitative primary component and qualitative secondary component.

Sample

N = 1217, 5 groups

Primary method

SPSS (version 26) for quantitative analysis; Descriptive statistics (frequencies, percentages, means, standard deviations); Inferential statistics: ordinal logistic regression for correlations between cultural dimensions and GenAI perceptions; Content analysis for qualitative data with inter-rater reliability assessment (Miles and Huberman, 1994 absolute agreement rating); Network analysis using Gephi software for associating qualitative themes with cultural dimensions; Pearson correlation analysis for associations between cultural dimensions and perceived potential/concerns; Interpretative rating system by Pimentel (2019) for Likert scale responses (1.00-1.79 'strongly disagree' to 4.20-5.00 'strongly agree')

Main result

The study found that a significant majority (81.76%) of respondents acknowledged awareness of GenAI tools, with ChatGPT being the most recognized (71.8% highly familiar). A substantial cohort (n = 691 out of 1217) had previously engaged with GenAI tools, and among those, 35.7% expressed strong inclination toward employing such tools in the future. Notably, "a substantial majority of participants (n = 46.4% and 45.4%) expressed the firm belief that incorporating GenAI tools in academic endeavors, whether by students or educators, constitutes outright cheating." The research revealed significant correlations between cultural dimensions and GenAI perceptions: "cultures characterized by high uncertainty avoidance (UAI) exhibited a 3.67-fold greater likelihood of categorizing students' utilization of GenAI tools in their academic pursuits as instances of cheating (Odds Ratio [OR] = 3.671, 95% Confidence Interval [CI] [1.56-3.68], p-value < 0.001)."

Reports effect sizes and confidence intervals.

Research paradigm

Mixed methods (quantitative primary, qualitative secondary embedded design)

Author conclusions

The authors conclude: "The recognition of such an association underscores the importance of tailoring educational strategies and policies to specific cultural contexts within higher education. It emphasizes the need for ongoing research and dialogue to better understand these dynamics and develop more effective guidelines for the responsible and equitable incorporation of GenAI technologies into the educational landscape. Such policies should be flexible enough to accommodate cultural variations in attitudes and expectations, fostering a fair and inclusive learning environment. To this end, we suggest that a one-size-fits-all approach to GenAI integration in HE may not be appropriate. Instead, institutions must take cultural diversity into account when formulating policies and strategies for GenAI adoption."

Risk of bias

Selection bias: Convenience sampling method based on availability and willingness to participate through social media, research repositories, and academic forums; Geographic disparity: Unequal participant distribution across countries (Nigeria 278 vs. South/North America and Australia combined 123); Attrition: 12 participants removed for <3% survey progress; 8 for non-consent; 3 for sensitive language in open-ended responses; Survey design bias: Conditional display logic may have affected response patterns; 18% of respondents did not submit responses to certain questions; Sampling methodology: No unique links for survey access increases risk of multiple submissions despite prevention efforts; Self-report bias: Participants self-reported awareness, familiarity, and use of GenAI tools; Cultural measurement: Hofstede's framework applied retrospectively to country-level data rather than individual-level cultural assessment; Selection bias: Convenience sampling method based on availability and willingness to participate; Sampling disparity: Unbalanced geographic representation with Nigeria overrepresented (n=278) relative to Americas and Australia (n=123 combined); Spain overrepresented relative to Germany; Missing data: 15 countries lacked Hofstede cultural dimension index scores; excluded from correlation analyses; Survey access bias: Lack of personalized participant links increases risk of unauthorized multiple submissions; Attrition: 12 participants removed for <3% survey completion; 8 removed for non-consent; 3 removed for sensitive language; Response bias: 18% non-response to future GenAI use question; 21.8% non-response to policy regulation question; Cultural framework limitation: Hofstede's dimensions may not capture complex within-culture variations by age, gender, education, socioeconomic status; Social desirability bias: Self-reported behavioral intentions regarding plagiarism may not reflect actual behavior; Temporal limitation: Data collected during single 1-month period (August-September 2023); may not capture seasonal variations in attitudes; Convenience sampling method (non-random participant selection); Significant demographic disparity across countries and regions (Nigeria overrepresented); Selection bias from recruitment via social media and online platforms (excludes offline populations); Lack of unique participant links may increase risk of multiple submissions despite stated prevention efforts; Gender imbalance potential (49.84% male, 44.54% female, 5.75% other/undisclosed); Urban bias (71.57% from major cities); 15 countries lacking Hofstede cultural dimension index scores excluded from correlation analyses; Potential response bias from self-selected voluntary participation

Limitations

The authors acknowledge that "culture is complex and multifaceted, and reducing it to a few dimensions may oversimplify the true diversity of cultural values and behaviors within a society." They also note that "within any culture, there can be significant variations in values, beliefs, and behaviors based on factors such as age, gender, education, urban-rural divide, and socioeconomic status." Additionally, "a significant disparity in the participants' demographic distribution" was observed, with "the number of participants from Nigeria (n = 278) is twice that of participants from South and North America and Australia combined (total = 123)." Finally, they acknowledge that "participants were not assigned unique links for accessing our online survey
While efforts were made to prevent multiple submissions and ensure an anonymous data collection process, the absence of personalized links for each participant may increase the risk of unauthorized access to the survey."

Open questions raised

Absence of multicultural perspectives in existing GenAI research in higher education
Limited understanding of how cultural contexts influence GenAI adoption and perceptions
Need for comprehensive guidelines on responsible use of GenAI technologies in higher education
Further research needed to understand whether cultural dimensions influence justifications for GenAI classification
Future research should employ more balanced participant recruitment strategies to prevent demographic disparity
Need for personalized survey links and refined ethical protocols in future multinational studies

Extracted from: pdfAgreement 54%

Explore related topics

Institutional Policy AI Governance Survey