ChatGPT in Writing Literature Reviews: Student Perceptions and Concerns

Rentauli Mariah Silalahi

Abstract


Abstract: This study investigates the perceptions and concerns of Indonesian EFL undergraduate students regarding the use of ChatGPT for writing literature reviews, a particularly challenging task in English for this demographic. Employing a mixed-methods approach, data were collected from 151 survey participants and 7 interviewees across five study programs. The Technology Acceptance Model (TAM) serves as the theoretical framework for this study. Quantitative data were analysed using descriptive statistics, while qualitative data underwent thematic analysis. Findings indicate that students generally hold neutral views regarding the ease of use of ChatGPT, yet they consistently report finding it highly beneficial in assisting with their literature reviews. By triangulating quantitative and qualitative findings, the study reveals that ChatGPT primarily aids in idea generation and the identification and correction of grammatical errors. However, concerns were raised regarding its potential to reduce students' learning efforts, foster dependence on AI tools, and facilitate plagiarism. Despite acknowledging these limitations, students underscored the importance of verifying ChatGPT outputs. The study recommends that educators and policymakers develop guidelines to maximize the benefits of ChatGPT while ensuring academic integrity.

Keywords


ChatGPT, Language Support, Literature Reviews, Technology Acceptance Model

Full Text:

PDF

References


Adiguzel, T. (2023). Revolutionizing Education with AI : Exploring the Transformative Potential of ChatGPT. Contemporary Educational Technology, 15(3), 1–13.

Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 1–6. https://doi.org/10.1016/j.asw.2023.100745

Bašić, Ž., Banovac, A., Kružić, I., & Jerković, I. (2023). ChatGPT-3.5 as Writing Assistance in Students ’ Essays. Humanities and Social Sciences Communications, 10(750), 1–5. https://doi.org/10.1057/s41599-023-02269-7

Braun, V., & Clarke, V. (2013). Successful qualitative research: A practical guide for beginners. SAGE Publications Ltd.

Braun, V., & Clarke, V. (2022). Thematic analysis: A practical guide. SAGE Publications Ltd.

Browne, B. (2023). Italy became the first western country to ban ChatGPT. Here’s what other countries are doing. CNBC. https://www.cnbc.com/2023/04/04/italy-has-banned-chatgpt-heres-what-other-countries-are-doing.html

Cornish, D., & Larter, Z. (2024). “I Don ’ t Have to Write an Essay Ever Again ! ” : University Student Reflections on ChatGPT in the Classroom. Journal of Education Technology Systems, 52(3), 325–334. https://doi.org/10.1177/00472395231219267

Črček, N., & Patekar, J. (2023). Writing with AI: University Students ’ Use of ChatGPT. Journal of Language and Education, 9(4), 128–138.

Das, S. R., & J.V., M. (2024). Perceptions of Higher Education Students towards ChatGPT Usage. International Journal of Technology in Education, 7(1), 86–106.

Davis, F. D. (1993). User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts. International Journal of Man-Machine Studies, 38, 475–487.

Davis, F. D., & Venkatesh, V. (1996). A Critical Assessment of Potential Measurement Biases in the Technology Acceptance Model: Three Experiments. International Journal of Human-Computer Science, 45, 19–45.

Eunim, B., & Youngsang, C. (2023). Examining Korean EFL College Students ’ Experiences and Perceptions of Using ChatGPT as a Writing Revision Tool. Journal of English Teaching through Movies and Media, 24(4), 15–27.

Ge, T. (2024). Assessing the Acceptance and Utilization of ChatGPT by Chinese University Students in English Writing Education. International Journal of Learning and Teaching, 10(1), 166–170. https://doi.org/10.18178/ijlt.

Granić, A., & Marangunić, N. (2019). Technology acceptance model in educational context: A systematic literature review. British Journal of Educational Technology, 50(5), 2572–2593. https://doi.org/10.1111/bjet.12864

Harunasari, S. Y. (2023). Examining the Effectiveness of AI-integrated Approach in EFL Writing: A Case of ChatGPT. International Journal of Progressive Sciences and Technologies (IJPSAT), 39(2), 357–368. https://doi.org/10.52155/ijpsat.v39.2.5516

Imran, A. A., & Lashari, A. A. (2023). Exploring the World of Artificial Intelligence: The Perception of the University Students about ChatGPT for Academic Purpose. Global Social Sciences Review (GSSR), 8(1), 375–384. https://doi.org/10.31703/gssr.2023(VIII-I).34

Jarrah, A. M., Wardat, Y., & Fidaigo, P. (2023). Using ChatGPT in Academic Writing is (not) a Form of Plagiarism : What does the Literature Say? Online Journal of Communication and Media Technologies, 13(4).

Lambert, J., & Stevens, M. (2023). ChatGPT and Generative AI Technology: A Mixed Bag of Concerns and New Opportunities. Computers in the Schools, 0(0), 1–25. https://doi.org/10.1080/07380569.2023.2256710

Lin, S., Chung, F.-L., Chung, H.-H., & Lan, K. Y. (2023). Concerns About Using ChatGPT in Education. ICITL, 37–49. https://doi.org/10.1007/978-3-031-40113-8

Mahapatra, S. (2024). Impact of ChatGPT on ESL Students ’ Academic Writing Skills : a Mixed Methods Intervention Study. Smart Learning Environments, 11(9), 1–18. https://doi.org/10.1186/s40561-024-00295-9

Marzuki, Widiati, U., Rusdin, D., Indrawati, I., & Indrawati, D. (2023). The Impact of AI Writing Tools on the Content and Organization of Students ’ Writing: EFL Teachers’ Perspective. Cogent Education, 10(2), 1–17. https://doi.org/10.1080/2331186X.2023.2236469

Nugroho, A., Andriyanti, E., Widodo, P., & Mutiaraningrum, I. (2024). Students’ Appraisals post-ChatGPT Use: Students’ Narrative after Using ChatGPT for Writing. Innovations in Education and Teaching International, 1–13. https://doi.org/10.1080/14703297.2024.2319184

Nugroho, A., Putro, N. H. P., & Syamsi, K. (2023). The Potentials of ChatGPT for Language Learning: Unpacking its Benefits and Limitations. Register Journal, 16(02), 224–247. https://doi.org/10.18326/rgt.v16i2.224-247

OpenAI. (2024). Chat with GPT-4o. OpenAI. https://chatbotapp.ai/landing-gpt4o?utm_source=GoogleAds&utm_medium=cpc&utm_campaign=%7Bcampaign%7D&utm_id=21124457886&utm_term=163298305114&utm_content=702307790819&gad_source=1&gclid=CjwKCAjwjqWzBhAqEiwAQmtgT88fOTx8s0o1-rvm8PF-3AlDRhmmE_4bAUaGej9ILYYZUKelG6_xYxoCfF8QAvD_BwE)

Özçelik, N. P., & Ekşi, G. Y. (2024). Cultivating writing skills : the role of ChatGPT as a learning assistant — a case study. Smart Learning Environments, 11(10), 1–18. https://doi.org/10.1186/s40561-024-00296-8

Phuong, H. P. X. (2024). Using ChatGPT in English Language Learning: A Study on I.T. Students’ Attitudes, Habits, and Perceptions. International Journal of TESOL & Education, 4(1), 55–68.

Rahim, E. M. A., Rahim, M. E. A., Razawi, N. A., & Mohamed, N. A. (2023). Students’ Perception on the Use of ChatGPT as a Language Learning Tool. Idealogy Journal, 8(2), 70–78.

Sabzalieva, E., & Valentini, A. (2023). ChatGPT and Artificial Intelligence in Higher Education: Quick Start Guide. UNESCO.

Shaengchart, Y. (2023). A Conceptual Review of TAM and ChatGPT Usage Intentions Among Higher Education Students. Advance Knowledge for Executives (AKE), 2(3), 1–7.

Shakil, E., & Siddiq, D. S. (2024). ESL Teachers’ Perceptions about ChatGPT as a Threat to Analytical Writing Abilities of ESL Learners at Graduate Level. Pakistan Languageas and Humanities Review, 8(1), 115–128

Shidarta, & Martinelli, I. (2023). Should Indonesia Block ChatGPT ? ICOBAR, 1–5.

Silvestre, A. S. S., Amaral, E. L. de M., Holanda, M. E., & Canedo, E. D. (2023). Students ’ Perception about ChatGPT’ s Impact on their Academic Education. Congresso Brasileiro de Informatica Na Educacao, 1260–1270

Thao, L. T., Hieu, H. H., & Thuy, P. T. (2023). Exploring the Impacts of ChatGPT in EFL Writing: Student Perceptions of Opportunities and Challenges in Vietnamese Higher Education. Kognisi: Jurnal Ilmu Keguruan, 1(2), 107–124.

Xu, X., Su, Y., Zhang, Y., Wu, Y., & Xu, X. (2024). Understanding Learners’ Perceptions of ChatGPT: A Thematic Analysis of Peer Interviews among Undergraduates and Postgraduates in China. Heliyon, 10, 1–13.

Yusuf, A., Pervin, N., & González, M. R. (2024). Generative AI and the future of higher education : a threat to academic integrity or reformation ? Evidence from multicultural perspectives. International Journal of Educational Technology in Higher Education, 21(21), 1–29. https://doi.org/10.1186/s41239-024-00453-6


Refbacks

  • There are currently no refbacks.


------------------

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

  

Proceeding of International Seminar on Student Research in Education, Science, and Technology already indexed: