How to Navigate ChatGPT and Its Pitfalls in Exam Situations
Written on
Chapter 1: A Cautionary Tale
During a dinner conversation, my friend, an educator at the higher education level, shared a significant experience with me. "I had to fail a student today for utilizing ChatGPT during their exam," they revealed. As it was exam season, I was keenly interested in the broader societal impacts of such technology, having discussed its implications previously. "What tipped you off?" I asked.
With their consent, I’ll outline the three key indicators that made it evident the student was merely copying and pasting AI-generated responses.
- Speeding Through the Exam
This exam was conducted online using specialized software, allowing the instructor access to detailed data, including the time each student spent on the test. While most students took over one hundred minutes, this particular individual—whose performance hadn’t been remarkable throughout the semester—finished in just sixty-three minutes. This was the first warning sign.
- Video Content Misstep
As part of the exam, students were required to watch a video and provide commentary based on it. Since ChatGPT currently lacks the ability to process video content, my friend thoughtfully provided transcripts for all videos. The student, seemingly attempting to outsmart the system, fed the transcript into the AI prior to answering the questions. However, in their haste, they overlooked an indication in the response that read, "...according to the transcript...". While it’s conceivable that a student might refer to a transcript instead of viewing the video—perhaps due to a visual impairment—this particular student was not among that group. This was the second red flag.
- AI's Limitations Under Pressure
The most glaring indicator came when my friend shared the final revelation. "You've got to be kidding me," I responded incredulously. "Nope," they chuckled. "One of the answers started with ‘I am only an AI chatbot, so I’m not able to...’" Despite the AI's attempts to provide a response, it still fell short. In a question requiring two examples, the AI generated six, three of which were incorrect. "How am I supposed to grade that?" my friend lamented.
Upon receiving a failing grade, the student attempted to contest it, citing personal challenges, the need to finish classes early, and their intent to use every resource available. My friend, however, is compassionate and genuinely cares for their students. Yet, the failing grade remained unchanged. Although the student may not have grasped the course content, they certainly learned a valuable lesson about the perils and limitations of relying too heavily on AI chatbots.
Section 1.1: The Role of Technology in Education
As technology evolves, its influence on education becomes more profound. This situation illustrates the need for students to engage with the material genuinely rather than relying on shortcuts.
Subsection 1.1.1: Understanding AI Limitations
Section 1.2: A Lesson Learned
The episode serves as a reminder that while technology can be a valuable aid in learning, it must be used responsibly and ethically.