At the moment, it seems like AI (artificial intelligence) is everywhere. It鈥檚 on our devices, in our infrastructure and now, it鈥檚 making its way into schools too. The problem? Students can鈥檛 seem to tell when it鈥檚 telling the truth and when it鈥檚 not.
According to a new study from Oxford University Press (OUP), nearly 1 in 3 pupils (32%) aged 13-18 say they can鈥檛 tell whether AI-generated content is true and 1 in 5 (21%) say they are regularly unsure.
As a whole, less than half of pupils (47%) say that they feel confident when it comes to spotting misinformation created by AI.
The issue is that the study found that students do use AI a lot, with 80% using it for homework and other school work. But if they can鈥檛 accurately spot misinformation, what does that mean for their learning?
听
AI Hallucinations
听
But the concept that AI doesn鈥檛 always tell the truth isn鈥檛 new. These 鈥�AI hallucinations鈥� as they have been named, occur when large language models like ChatGPT or Gemini present false information as true.
In an OpenAI report, the company found that ChatGPT鈥檚 o3 and o4 models hallucinated more than the previous ones. o3 hallucinated 33% of the time while o4-mini did so 48% of the time. For 04, that means it hallucinated nearly half of the time.
And whilst companies like Google and OpenAI are working on reducing this, the fact that they occur so regularly and yet are so hard to spot, raises important questions about reliance on AI.
听
More from Artificial Intelligence
- AI Is Now Better At Catching Fraudsters Than Human Analysts: Here鈥檚 Why That Matters
- World Environment Day 2026: How Tech Is Impacting Europe鈥檚 Climate Footprint
- Claude Is Surging Across Enterprise 鈥� Portal26 Just Made Governance Free
- How AI-First Agencies Are Reshaping UK Marketing In 2026
- Anthropic鈥檚 Claude Outage: Are Businesses Built Around AI Prepared For Failures?
- The Women Behind MENA鈥檚 Most Exciting AI Startups
- Why The Gulf Could Become The World鈥檚 Most Exciting Deployment Zone For Physical AI
- AI Experts React To Anthropic鈥檚 Plans To Publicly Release Mythos
听
Students Use AI As A Shortcut
听
For many students across the UK, AI has become a way for them to access more personalised learning and have a helping hand with revision.
The problem is, many are using it to听do听their work, not just help them with it.
鈥淪ome are using it really effectively and are getting that extra help,鈥� said Dan Williams, Assistant Headteacher at Bishop Vesey鈥檚 Grammar School. 鈥淏ut many are copying and pasting from the AI. They don鈥檛 yet have the knowledge to test whether something is correct.鈥�
Williams, who works in the school as an AI lead, admitted that even he finds it hard to work out when videos are generated by AI. His worry is that students are becoming dependant on AI without the skills to actually work out whether it is pulling in accurate information.
Conversely, Dr. Alexandra Tomescu from Oxford University Press had a slightly different view. 鈥淲e hear a lot about how AI is all doom and gloom and how it鈥檚 going to make young people very dependent on it,鈥� she said. 鈥淏ut when asked, actually nine out of ten students have said that they have benefitted from AI, especially in skill development.鈥�
听
The Importance Of AI Literacy
听
The study by the OUP also found that despite not being able to spot AI mistakes, students genuinely wanted to have better AI literacy.
48% said they wanted more support from their teachers to help them identify which AI content they can trust, whilst 51% said they wanted more clarity around when they could use it to help them with homework.
As the rise and adoption of LLM models has been so quick, especially amongst young people, it can be hard to understand just how much students are able to use them without being penalised. After all, most students will likely end up using AI as part of their future work, so growing their skills early is important.
The problem? Teachers don鈥檛 know either. In fact, a third of student said their teachers lack confidence using AI themselves, and almost half (47%) think teachers can鈥檛 spot when AI is being used for homework and other assignments.
听
AI: Help Or Hindrance?
听
When it comes to whether AI has been a help or a hindrance, it seems students are a little divided. 6 in 10 said AI has hurt their skills in some way and 26% said it makes their school work too easy. Others say it limits creative thinking (12%) or hinders problem-solving (8%).
However, it鈥檚 not all bad. 9 in 10 students said that AI has helped them with problem-solving (18%), creating new ideas (15%) and exam preparation (13%).
And whilst it is true that some level of critical thinking is important, the fact that AI can provide more personalised tuition is a positive 鈥� as long as it is not hallucinating in the process.
听
ChatGPT: Classmate or Cheat?
听
The truth is that many students will grow up in a world where AI is all around them. Banning it is not a smart option, but teaching them how to use it responsibly definitely is.
As Erika Galea, Director of the Educational Neuroscience Hub Europe and co-author of the report puts it: 鈥淭he true challenge ahead is not mastering technology but safeguarding the depth of human thought in an age of鈥rtificial intelligence.鈥�
