The next AI won't answer you. It'll log in as you.
- Dane Smale
- Jun 9
- 2 min read
Here's the news story that should change how schools think. Amazon sued the AI company Perplexity for letting its Comet agent log into Amazon as the user and shop on their behalf, and Amazon won the first round. The point is, control stays with the platform, not the user. The next wave of AI doesn't sit politely in a chat box. It takes your credentials and acts as you: booking flights, doing the shopping, and the bit that matters for schools, potentially logging into a learning system and doing the course for you.
This is the agentic world today's six-year-olds will grow up inside. My paper has argued all along that the chat box is transitional, that agents are just a phase on the way to something bigger. A primary school's job isn't to teach this week's interface. It's to build the judgement to live with whatever comes next: when to let AI act, when to keep control, and how these systems get gamed.
Two more moments from the same episode make the point. An educator, Jason La Greca, published a guide called How to Break Your Chatbot, a set of tests every school-deployed AI should survive, because students absolutely have an incentive to jailbreak it. Someone once talked a dealership bot down to a $1 car. And a little game called FakeWriters left the two hosts scoring two out of six trying to tell AI text from human writing, which is worse than a coin toss. So much for "I can always spot AI".
That's the case for a school that owns and tests its own AI rather than piping in consumer tools, and teaches kids to probe and test these systems rather than just trust them. PrimarAI keeps its system in a closed environment with the data in NSW, and treats verification as a skill taught on purpose. Detection's a dead end now. Judgement is the job. Besides, my students would have that dealership bot down to a dollar before recess, and I'd much rather they learned the trick in a classroom built for it.
Read all about the new AI-based primary school at www.primarai.com.au/theprimaraischool





Comments