The more helpful an AI is, the more it tricks you into thinking you’ve learned something you haven’t.
April 14, 2026
Original Paper
Confidence Without Competence in AI-Assisted Knowledge Work
arXiv · 2604.09444
The Takeaway
AI creates a 'confidence-competence gap' where users feel like experts despite scoring poorly on objective tests. The seamlessness of the interaction makes the brain mistake the AI's 'fluency' for the user's own mastery.
From the abstract
Large Language Models (LLMs) are widely used by students, yet their tendency to provide fast and complete answers may discourage reflection and foster overconfidence. We examined how alternative LLM interaction designs support deeper thinking without excessively increasing cognitive burden. We conducted a two-phase mixed-methods study. In Phase 1, interviews with 16 Gen Z students informed the design of Deep3, a web-based system with three interaction modes: \emph{a)} future-self explanations, \