CST-3: When AI Deceives: Over-Reliance and the Illusion of Authority

The essay examines two critical human cognitive susceptibilities—automation over-reliance and the illusion of authority—that emerge when interacting with artificial intelligence. Automation over-reliance describes the human tendency to uncritically accept AI suggestions without verification, often leading to uncorrected errors. Conversely, the illusion of authority explains how people attribute undue credibility to AI systems solely due to their confident and fluent presentation of information. These susceptibilities dangerously interact with AI's inherent flaws, such as hallucinations or ethical oversights, potentially leading to cascading failures in various sectors, from aviation and medicine to finance and legal practices. The text stresses that a lack of human vigilance, spurred by over-trust in AI, can undermine safety, ethical decision-making, and the development of critical thinking skills, highlighting the urgent need for appropriate design, education, and policy to foster a balanced, skeptical approach to AI interactions.