the narrative trap<\/a> is worth a read.<\/p>\nWhat not to do.<\/strong> Do not become the person who distrusts every AI answer. The same Dell’Acqua experiment found large gains inside the frontier: more tasks, completed faster, at higher quality. The goal is not less AI. It is fewer unexamined agreements.<\/p>\n<\/span>Frequently asked questions<\/span><\/h2>\nWhat is automation bias?<\/strong>
\nAutomation bias is the tendency to over-rely on automated suggestions. A 2012 systematic review in JAMIA covering 74 studies found it was shaped by experience, trust and confidence in the system, and by workload, task complexity and time pressure. It was reduced by training, by emphasising user accountability, and by systems that give information rather than recommendations.<\/p>\nDoes experience protect people from following a wrong AI suggestion?<\/strong>
\nPartly. In a 2023 Radiology study, very experienced radiologists’ correct ratings fell from 82.3% to 45.5% when a purported AI suggested the wrong category, compared with a fall from 79.7% to 19.8% for inexperienced readers. Experience reduced the damage but did not eliminate it.<\/p>\nIs a devil’s advocate a good way to challenge AI-generated consensus?<\/strong>
\nResearch by Charlan Nemeth and colleagues found that assigned devil’s advocates were less effective than authentic dissent, and in one study role-played dissent led people to bolster their original view. A sincere, evidence-based challenge from someone who actually disagrees works better than a rotating role.<\/p>\nCan I ask the AI whether it is sure?<\/strong>
\nIt is a weak check. A 2024 study of five AI assistants found that when asked “Are you sure?”, they admitted mistakes they had not made on between 42% and 98% of questions, depending on the model. Test the claim against the underlying evidence or an independent source instead.<\/p>\nHow do I disagree without looking like I am against AI?<\/strong>
\nState that you formed your view independently, name the specific evidence the model did not see or underweighted, propose a short bounded check, and commit in advance to accepting the result. That frames the challenge as quality control rather than opposition to the tool.<\/p>\nWhat is the single most effective thing a leader can do?<\/strong>
\nCollect independent written views before any AI output is shared, then speak last. Asch found that one dissenting partner reduced conformity pressure to a quarter of its unanimous level, and Doshi and Hauser found that exposure to AI ideas pulls people’s output toward the AI’s and toward each other. Order of exposure matters.<\/p>\nWhen is it fine to go along with the AI answer?<\/strong>
\nWhen the task is inside the AI’s known strengths, the decisive evidence was fully available to the model, the decision is cheap to reverse, and you have no independent reason to doubt it. In the BCG experiment, AI users inside the frontier completed 12.2% more tasks, 25.1% faster, with over 40% higher quality.<\/p>\n<\/span>Sources<\/span><\/h2>\n\n- Asch, S. E. (1955). Opinions and Social Pressure. Scientific American, 193(5), 31-35.<\/li>\n
- Dell’Acqua, F., McFowland III, E., Mollick, E., Lifshitz-Assaf, H., Kellogg, K. C., Rajendran, S., Krayer, L., Candelon, F., and Lakhani, K. R. (2023). Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality. Harvard Business School Working Paper 24-013.<\/li>\n
- Dratsch, T., Chen, X., Rezazade Mehrizi, M., Kloeckner, R., Mahringer-Kunz, A., Pusken, M., Baessler, B., Sauer, S., Maintz, D., and Pinto dos Santos, D. (2023). Automation Bias in Mammography: The Impact of Artificial Intelligence BI-RADS Suggestions on Reader Performance. Radiology, 307(4), e222176.<\/li>\n
- Doshi, A. R., and Hauser, O. P. (2024). Generative AI enhances individual creativity but reduces the collective diversity of novel content. Science Advances, 10(28), eadn5290.<\/li>\n
- Sharma, M., Tong, M., Korbak, T., Duvenaud, D., Askell, A., Bowman, S. R., et al. (2024). Towards Understanding Sycophancy in Language Models. International Conference on Learning Representations (ICLR 2024).<\/li>\n
- Goddard, K., Roudsari, A., and Wyatt, J. C. (2012). Automation bias: a systematic review of frequency, effect mediators, and mitigators. Journal of the American Medical Informatics Association, 19(1), 121-127.<\/li>\n
- Nemeth, C. J. (2010). Minority Influence Theory. Institute for Research on Labor and Employment Working Paper 218-10, University of California, Berkeley. (Summarises Nemeth, Brown and Rogers, 2001, European Journal of Social Psychology, 31, 707-720, and Nemeth, Connell, Rogers and Brown, 2001, Journal of Applied Social Psychology, 31, 48-58.)<\/li>\n
- Edmondson, A. (1999). Psychological Safety and Learning Behavior in Work Teams. Administrative Science Quarterly, 44(2), 350-383.<\/li>\n
- Presidential Commission on the Space Shuttle Challenger Accident (1986). Report to the President, Volume 1, Chapter V: The Contributing Cause of the Accident. Washington, DC.<\/li>\n<\/ol>\n
\nThis content was compiled with the support of AI following in-depth research, then written and prepared for publication by the CEOtudent editorial team.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"When a team converges on an AI-generated answer, two old biases stack: automation bias and social conformity. In a 758-person BCG field experiment, consultants using GPT-4 on a task outside the AI’s competence were 19 percentage points less likely to be correct, and in Asch’s classic studies a single dissenting partner cut conformity to one fourth. This piece turns the evidence into a protocol for disagreeing well and a checklist for leaders who want dissent to reach the decision.<\/p>\n","protected":false},"author":1,"featured_media":326235,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-326224","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/posts\/326224","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/comments?post=326224"}],"version-history":[{"count":0,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/posts\/326224\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/media\/326235"}],"wp:attachment":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/media?parent=326224"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/categories?post=326224"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/tags?post=326224"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}