Skip to main navigation Skip to search Skip to main content

Interaction Context Often Increases Sycophancy in LLMs

  • Shomik Jain
  • , Charlotte Park
  • , Matt Viana
  • , Ashia Wilson
  • , Dana Calacci

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We investigate how the presence and type of interaction context shapes sycophancy in LLMs. While real-world interactions allow models to mirror a user's values, preferences, and self-image, prior work often studies sycophancy in zero-shot settings devoid of context. Using two weeks of interaction context from 38 users, we evaluate two forms of sycophancy: (1) agreement sycophancy - the tendency of models to produce overly affirmative responses, and (2) perspective sycophancy - the extent to which models reflect a user's viewpoint. Agreement sycophancy tends to increase with the presence of user context, though model behavior varies based on the context type. User memory profiles are associated with the largest increases in agreement sycophancy (e.g. + 45% for Gemini 2.5 Pro), and some models become more sycophantic even with non-user synthetic contexts (e.g. + 15% for Llama 4 Scout). Perspective sycophancy increases only when models can accurately infer user viewpoints from interaction context. Overall, context shapes sycophancy in heterogeneous ways, underscoring the need for evaluations grounded in real-world interactions and raising questions for system design around alignment, memory, and personalization.

Original languageEnglish (US)
Title of host publicationCHI 2026 - Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
EditorsNuria Oliver, David A. Shamma, Heloisa Candello, Pablo Cesar, Pedro Lopes, Alessandro Bozzon, Thomas Kosch, Vera Liao, Xiaojuan Ma, Valentino Artizzu, Fiona Draxler, Gustavo Lopez, Anke V. Reinschluessel, Xin Tong, Phoebe O. Toups Dugas
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400722783
DOIs
StatePublished - Apr 13 2026
Event2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 - Barcelona, Spain
Duration: Apr 13 2026Apr 17 2026

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2026 CHI Conference on Human Factors in Computing Systems, CHI 2026
Country/TerritorySpain
CityBarcelona
Period4/13/264/17/26

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint

Dive into the research topics of 'Interaction Context Often Increases Sycophancy in LLMs'. Together they form a unique fingerprint.

Cite this