My research centers on the trustworthiness and interpretability of multimodal AI systems —
spanning bias-driven hallucinations, multimodal moral reasoning, and better scaffolded reasoning to evaluate and calibrate user trust. I design benchmarks,
annotation pipelines, and preference learning techniques to improve transparency,
safety, and alignment of multimodal systems.
Feb 2026Extending my position at CMU HCII as a Visiting Scholar till the end of 2026.
Jul 2025New work CoCoT is out — written during my first month at CMU!
Jun 2025Dataset HalLoc V1 is released on HuggingFace.
May 2025Joining CMU HCII as a Visiting Scholar through the end of Fall 2025.
Research ✨
My research asks: How can we design multimodal AI systems whose reasoning is transparent, trustworthy, and genuinely aligned with human values — and how do humans perceive, interact with, and sometimes misplace trust in these systems? I pursue this vision through three interrelated research themes:
01Trustworthiness & Interpretability of Vision-Language Models
I develop methods to detect and localize failures in VLMs, examining how model biases lead to unfaithful outputs. I also study alignment — whether a model's internal reasoning and outputs faithfully reflect human values and intentions, rather than superficially mimicking them.
I investigate how people evaluate, trust, and are misled by AI-generated reasoning chains. Using behavioral experiments and real-world deployments, I examine when chain-of-thought explanations genuinely support critical thinking versus when they create false confidence — and what interaction designs can encourage more careful human oversight.
I design benchmarks and preference learning frameworks that capture the continuous, pluralistic nature of human moral judgment across text and image contexts — moving beyond binary labels toward richer, more human-aligned supervision signals.
moral reasoningvalue alignmentmultimodal benchmarks
Critical or Compliant? The Double-Edged Sword of Reasoning in Chain-of-Thought Explanations
Eunkyu Park, Wesley Hanwen Deng, Vasudha Varadarajan, Mingxi Yan, Gunhee Kim, Maarten Sap, Motahhare Eslami
EMNLP 2026
Abstract
Explanations are often promoted as tools for transparency, but they can also foster confirmation bias. We study the double-edged role of CoT explanations in multimodal moral scenarios by systematically perturbing reasoning chains and manipulating delivery tones. We find: (1) users equate trust with outcome agreement, sustaining reliance even when reasoning is flawed, and (2) confident tone suppresses error detection while maintaining reliance — showing delivery style can override correctness.
Cognitive Chain-of-Thought (CoCoT): Structured Multimodal Reasoning about Social Situations
Eunkyu Park, Wesley Hanwen Deng, Gunhee Kim, Motahhare Eslami, Maarten Sap
COLM 2026
Abstract
We introduce Cognitive Chain-of-Thought (CoCoT), a prompting strategy that scaffolds VLM reasoning through three stages: perception, situation, and norm. CoCoT consistently outperforms CoT and direct prompting (+8% on average) across multiple multimodal benchmarks.
HalLoc: Token-level Localization of Hallucinations for Vision Language Models
Eunkyu Park*, Minyeong Kim*, Gunhee Kim
CVPR 2025
Abstract
Hallucinations pose a significant challenge to the reliability of large vision-language models. We propose HalLoc, a dataset for efficient, probabilistic hallucination detection featuring 150K token-level annotated samples across VQA, instruction-following, and image captioning tasks. We also introduce a baseline model offering low-overhead, concurrent hallucination detection during generation.