박은규
Ph.D. Candidate, Seoul National University
Visiting Researcher, CMU HCII
Hi! I am a Ph.D. Candidate in the Interdisciplinary Program in Artificial Intelligence at Seoul National University. I work at the intersection of NLP, computer vision, and HCI, studying how multimodal AI systems reason and how people come to trust them. My research spans three threads: evaluating the trustworthiness of vision-language models (faithfulness of reasoning, localizing perception-to-understanding failures); studying how people perceive, rely on, and are misled by AI explanations; and building benchmarks and alignment methods for multimodal moral and social reasoning. I design human-subject studies to evaluate how users perceive and calibrate trust in these systems, and translate those findings into better learning signals for model alignment.
I am advised by Professor Gunhee Kim at SNU Vision & Learning Lab. At CMU, I am visiting Professor Motahhare Eslami's lab at HCII and work closely with Professor Maarten Sap at LTI.
How can we design multimodal AI systems whose reasoning is transparent, trustworthy, and aligned with human values, and how do humans perceive, interact with, and sometimes misplace trust in these systems?
How people evaluate, trust, and are misled by AI reasoning chains. When chain-of-thought explanations support critical thinking versus create false confidence, and what interaction designs encourage careful oversight.
Benchmarks and preference learning frameworks that capture the continuous, pluralistic nature of human moral judgment across text and image, moving beyond binary labels toward human-aligned supervision.
Detecting and localizing failures in vision-language models, examining how model biases lead to unfaithful outputs, and whether model reasoning faithfully reflects human values rather than mimicking them.