Skip to yearly menu bar Skip to main content


Poster
in
Workshop: Language Gamification

Mimicking Human Emotions: Persona-Driven Behavior of LLMs in the ‘Buy and Sell’ Negotiation Game

mingyu jeon · Jae Young Suh


Abstract:

In this study, we quantified how effectively four large language models (LLMs)—GPT-4o, GPT-4-preview-1106, GPT-4o mini, and GPT-3.5 Turbo—mimic human social behaviors using the "Negotiation Arena" framework. Drawing from recent research that highlights the need for complex conversational task simulations to evaluate LLM performance, we utilized the "Buy and Sell" game to assign distinct personas (Cooperative, Competitive, Altruistic, Selfish, Cunning, Desperate, Control) to each model. Our findings show that end-to-end multimodal models like GPT-4o and GPT-4o mini exhibit strong persona-driven behavior, while text-based models like GPT-4-preview-1106 also respond to persona instructions, though with different tendencies. Aggressive and self-centered personas performed better in negotiations, while altruistic and cooperative personas showed lower success rates. This study provides insights into how LLMs can replicate human-like persona behaviors, emphasizing the potential of persona-driven simulations as an evaluation method for practical applications in social interactions.

Chat is not available.