Role-Playing Agent

Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works
We propose evaluating large language models’ character understanding through character profiling, using the CroSS dataset and showing promising results for role-playing agent development.
Xinfeng Yuan, Siyu Yuan, Yuhan Cui, Tianhe Lin, Xintao Wang, Rui Xu, Jiangjie Chen, Deqing Yang
PDF Cite Code
Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works
From Persona to Personalization: A Survey on Role-Playing Language Agents
This paper surveys Role-Playing Language Agents (RPLAs) by categorizing personas, discussing their development, and examining their applications, challenges, and future directions.
Jiangjie Chen, Xintao Wang, Rui Xu, Siyu Yuan, Yikai Zhang, Wei Shi, Jian Xie, Shuang Li, Ruihan Yang, Tinghui Zhu, Aili Chen, Nianqi Li, Lida Chen, Caiyu Hu, Siye Wu, Scott Ren, Ziquan Fu, Yanghua Xiao
PDF Cite
From Persona to Personalization: A Survey on Role-Playing Language Agents
Character is Destiny: Can Large Language Models Simulate Persona-Driven Decisions in Role-Playing?
We evaluate the potential of LLMs to make decisions as literary characters, using a new dataset and improved method that enhances decision-making accuracy, with future work and resources to be shared publicly.
Rui Xu, Xintao Wang, Jiangjie Chen, Siyu Yuan, Xinfeng Yuan, Jiaqing Liang, Zulong Chen, Xiaoqing Dong, Yanghua Xiao
PDF Cite
Character is Destiny: Can Large Language Models Simulate Persona-Driven Decisions in Role-Playing?
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews
We propose InCharacter, a method using psychological scales to evaluate the personality fidelity of role-playing agents (RPAs) powered by large language models.
Xintao Wang, Yunze Xiao, Jen-Tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, Yanghua Xiao
PDF Cite Code Demo
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews