Large Language Models

SurveyAgent: A Conversational System for Personalized and Efficient Research Survey
We propose a novel conversational AI system that enhances researchers’ literature review processes by providing personalized knowledge management, literature recommendations, and query answering through a unified platform.
Xintao Wang, Jiangjie Chen, Nianqi Li, Lida Wang, Xinfeng Yuan, Wei Shi, Xuyang Ge, Rui Xu, Yanghua Xiao
PDF Cite Code Demo
SurveyAgent: A Conversational System for Personalized and Efficient Research Survey
How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?
We study how LLMs handle irrelevant information and find they struggle with content that is semantically related but ultimately not pertinent, highlighting the limitations of current systems in filtering out such distractions.
Siye Wu, Jian Xie, Jiangjie Chen, Tinghui Zhu, Kai Zhang, Yanghua Xiao
PDF Cite Code
How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?
Agent Group Chat: An Interactive Group Chat Simulacra For Better Eliciting Collective Emergent Behavior
We propose a simulation to study language’s influence on collective behavior by having agents engage in free chat within various narrative scenarios, with findings suggesting that greater information exchange promotes more orderly and meaningful emergent behaviors.
Zhouhong Gu, Xiaoxuan Zhu, Haoran Guo, Lin Zhang, Yin Cai, Hao Shen, Jiangjie Chen, Zheyu Ye, Yifei Dai, Yan Gao, Yao Hu, Hongwei Feng, Yanghua Xiao
PDF Cite Code
Agent Group Chat: An Interactive Group Chat Simulacra For Better Eliciting Collective Emergent Behavior
TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation
TimeArena enhances LLMs with temporal dynamics for better multitasking, showing advanced models like GPT-4 still trail behind human temporal awareness.
Yikai Zhang, Siyu Yuan, Caiyu Hu, Kyle Richardson, Yanghua Xiao, Jiangjie Chen
PDF Cite Project
TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews
We propose InCharacter, a method using psychological scales to evaluate the personality fidelity of role-playing agents (RPAs) powered by large language models.
Xintao Wang, Yunze Xiao, Jen-tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, Yanghua Xiao
PDF Cite Code Demo
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews
GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick
We propose GumbelSoft to improve the diversity of text outputs from LLMs while maintaining high detectability, outperforming other watermarking methods in both aspects.
Jiayi Fu, Xuandong Zhao, Ruihan Yang, Yuansen Zhang, Jiangjie Chen, Yanghua Xiao
PDF Cite Code
GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick
TravelPlanner: A Benchmark for Real-World Planning with Language Agents
We introduced TravelPlanner, a benchmark for assessing language agents’ planning abilities, showing that even advanced models like GPT-4 face difficulties with complex tasks.
Jian Xie, Kai Zhang, Jiangjie Chen, Tinghui Zhu, Renze Lou, Yuandong Tian, Yanghua Xiao, Yu Su
PDF Cite Dataset Project Code
TravelPlanner: A Benchmark for Real-World Planning with Language Agents
EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction
We proposes EASYTOOL, a method that simplifies tool documentation into concise instructions, improving tool use by language models.
Siyu Yuan, Kaitao Song, Jiangjie Chen, Xu Tan, Yongliang Shen, Ren Kan, Dongsheng Li, Deqing Yang
PDF Cite Code
EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction
Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction Arena
We propose AucArena to tests LLMs in auctions, showing they can strategize but with variable success, indicating potential for enhancement.
Jiangjie Chen, Siyu Yuan, Rong Ye, Bodhisattwa Prasad Majumder, Kyle Richardson
PDF Cite Demo
Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction Arena
Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models
We propose a multilingual idiom KB (IdiomKB) developed using LLMs to facilitate better idiomatic translation by smaller models by retrieving idioms’ figurative meanings.
Shuang Li, Jiangjie Chen, Siyu Yuan, Xinyi Wu, Hao Yang, Shimin Tao, Yanghua Xiao
PDF Cite Code
Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models