← List all talks ...

CICERO: Human-Level Performance in the Game of Diplomacy by Combining Language Models with Strategic Reasoning

Noam Brown – Research Scientist, OpenAI

Thu, 19-Oct-2023 / 4:00pm / Packard 202

This talk has been moved from Oct 5 to Oct 19.

Abstract

In this talk I will describe CICERO, the first AI agent to achieve human-level performance in Diplomacy, a strategy game involving both cooperation and competition that emphasizes natural language negotiation and tactical coordination between seven players. CICERO integrates a language model with planning and reinforcement learning algorithms by inferring players’ beliefs and intentions from its conversations and generating dialogue in pursuit of its plans. Across 40 games of an anonymous online Diplomacy league, CICERO achieved more than double the average score of the human players and ranked in the top 10% of participants who played more than one game.

Bio

Noam Brown is a Research Scientist at OpenAI investigating multi-step reasoning and self-play in language models. He co-created Libratus and Pluribus, the first AIs to defeat top humans in two-player no-limit poker and multiplayer no-limit poker, respectively. Noam was also the lead research scientist for CICERO, the first AI to achieve human-level performance in the strategy game Diplomacy. He has received the Marvin Minsky Medal for Outstanding Achievements in AI, was named one of MIT Tech Review’s 35 Innovators Under 35, and his work on Pluribus was named by Science as one of the top 10 scientific breakthroughs of 2019. Noam received his PhD from Carnegie Mellon University, for which he received the AAMAS Victor Lesser Distinguished Dissertation Award, the AAAI ACM-SIGAI Dissertation Award, and the CMU School of Computer Science Distinguished Dissertation Award.