MetaAI_Official
MetaAI_Official OP t1_izfq8y9 wrote
Reply to comment by MetaAI_Official in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
[Goff] There's also some interesting "anti-weirdness" steps that the team worked on that would need to be put in place - an AI that responds to messages within five minutes 24 hours a day would not feel right at all. I think the most intense timeframe is probably 15 to 30 minutes, as then you will need longer, more complex communications but also the rapid tactical back-and-forth - that pivot would be a cool challenge.
MetaAI_Official OP t1_izfq7yw wrote
Reply to comment by Specialist-Regret241 in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Regarding the post-game kibbitzing, we discussed this a few times, but every solution felt like we'd be faking it. For example, we could have put a human in the loop here but.... why? In the end we picked the most honest approach we could when dealing with the community, which was an ethical consideration that underpinned the whole project I think. -AG
MetaAI_Official OP t1_izfq2c8 wrote
Reply to comment by MetaAI_Official in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
[Goff] Two thoughts on this:
Seeing under the hood like this was fascinating and seeing how the model responded to the messages human players sent was great. That is more about detecting when people lie than the other way around though.
On the actual question you asked Alex is spot on that CICERO only ever ""lied"" by accident - you could see when it sent messages it meant them, then it genuinely changed it's plan later.
MetaAI_Official OP t1_izfq18c wrote
Reply to comment by MetaAI_Official in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
As someone who isn't an AI specialist, this research was a fascinating read. Even for people not in the field this problem is important and if you get the chance it is worth reading! -AG
MetaAI_Official OP t1_izfpw9x wrote
Reply to comment by toposynthesis in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
JG: There's never been a better time to get into machine learning, with so many amazing open source projects being released, amazing blog and youtube tutorials, and communities of people trying to learn together. Whether you're interested in audio, image generation, game AI, or anything else, I'd recommend you clone a popular open source repo, play around with it for a while, and then see if you can make a small modification!
MetaAI_Official OP t1_izfpjl9 wrote
Reply to comment by Aesthetic_tissue_box in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
One of the key challenges of Diplomacy is modeling how people might respond to your actions. We found that approaches used in prior game AI breakthroughs like Go and poker that relied purely on self-play were not able to anticipate "human" behaviors like retaliation. For that reason, a big contribution of our research is developing a way to incorporate human data into self-play, which allows us to find strong policies that also understand how people approach the game. -NB
MetaAI_Official OP t1_izfpggs wrote
Reply to comment by PolarCow89 in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
CICERO always tries to maximize its own score. However, there is a regularizer that penalizes it for deviating from a human-like policy. When all actions have the same expected value (e.g., when it's guaranteed to lose no matter what) then it will just try to play in a human-like way, which may involve retaliating against those that attacked it. -NB
MetaAI_Official OP t1_izfpeey wrote
Reply to comment by suchenzang in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Controlling the dialogue model via intents/plans was critical to this research. Interfacing with the strategic reasoning engine in this way relieved the language model of most of the responsibility of learning strategy and even which moves are legal. As shown in Fig. 4 in the paper, using an LM without this conditioning results in messages that are (1) inconsistent with the agent's plans, (2) inconsistent with the game state, and (3) lower quality overall. We did not conduct human experiments with an LM like this or a dialogue-free agent, as such behavior is likely to be frustrating to people (who would be unlikely then to cooperate with the agent) and quickly detected as an AI. -ED
MetaAI_Official OP t1_izfpaa6 wrote
Reply to comment by edwardzachary785 in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
We joined a league designed by members of the active online Diplomacy community. The league included new players as well as more experienced players who have performed well in other Diplomacy tournaments. -AM
MetaAI_Official OP t1_izfp4ei wrote
Reply to comment by -ZeroRelevance- in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
I think you could take a similar approach to Mafia or Among Us and do well. In fact, Mafia would be easier because it's still a two-team zero-sum game. We chose Diplomacy specifically because we thought it would be the hardest game to make an AI for and the most "real-world" game due to its natural language component. Now that we've achieved human-level performance in it, we're hoping to move beyond recreational games toward more real-world domains. -NB
MetaAI_Official OP t1_izfp3hc wrote
Reply to comment by Aggravating-Act-1092 in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Since this is a research effort, we don't have plans to host CICERO for public availability. However, we have open-sourced both the model files and code, which means you could host CICERO yourself on a private instance of webDiplomacy.net (also open sourced here). More details can be found here. -CF
MetaAI_Official OP t1_izfoxo4 wrote
Reply to comment by toposynthesis in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
For me personally, I had no practical machine learning experience prior to 2017, although I did have experience in engineering, and with statistics and working with data. I often had personal programming projects going which I worked on in the weekends and evenings. But anyways, among these projects I picked an intro project that I thought would be fun (human move prediction with deep neural nets in computer Go), started looking up tutorials, academic papers, ML libraries and APIs, and that was the start of it. Pick something you're interested in, and dive in! -DW
MetaAI_Official OP t1_izfolik wrote
Reply to comment by loranditsum in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
[AG] Me. The whole team is just next level and every day I was working with them I was sponging up ideas and knowledge. It's just so great being in a room with people who are so good at what they do. While I'm obviously OK at Diplomacy, the AI aspects and how the team attacked problems just blew my mind.
MetaAI_Official OP t1_izfoej8 wrote
Reply to comment by rikiiyer in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
The learned features are specific to the game of the Diplomacy because the data we used is specific to the game of Diplomacy, but the ideas can be transferred to other domains. Rather than just learning Diplomacy by playing against itself, the AI used a model trained on human games both to guide exploration during training (sampling moves from this model during self-play) as well as during planning (consider what actions humans are likely to take). It's not always obvious exactly how to apply this, but we think there's exciting opportunities for research in this space! -AM
MetaAI_Official OP t1_izfod3v wrote
Reply to comment by AnArgumentativeFool in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
We were originally targeting 24hr-turn games, but ended up pivoting to 5min-turn games due to the inability to gather a sufficient number of samples in the 24hr-turn format (as playing a single game can sometimes take months)! Playing 24hr-turn games would indeed pose additional challenges from a language generation perspective — while human players tend to send a similar number of messages in each format, messages in 24hr turns tend to be signficantly longer (and likely more complex). Moreover, human players would have more time to interrogate mistakes from the bot, which could potentially lead to the agent making further mistakes. -ED
MetaAI_Official OP t1_izfo503 wrote
Reply to comment by draconicmoniker in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
While many players do lie in the game, the best players do so very infrequently because it destroys the trust they’ve built with other players. Our agent generates plans for itself as well as for other players that could benefit them, and it tries to have discussions based on those plans. It doesn’t always follow through with what it previously discussed with a player because it may change its mind about what moves to make, but it does not intentionally lie in an effort to mislead opponents. We're excited about the opportunities for studying problems like this that Diplomacy as an environment could provide for researchers interested in exploring this question; in fact, some researchers have already studied human deception in Diplomacy: https://vene.ro/betrayal/niculae15betrayal.pdf and https://www.cs.cornell.edu/~cristian/Deception_in_conversations_files/deception-conversational-dataset.pdf. -AM
MetaAI_Official OP t1_izfo0f7 wrote
Reply to comment by Takithereal in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
The speed at which we managed to progress from no communication to full natural language Diplomacy also surprised the research team. When we started, the idea of an AI agent that could master no-press Diplomacy seemed like a multi-year effort, and the idea of an AI agent that could play full-scale Diplomacy in natural language seemed like science fiction. We thought it might take 10 years to reach this point. -NB
MetaAI_Official OP t1_izfnzva wrote
Reply to comment by weightloss_coach in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Great question! Back when we initiated Diplomacy, I hypothesized that "an agent that can read the rules of any game and play it at an intermediate level" would be the next challenge problem. There's been so much progress on the language modeling side that I think a system like this is within reach within the next 2-3 years if substantial effort was devoted to it. We're starting to see similar task-generality in large language models on real-world tasks, although constructing a symbolic representation for planning out of a text description is still an open research question! -AL
MetaAI_Official OP t1_izfnoh3 wrote
Reply to comment by pm_me_your_pay_slips in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
CICERO's dialogue model is trained to generate messages that honestly correspond to the intents (actions for itself and for its dialogue partner) that are inputs to the model, and CICERO always inputs the action it actually intends to take. That said, that doesn't mean CICERO will never attack any particular player. If it chooses to do so, it might strategically withhold details of its plans from that player. -NB
MetaAI_Official OP t1_izfnjj7 wrote
Reply to comment by ClayStep in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
A related question is "can CICERO take suggestions from other players?" to which the answer is "Yes!". CICERO uses its models to generate a list of "plausible moves" that it reasons over, but if someone suggests an unexpected move to CICERO, it will evaluate that move in its planning and play it if it's a good idea. -AL
MetaAI_Official OP t1_izfnivp wrote
Reply to comment by doU2Boo in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Our final agent does not explicitly try to detect deception. We do have models that predict the actions that people will play based on the board state and message history, and these models may implicitly detect betrayal by predicting actions that don't correspond with the message history. CICERO does have a model that tries to detect whether its *own* messages don't correspond to its intended action, and it will filter out the most egregious cases of that. -JG
MetaAI_Official OP t1_izfn939 wrote
Reply to comment by MetaAI_Official in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Emily is spot on with the revenge point. It is a very understandable human emotion but it doesn't help you win games of Diplomacy. CICERO doesn't get tilted - another thing it shares with strong human players. -AG
MetaAI_Official OP t1_izfn6je wrote
Reply to comment by bpe9 in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
I've talked to a few folks about whether this kind of research is applicable to financial markets and the short answer I've gotten is "not directly". I think there are many more promising directions to take this research, like personal assistants and modeling drivers on roads. -NB
MetaAI_Official OP t1_izfn5kb wrote
Reply to comment by Thorusss in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Re: memory of the whole game/chat — in terms of the dialogue, due to memory constraints, both our dialogue models and dialogue-conditional action models see a fixed context window (typically, only a few turns/phases worth of dialogue, depending on how many messages were sent in a given turn).
Re: betrayal/forgiveness — Many humans fall into the trap of trying to make another player lose out of ""revenge"", even at the cost of making bad strategic decisions relative to their own gameplay. CICERO is designed to take actions that are best for itself. - ED
MetaAI_Official OP t1_izfqers wrote
Reply to comment by MetaAI_Official in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official
Markus was instrumental in organising this - he's deeply connected to the online diplomacy community and his expertise and care for the people involved was pretty critical here. Both from a logistics point of view of getting people to play lots of games but also from making sure there was a good balance. I think from personal feedback I've received it was also a really fun event for the people who participated, so hats off to Markus for all his work on that. -AG