February 28, 2010

The Prisoner's Dilemma, The Striatum, And The Dragonmaw Shinbones

I just finished rereading Satisfaction, which is one of my favorite psychology books (and therefore one of my favorite game design books). I really recommend reading it yourself, but here's one of the theses in a nutshell: Greg Berns believes that the Striatum is the region of the brain that controls how satisfied we feel, and that it is best activated by unpredictable stimuli.

Have you heard of the Prisoner's Dilemma? It's a scenario in game theory that examines how willing people are to make themselves vulnerable to betrayal:

Two suspects are arrested by the police. The police have insufficient evidence for a conviction, and, having separated both prisoners, visit each of them to offer the same deal. If one testifies (defects from the other) for the prosecution against the other and the other remains silent (cooperates with the other), the betrayer goes free and the silent accomplice receives the full 10-year sentence.

If both remain silent, both prisoners are sentenced to only six months in jail for a minor charge. If each betrays the other, each receives a five-year sentence. Each prisoner must choose to betray the other or to remain silent. Each one is assured that the other would not know about the betrayal before the end of the investigation. How should the prisoners act?
If both prisoners implicate each other, both will be punished. If both "cooperate," they will each be punished minimally. If one tries to cooperate but the other betrays them, the betrayer will go free, but the cooperator will be punished severely.

By remaining silent, a prisoner opens the possibility to not be punished at all, but must also willingly make themselves vulnerable to the worst punishment if they are betrayed.

Uncertainty can be very satisfying

In the last chapter of the book, Berns returns home after traveling the world to apply everything he has learned to his marriage. While examining the psychology of relationships and the temptation of infidelity, he examines the effects of the Prisoner's Dilemma on the Striatum:

In a brain imaging study of the prisoner's dilemma, Jim Rilling, a postdoctoral student in my department, found that parts of the striatum were activated when people cooperate. Given the close relationship of the striatum with reward and action, he naturally concluded that social cooperation is rewarding to the human brain. But it was not the act of cooperation alone that activated the striatum; it was mutual cooperation.

By design, mutual cooperation does not always result in the best outcome for each participant, not only because cooperation entails risk but also because it depends on making yourself vulnerable, which, in turn, creates opportunities for betrayal.

Whether it is a romantic relationship or a business deal, cooperation means uncertainty. When you do cooperate, and the act is reciprocated, the novelty of this outcome is picked up by the striatum. Perhaps that is the reason mutually reciprocated acts feel so good. The fact that cooperation doesn't always happen is exactly why it is so satisfying.



If you're like me, it's not hard to think of lots of moments from games when people were supposed to be cooperating but didn't: people getting the team killed in MMOs, Spies in EVE, players in shooters griefing the hell out of their teammates, etc.

What reading this quote really brought to mind for me, though, was a moment in World of Warcraft when an enemy and I managed to cooperate [I played on a PvP server]. As Bern predicted, it was very satisfying and has became one of my favorite memories from that game.

Dragonmaw Shinbones

At around level 30 in WoW, players of the warrior class are sent on several quests to gather resources which NPCs then turn into set of Brutal Armor for them. By level 30, most areas players quest in are contested zones, meaning that on PvP servers players often run across players from the enemy faction and have to fight.

Blizzard is careful to make sure that quests lead players from opposite factions to the same places at around the same level, to facilitate this conflict. One such place is the Angerfang Encampment, an out of the way location most people would never go except for the few quests that lead there (one of which being the quest for the Brutal Armor).

I was sent to the encampment for some Dragonmaw Shinbones, and happened to get there at the same time as a warrior from the other faction, presumably on the same quest. We traded deaths back and forth a few times, until ultimately one of us accidentally aggroed the local miniboss, whose army killed both of us. I don't remember whose idea it was, but one of us started to try and call a truce so that we could work together.

At this point I should mention for those that haven't played WoW that Blizzard does a great job of making the two factions feel at odds. Words typed by one faction are garbled to the other, and players on PvP servers aren't allowed to have characters on more than one of the factions. So the only way the other warrior and I could begin to form a truce and kill the boss was to use lots of emotes such as /bow /point /wait /sorry /ready etc.

We spent the next hour fighting enemies in the quest zone for our shinbones, and killing the miniboss as he respawned. We had to learn some new ways to fight, because all of our AoE powers would affect each other as well as the mobs. It was hilarious and terrifying when we died because I accidentally sent him running into a crowd of enemies. At one point, more players from his faction showed up and he even stopped them from killing me.



It was the only in an online game that I felt I'd had a reason to form an alliance with an enemy. That warrior and I probably killed each other hundreds of times after that in the battlegrounds without even noticing, but that temporary alliance was a great experience that shook up my expectations and made me feel as though I was part of a real world for a little while. I'm sure this sort of thing must've happened in multi-faction PvP games such as DAoC and Shadowbane, but I never played either of those very seriously.

Surprising doesn't have to mean punishing

There are actually lots more examples of this kind of thing in WoW, which is surprising because it's known for being so accessible. Being surprised in an online game doesn't necessarily imply having all your possessions stolen or your corpse camped for hours at a time. Sometimes it means players or a giant monster invading your city, or a bunch of level 1 players ganging up on a level 25. If you ask players if they want to be surprised, they (and I) will almost always say no, but the truth is we like the way it feels from time to time.

WoW is a game that's very good at leaving loopholes for interesting experiences while still being a "casual-friendly" game. These kinds of shenanigans don't really hurt anything, and are usually pretty easy to avoid if you're not in the mood. WoW could probably be better about making important areas like auction houses inaccessible to enemies, and the zombie event should probably have never happened on PvE servers, but PvP Servers in WoW usually manage to feel chaotic and dangerous without making player feel as though they have lost control over their playtime. This is something worth emulating.