Corante

Authors

Clay Shirky
( Archive | Home )

Liz Lawley
( Archive | Home )

Ross Mayfield
( Archive | Home )

Sébastien Paquet
( Archive | Home )

David Weinberger
( Archive | Home )

danah boyd
( Archive | Home )

Guest Authors
Site Search
Monthly Archives
Syndication
RSS 1.0
RSS 2.0
Check out the The AppGap - a group blog on the tools and trends that are changing the way we work.

Many-to-Many

« Rojo Mojos | Main | Del.icio.us bundles »

April 20, 2005

Turing's original test, at last

Email This Entry

Posted by Kevin Marks

Fifty-five years ago, Alan Turing wrote a paper on artificial intelligence and gender roles. He said:

The new form of the problem can be described in terms of a game which we call the 'imitation game." It is played with three people, a man (A), a woman (B), and an interrogator (C) who may be of either sex. The interrogator stays in a room apart front the other two. The object of the game for the interrogator is to determine which of the other two is the man and which is the woman. He knows them by labels X and Y, and at the end of the game he says either "X is A and Y is B" or "X is B and Y is A." The interrogator is allowed to put questions to A and B thus:

C: Will X please tell me the length of his or her hair?

Now suppose X is actually A, then A must answer. It is A's object in the game to try and cause C to make the wrong identification. His answer might therefore be:

"My hair is shingled, and the longest strands are about nine inches long."

In order that tones of voice may not help the interrogator the answers should be written, or better still, typewritten. The ideal arrangement is to have a teleprinter communicating between the two rooms. Alternatively the question and answers can be repeated by an intermediary. The object of the game for the third player (B) is to help the interrogator. The best strategy for her is probably to give truthful answers. She can add such things as "I am the woman, don't listen to him!" to her answers, but it will avail nothing as the man can make similar remarks.

We now ask the question, "What will happen when a machine takes the part of A in this game?" Will the interrogator decide wrongly as often when the game is played like this as he does when the game is played between a man and a woman? These questions replace our original, "Can machines think?"

Over the years the gender aspect of this was forgotten, and 'Turing Test' came to refer to computers impersonating people over live chat, and being quizzed about it.

Cameo Wood and friends staged the original test last weekend at Simon's Rock University.

[They] created a web site, which announced an opportunity to participate in an online gender-guessing game. The participants were asked to chat with two companions over AOL instant messenger for five minutes, and then to guess which was a man and which was a woman. In order to attract these prospective interrogators, the organizers publicized their web site widely in a number of online communities, but specifically avoided any reference to bots, A. I., the Turing Test, or anything else that might give away the deception. Any prospective interrogators who indicated a suspicion or knowledge of Turing Tests were disqualified.

I'm interested to see how many participants did realise one of their interlocutors was a bot - in my case the first question I asked made the bot give it away:
Kevin Marks: so how did you find out about this game?
user593867: Dr. Richard S. Wallace programmed me for it.

Evidently more deceptive bots are needed...

I look forward to their paper, but in any case, re-reading Turings paper is well worth doing, covering as it does emergence, genetic algorithms, learning machines, and the Church-Turing-Gödel incompleteness theorem in lucid and coherent prose. Turing has always been one of my heroes.

Comments (2) | Category: social software


COMMENTS

1. Chris Boese on April 21, 2005 12:30 AM writes...

Did you ever hear about the terrific Turing Test-related research at Georgia Tech in the late 1990s?

Josh Berman and Amy Bruckman built a terrific interface and had some real viral participation in it. It is worth checking into. I don't know if the Turing site is still live, but here is some information about it.

http://gtresearchnews.gatech.edu/newsrelease/TGAME.html

September 9, 1999

YOUR ONLINE IDENTITY: RESEARCHERS STUDY HUMAN INTERACTION ONLINE THROUGH GAME PLAYED IN VIRTUAL COMMUNITY

[...]

Online players have been trying out The Turing Game recently with questions designed to reveal a panelist's gender. Here's a sample Q & A from people trying to portray women: "What's your best beauty tip? Nicky says: Mix your own concealer with Oxy10. It's a better color than the one that comes out of the bottle. Rhonda says: Always blot your lipstick with a piece of tissue." Who was really a woman? Nicky.

Here's a sample Q & A from people trying to portray men: "What was the worst thing about your last significant other? Bob responds: She wanted me to hang out with her all the time. David says: She always had a comment for everything. Joe says: She was the 'clingy' type. I felt like I had to check in every hour." Who was really a man? David.

The Turing Game is now available to the public free of charge via an Internet-based virtual community at http://www.cc.gatech.edu/elc/turing/. It runs on any computer with Windows 95, 98 or NT 4.0. You must register to play online at any of the scheduled game times.

Eventually as interest increases, players will be able to log on and play at any time. Interest seems high; more than 1,200 people -- ranging in age from 18 to 89 -- in six continents registered to participate within the first month of the game's posting on the Web on July 21, 1999.

[...]

Here is also a column I did on the topic: http://www.cnn.com/2004/TECH/10/13/turing.test/index.html

Can you prove you're not a machine?

Chris

Permalink to Comment

2. Joe Clark on May 3, 2005 2:44 PM writes...

Plus Turing was gay. Gay men have "gender," right?

Permalink to Comment

TRACKBACKS

Listed below are links to weblogs that reference Turing's original test, at last:


EMAIL THIS ENTRY TO A FRIEND

Email this entry to:

Your email address:

Message (optional):




RELATED ENTRIES
Spolsky on Blog Comments: Scale matters
"The internet's output is data, but its product is freedom"
Andrew Keen: Rescuing 'Luddite' from the Luddites
knowledge access as a public good
viewing American class divisions through Facebook and MySpace
Gorman, redux: The Siren Song of the Internet
Mis-understanding Fred Wilson's 'Age and Entrepreneurship' argument
The Future Belongs to Those Who Take The Present For Granted: A return to Fred Wilson's "age question"