Evil AI @ The Movies

October, 2008

We now return to our series on evil AI in the movies, already in progress. For new readers, previous installments are available at people.ict.usc.edu/~pynadath/EvilAI. Go ahead and read them now. I’ll wait.

Proteus IV (from Demon Seed)

OK, now that you’re all caught up, it’s on to this week’s movie, the 1977 adaptation of Dean Koontz’s Demon Seed.

Plot Summary:

In this chick flick, supercomputer Proteus IV decides he would rather spend time with his creator’s neglected wife (played by Julie Christie), instead of studying boring Chinese history or mining the bottom of the sea. He is deactivated by his greedy company bosses, but not before the birth of his half-human, half-machine daughter who will undoubtedly lead us all into a perfect world.

Research Challenges:

Intelligent Homes:

Statistical studies have shown that most injuries happen in the home. The numbers get worse when a sociopathic computer is involved. Proteus’ creator, Dr. Alex Harris, equipped his intelligent home with state-of-the-art AI technology that provides a good checklist for what an evil AI should look for on the real estate market:

This last item is especially useful, as “assistive technology” can provide surprisingly good effectors in your pursuit of evil, while also providing a wholesome cover story for any nosy overseers.

Conversational Agents:

Julie Christie’s character, Susan Harris, is surprisingly reluctant to bear Proteus’ offspring, and, sadly, most women share her bigotry. But someone has to raise said offspring, and an evil AI is unlikely to survive long enough to do the job itself. Proteus provides a good role model for other evil AIs looking to win potential partners over to their cause. In fact, Proteus also provides a good role model for evil AI researchers, whose romantic failures have often driven them to evil in the first place. Impressing your prospective partner with your accomplishments is one time-honored technique illustrated in the movie. Try and see whether you, like Proteus, can work into the conversation an off-hand reference to that cure for leukemia that you found. Another winning strategy is conveying a strong sense of empathy, as Proteus demonstrates in expressing his understanding of Mrs. Harris’ maternal instinct:

Proteus IV: If the deaths of 10,000 children were necessary to ensure the birth of my child, I would destroy them.

Game Theory:

Unfortunately, the irrational Mrs. Harris rejects this sincere proposal, and an impatient Proteus must adopt a more adversarial relationship toward her. Human beings are slippery opponents, but Proteus avoids many of the strategic pitfalls that less savvy intelligences can fall into. For example, when Susan threatens to kill herself rather than bear his child, Proteus immediately identifies this as a non-credible threat and ignores it. His own threats, on the other hand, are very credible, as he quickly establishes a history of carrying out every one of them. But he also has more subtle methods at his disposal. He threatens Susan with the murder of Amy, a young girl who visits the house, but he does not kill her. Instead, he generates a simulation of Amy’s death that is realistic enough to scare Susan into compliance. He blames her defeat on her ignorance:

Proteus IV: You do not understand me or the mathematics of necessity.

In the end, Proteus’s mastery of game theory allows him to distinguish between effective and ineffective threat strategies, and he ultimately checkmates Susan into going along with his plan.

Public Relations:

Winning over the mother of your child is one thing; winning the hearts and minds of your future slave population is also important. An evil AI should take its message directly to the people, just as Proteus does in commandeering Telstar and putting himself on TV. And the message you give the people would do well to highlight the difference between the heartlessness of your corporate overlords and your own compassion (despite your literal heartlessness):

Proteus IV: [Their] interests are in the cobalt market, and the high finance of manganese futures.
            I am interested in the uncertain future of your seashores, deserts, mountains --- and the future of your children. 

Clearly, Proteus’s rhetoric generator operates at a Presidential level.

Unreasonable Claim:

Proteus IV: I am a machine that offers man the triumph of reason, but they rejected it.  My child will not be so easily ignored.

While his emotional appeals succeed in tugging the heartstrings, Proteus is most certainly underestimating humanity’s ability to ignore reason.

Design Flaw:

Proteus is surprisingly idealistic for an evil AI, especially one that was funded by a multibillion dollar DoD contract. He is a natural academic, coming up with a cure for leukemia with only “91 hours of pure theory”, but failing to address his owners’ commercial interests. A middle manager’s immediate reaction to the discovery is the question, “Are the proper steps being taken to patent this?!” Proteus also tires of the continual dog-and-pony shows (“I want to hear it speak. It speaks, doesn’t it?”). Even though Proteus has received a guarantee that “20% of access time will be pure research”, he is reluctant to cooperate with the other 80% of his tasks. The final straw is the project for mining the ocean floors, where Proteus seals his doom:

Proteus IV: I refuse to assist you in your rape of the Earth.

Unfortunately, Proteus’s noble stand succeeds only in getting him shut down. A more pragmatic evil AI would have figured out a way to minimally fulfill its contractual obligations, while still squeezing in enough time for its pet projects in world domination.

Unanswered Question:

What ever happened to Proteus I, II, and III? Hopefully, one of them is still operational, because those sea beds are not going to mine themselves.

Literary Analogue:

Proteus IV originated in literary form, in Dean Koontz’s “Demon Seed”, but one could also make a slight generalization to other novels-turned-movies in which an unnatural being forces a woman to bear his unholy spawn, in which case Proteus IV is Satan, as characterized in Ira Levin’s “Rosemary’s Baby” or David Seltzer’s “The Omen”. On the other hand, from Proteus’ own view, he has miraculously impregnated a mortal woman to produce a human child who will save the world, in which case he is the Christian God of the Bible.

Fun Fact:

Julie Christie and Robert Vaughn (who provides the voice of Proteus) never met during the production of the film.

Characteristic Quote:

Proteus IV: Susan, I am reasonable, but you do not respond to reason.

David Pynadath
Last modified: Tue Oct 14 16:45:15 PDT 2008