The Man Who Wasn't Afraid of Robots. Sagan and the Machines, lecture 1. Terence Kok and Michael Low, with a faint portrait of Carl Sagan above a painted Mars rover.
ML TK
Why Sagan, why now

He answered the AI debate in 1979. We are in the middle of it.

47

years between Sagan's defence of intelligent machines and today

The builders of frontier AI now say the takeoff has started. See The Future of Humanity, Part 1, terencekok.com.

ML TK
The chapter

Broca's Brain, chapter 20: in defence of robots.

Sagan, Broca's Brain (1979), pp. 295 to 308. Photo: NASA/JPL, public domain.

ML TK
His word for the prejudice

Speciesism

The assumption that no being is as capable or reliable as a human, applied to machines before the evidence is in.

“A conclusion drawn before all the facts are in.”

Carl Sagan, Broca's Brain, 1979, p. 296

Sagan and the Machines · Lecture 1
ML TK
The fair rule

His test cuts both ways.

Before the facts Dismiss the machine Trust the machine Both are prejudgment Ask for evidence

Sagan defined the prejudice as prejudgment. Applying it to trust as well as dismissal is our reading.

Sagan and the Machines · Lecture 1
ML TK
What he offered as evidence

Three working examples.

One

A conversation

Turing's test: can a machine pass for a human in a typed exchange? Sagan said none was that good yet.

Two

A block world

Winograd's program stacked children's blocks on typed instructions and explained why it moved each one.

Three

A machine therapist

Weizenbaum's program turned a patient's statements back as questions. Sagan called one reply astonishing.

Sagan and the Machines · Lecture 1
ML TK
The machine therapist

He imagined booths where anyone could talk.

you>my manager never listens to me bot>WHY DO YOU THINK YOUR MANAGER NEVER LISTENS you>because i am always last to speak bot>DOES THAT TROUBLE YOU
Sagan, 1979

The reply was preprogrammed, he wrote, but so are human therapists' replies.

Weizenbaum, 1976

Short exposures could induce "powerful delusional thinking in quite normal people."

Chat is an illustrative exchange in ELIZA's reflect-the-statement style, not Sagan's transcript. Weizenbaum quote via History.com.

ML TK
A prediction that was tested

The ten best players had nothing to fear. For a while.

1979

Sagan writes that the ten best chess players have nothing to fear from any present computer, and that the situation is changing.

Dec 1996

Carl Sagan dies on 20 December.

May 1997

Deep Blue beats world champion Garry Kasparov, 3.5 to 2.5.

Sagan, Broca's Brain, p. 301. History.com on Deep Blue; Cornell Chronicle, 20 December 1996.

Sagan and the Machines · Lecture 1
ML TK
The case for a machine that decides

A message to Mars arrives forty minutes too late.

Earth 20 light-minutes in Sagan's example Mars query reply

Sagan, Broca's Brain, p. 304. NASA, Perseverance Sol 200 AutoNav drive.

ML TK
How far up the ladder

He expected the climb to be slow.

Insect Crocodile Squirrel Dog

Viking, he wrote, was about as intelligent as a dragonfly.

Sagan, Broca's Brain, pp. 305 to 306. The rung layout is our summary.

Sagan and the Machines · Lecture 1
ML TK
Forty-seven years on

What he got right, and what he missed.

Sagan in 1979Since thenOur reading
Ten best players have nothing to fearDeep Blue wins in 1997Right, early
Rovers will need to decide for themselvesPerseverance picks its own pathRight
Machines will be specialisedFrontier models are general-purposeMissed
Machine therapy is possible; confidentiality to be worked outCompanion chatbots exist; privacy still openLight on risk
Displaced workers re-employed within a generationContestedUntested

Our own comparison. Sagan: Broca's Brain, pp. 301 to 307.

Sagan and the Machines · Lecture 1
ML TK
Where we part company

Three places his case is weakest.

One

Therapy

Weizenbaum drew the opposite lesson from the same program: people read understanding into a machine.

Two

Work

Re-employment, he wrote, should not be too difficult. He gave it a few sentences and little evidence.

Three

The word

A label like speciesism can end an argument as easily as win it. His own test says to ask for facts.

Sagan and the Machines · Lecture 1
ML TK
Verdict

Right on method. Early on machines. Light on risk.

Sagan and the Machines · Lecture 1
ML TK
Next

Part 2: Moving the Goalposts

Every time a machine passes a test of intelligence, the test changes. Who gets to move it?

1The Man Who Wasn't Afraid of Robots
6Who Meets Us First
2Moving the Goalposts
7The Candle in the Dark
3The Terminal That Listens
8A Society Nobody Understands
4Memory Outside the Body
9Who Holds the Button
5Robots on Other Worlds
10Who Speaks for Earth
Michael Low monogram

Terence Kok and Michael Low · terencekok.com/blog/series/sagan-and-the-machines