ApsûVoyage of a Thousand Books
Chart of the Sea of Books
Drag or zoom the chart. Tap an island to go ashore.
Who is this book for?
- People worried that humans will lose control once AI becomes ever more powerful
- Readers who want to know what "AI safety" actually studies without reading too much math
- Students of computing, philosophy, or policy who want a classic introduction to AI ethics
- People who have heard the "paperclip" or "AI will destroy humanity" claims and want to know what experts' real arguments are
Who is the author?
- Stuart Russell is a professor of computer science at the University of California, Berkeley
- With Peter Norvig, he co-wrote Artificial Intelligence: A Modern Approach, the world's most widely used AI textbook
- The book's English title is Human Compatible: Artificial Intelligence and the Problem of Control, published in 2019
Other BooksArtificial Intelligence: A Modern Approach (with Peter Norvig)
Reading notes
🔒 Arrive at Lofoten and visit the Norwegian Forest Cat to unlock this
Sail to LofotenWhat Steps Remain Before Superintelligence
Russell believes the key to making AI superintelligent is not that computers are not fast enough, but that several conceptual breakthroughs have not yet been made: truly understanding language, having common sense, being able to keep accumulating learning, being able to discover the hierarchical structure of things on its own, and being able to think about its own thinking.
These are algorithmic problems, and no one knows when they will be solved, but he cautions that we cannot wait until it happens before starting to think about how to control it.
Enormous Rewards and Enormous Risks
Why Worry Starting Now
Reception and Debate
The Gorilla Problem
The Fatal Flaw of the "Standard Model"
King Midas and "You Can't Fetch the Coffee If You're Dead"
Three New Principles
Assistance Games and the Off-Switch
Unsolved Problems
Navigators' bottles Reader reviews
Leave a bottle
Share your thoughts! You might meet voyagers who think just like you.
Register as a voyager to open the bottles.
0 bottles
Shang
Shang's books
Voyager's Guide
This world
The Sea of Books has 16 real islands, one for each subject. Every building on an island is a book.
What you can do now
- Tap an island on the chart to go ashore
- Tap a building to read the notes on that book
- Meet Shang, the Navigator
Coming soon
- Chapter 2: register as a voyager, sail your ship, collect building badges, send message bottles
- Chapter 4: private chats with other voyagers
Symbols
Navigator's registry
Before you set sail, we'll register your ship.