Humans Need Not Apply: A Guide to Wealth and Work in the Age of Artificial Intelligence
by Jerry Kaplan, 2015

Expands on the ideas in this video:

Actually, I got the causation backward when I checked out the book from the library. I thought the video above was based on the book, but: “I would also like to acknowledge that the title for this book is not original – it is borrowed from an outstanding short video of the same name by the famously reclusive C.G.P. Grey. I’m a big fan. Check out his work on YouTube.” (pg. 210)

Good discussion of how synthetic intelligences can do many things better and faster than humans ever could. However, optimistic on the whole: “I’m supremely confident that our future is very bright – if only we can figure out how to equitably distribute the benefits.” (pg 197)

Quick read.

Superintelligence: Paths, Dangers, Strategies
by Nick Bostrom, 2014

When the book chooses to include a jacket blurb that says “A damn hard read” by the Sunday Telegraph, you know they’re not screwing around. Definitely reads like a lengthy academic paper (260 main text pages). Covers the paths to a machine intelligence takeoff and possible efforts to control or shape such a future. Basically, a super intelligent machine or being will have motivations and capabilities that are hard to control, and if we don’t tackle the control problem before the intelligence takes off, we’re all doomed.

I like the closing paragraphs:

Before the prospect of an intelligence explosion, we humans are like small children playing with a bomb. Such is the mismatch between the power of our plaything and the immaturity of our conduct. Superintelligence is a challenge for which we are not ready now and will not be ready for a long time. We have little idea when the detonation will occur, though if we hold the device to our ear we can hear a faint ticking sound.

For a child with an undetonated bomb in its hands, a sesible thing to do would be to put it down gently, quickly back out the room, and contact the nearest adult. Yet what we have here is not one child but many, each with access to an independent trigger mechanism. The chances that we will all find the sese to put down the dangerous stuff seem almost negligible. Some little idiot is bound to press the ignite button just to see what happens.

Nor can we attain safety by running away, for the blast of an intelligence explosion would bring down the entire firmament. Nor is there a grown-up in sight.

In this situation, any felling of gee-wiz exhilaration would be out of place. Consternation and fear would be closer to the mark; but the most appropriate attitude may be a bitter determination to be as competent as we can, much as if we were preparing for a difficult exam that will either realize our dreams or obliterate them.

This is not a prescription of fanaticism. The intelligence explosion might still be many decades off in the future. moreover, the challenge we face is, in part, to hold on to our humanity: to maintain our groundedness, common sense, and good-humored decency even in the teeth of this most unnatural and inhuman problem. We need to bring all our human resourcefulness to bear on its solution.

Yet let us not lose track of what is globally significant. Through the fog of everyday trivialities, we can perceive – if but dimly – the essential task of our age. In this book, we have attempted to discern a little more feature in what is otherwise still a relatively amorphous and negatively defined vision – one that presents as our principal moral priority (at least from an impersonal and secular perspective) the reduction of existential risk and the attainment of a civilizational trajectory that leads to a compassionate and jubilant use of humanity’s cosmic endowment.

The Soul of a New Machine
by Tracy Kidder, 1981

Maria has her students read this book in Computer Systems class. So I decided to read it. It certainly provides good insight into hardware/software engineers. How they act. Their temperaments. Their biases. Their need for ‘interesting’ or ‘creative’ work and their willingness to reinvent the wheel so that it can be created ‘here’. Having played a similar role at my job, I can say that the depiction is pretty accurate. The 35 year old book is still relevant today.

That being said, one of my least favorite things in the world is to read other people’s code. A short logic jump would say that I don’t particularly like to debug or help people debug. As such, reading about other people debugging was not my favorite subject matter ever.

The story focuses upon a new 32-bit microcomputer being built at Data General. Tracy Kidder became embedded in the development group and followed their actions for about 1-2 years. Data General declined in the 80’s and was bought by EMC in 1999. A more recent version of ‘writer gets embedded with development team’ is Scott Rosenburg’s Dreaming in Code.