When we consider the future of AI, we need to think about the goals. That’s what humans contribute; that’s what our civilization contributes. The execution of those goals is what we can increasingly automate. What will the future of humans be in such a world? What will there be for them to do? One of my projects has been to understand the evolution of human purposes over time. Today we’ve got all kinds of purposes. If you look back a thousand years, people’s goals were quite different: How do I get my food? How do I keep myself safe? In the modern Western world, for the most part you don’t spend a large fraction of your life thinking about those purposes. From the point of view of a thousand years ago, some of the goals people have today would seem utterly bizarre—for example, like exercising on a treadmill. A thousand years ago that would sound like a crazy thing to do. What will people be doing in the future? A lot of purposes we have today are generated by scarcity of one kind or another. There are scarce resources in the world. People want to get more of something. Time itself is scarce in our lives. Eventually, those forms of scarcity will disappear. The most dramatic discontinuity will surely be when we achieve effective human immortality. Whether this will be achieved biologically or digitally isn’t clear, but inevitably it will be achieved. Many of our current goals are driven in part by our mortality: “I’m only going to live a certain time, so I'd better get this or that done.” And what happens when most of our goals are executed automatically? We won’t have the kinds of motivations we have today. One question I’d like an answer for is, What do the derivatives of humans in the future end up choosing to do with themselves? One of the potential bad outcomes is that they just play video games all the time. The term “artificial intelligence” is evolving, in its use in technical language. These days, AI is very popular, and people have some idea of what it mea