i Origins February 24 — 26, 2017 PROJECT An Origins Project Scientific Workshop ARIZONA STATE UNIVERSITY Challenges of Artificial Intelligence: Envisioning and Addressing Adverse Outcomes 2) DEMOCRACY, INFORMATION, AND IDENTITY Al, Information, and Democracy (Incorporating contributions from Shahar Avin, Sean O hEigeartaigh, David McAllester, Eric Horvitz, and others) An informed public is important to the healthy functioning of democratic societies. We can expect potential forthcoming advances around the control of information feeds with applications in spreading propaganda, via spreading false or misleading information, creating anxiety, fueling conspiracy theories, and influencing voting. Such methods will bring key challenges to democracy. CHALLENGES AHEAD WITH Al, PROPOGANDA, AND PERSUASION Data-centric analyses have been long used in marketing, advertising, and campaigning over decades. However, over the past few years, we have seen the rise of the use of more powerful tools, including machine learning and inference aimed at algorithmic manipulation, with the target of influencing the thinking and actions of people. Some initial uses of these methods reportedly played a role in influencing the outcome of recent US presidential elections, as well as the elections in 2008 and 2012. We can expect to see an upswing in methods that manipulate states of information in a personalized automated manner. These systems can be designed and deployed as omnipresent/persistent, and aimed at specific goals for group- or person-centric persuasion. As our data and models of how people consume and act on information improve, and as an increasing portion of information consumption is mediated through digital systems managed by potentially opaque algorithms, it becomes increasingly conceivable that the information ecosystem would get captured by malicious actors deploying increasingly advanced tools to control, shape, forge and personalize information, from ads to news reports. Ma