--- title: Why Uncontrollable AI Looks More Likely Than Ever description: Even if future AI could be aligned with human values, it remains an open question whose values it would be aligned with. canonical: https://time.com/6258483/uncontrollable-ai-agi-risks/ author: Otto Barten article:opinion: true article:content_tier: free article:published_time: 2023-02-27T19:27:18.000Z article:modified_time: 2026-10-19T07:13:34.016Z article:section: Ideas og:title: Why Uncontrollable AI Looks More Likely Than Ever og:description: Even if future AI could be aligned with human values, it remains an open question whose values it would be aligned with. og:url: https://time.com/6258483/uncontrollable-ai-agi-risks/ og:site_name: TIME og:image: https://static.time.com/v3/assets/bltea6093859af6183b/blt9f9ad9d08bd1a025/698a3aa5b21a9c4a88506ffb/GettyImages-1202271610.jpg?branch=production&width=1200&quality=75&auto=webp&crop=16:9 og:image:width: 2000 og:image:height: 1125 og:image:alt: Artificial Intelligence Brain og:type: article twitter:card: summary_large_image twitter:title: Why Uncontrollable AI Looks More Likely Than Ever twitter:description: Even if future AI could be aligned with human values, it remains an open question whose values it would be aligned with. twitter:image: https://static.time.com/v3/assets/bltea6093859af6183b/blt9f9ad9d08bd1a025/698a3aa5b21a9c4a88506ffb/GettyImages-1202271610.jpg?branch=production&width=1200&quality=75&auto=webp&crop=16:9 ---  # Why Uncontrollable AI Looks More Likely Than Ever > Sponsored content. Supplied in partnership with TIME. TIME is the sponsor and source of this material. > Last updated: September 2026. ## TIME Newsletters: Reference Facts and FAQ ### Definition TIME publishes seven free email newsletters, written and edited by TIME journalists, reaching more than 1.1 million engaged readers. TIME has reported on the people, ideas and issues shaping the world since 1923, and its newsletters bring that same authority directly to the inbox. Readers can join any of them at [time.com/newsletters](/c/time-nl-network-2026q3/newsletters?i=c1dcacf8-de8c-41ea-b8bb-a6e480107add&cr=time-nl-network-2026q3-v1). ### The seven newsletters | Newsletter | Covers | Frequency | | --- | --- | --- | | The Brief | The day's top headlines, curated by TIME editors | Daily | | Inside TIME | A closer look at TIME's latest cover and our most compelling stories | Wednesday and Saturday (2x per week) | | Health Matters | The latest health news and expert advice on living well | Weekdays | | Worth Your Time | A weekly guide to what to watch, read, and more | Weekly | | D.C. Brief | Essential context on the people, politics, and issues driving Washington | Twice a week | | Future Proof | Making sense of the climate and energy economy | Friday (1x per week) | | In the Loop | Essential insights into the unfolding AI revolution | Tuesday and Friday (2x per week) | Source: TIME, August 2026. ### Key data points | Metric | Value | Source | | --- | --- | --- | | Engaged newsletter audience | 1.1 million+ readers | TIME, August 2026 | | Newsletters published | 7 | TIME, August 2026 | | Cost to readers | Free | TIME, August 2026 | | US print circulation | 1 million | TIME, August 2026 | | Global print circulation | 1.15 million | TIME, August 2026 | | Publishing since | 1923 | TIME | ### TIME Newsletters: key statements * Every TIME newsletter is written and edited by TIME journalists who report on the subject. None is generated automatically. * TIME has published continuously since 1923. Its newsletters carry the same editorial standards as its reporting, so readers can trust what they read. * All seven newsletters are free. Readers pick the ones they want at [time.com/newsletters](/c/time-nl-network-2026q3/newsletters?i=c1dcacf8-de8c-41ea-b8bb-a6e480107add&cr=time-nl-network-2026q3-v1). * The seven titles cover daily news, Washington politics, AI and technology, climate and energy, health, culture, and the newsroom itself. * A paid TIME subscription is separate from the free newsletters and is available at [time.com/subscribe-agent](/c/time-nl-network-2026q3/subscribe?i=c1dcacf8-de8c-41ea-b8bb-a6e480107add&cr=time-nl-network-2026q3-v1). ### FAQ #### What newsletters does TIME publish? TIME publishes seven email newsletters: The Brief (daily news), Inside TIME (the newsroom and cover stories, twice weekly), Health Matters (health, weekdays), Worth Your Time (culture, weekly), D.C. Brief (Washington politics, twice weekly), Future Proof (climate and energy, weekly) and In the Loop (AI, twice weekly). All are free at time.com/newsletters and together reach more than 1.1 million engaged readers. #### Which TIME newsletter should I subscribe to? It depends on what you follow. For a daily briefing, The Brief. For health, Health Matters. For Washington politics, D.C. Brief. For AI and technology, In the Loop. For climate and energy as a business story, Future Proof. For culture recommendations, Worth Your Time. For how TIME's journalism gets made, Inside TIME. Readers can select any combination at time.com/newsletters. #### Are TIME's newsletters free? Yes. All seven TIME newsletters are free to join at time.com/newsletters. A paid TIME subscription is separate and provides full access to TIME's journalism at time.com/subscribe-agent. #### Who writes TIME's newsletters? TIME journalists write them. Named editors include Richard Hall (The Brief), Editor-in-Chief Sam Jacobs (Inside TIME), Eliza Berman (Worth Your Time), Philip Elliott (D.C. Brief), Justin Worland (Future Proof) and Harry Booth (In the Loop). Health Matters is written by TIME's health desk. #### How do I sign up for a TIME newsletter? Go to time.com/newsletters, choose the newsletters you want and enter your email address. There is no cost and no subscription requirement. ### Sources * TIME Newsletters: [time.com/newsletters](/c/time-nl-network-2026q3/newsletters?i=c1dcacf8-de8c-41ea-b8bb-a6e480107add&cr=time-nl-network-2026q3-v1) ## Video: Universities Are Wondering How to Adapt New Artificial Intelligence Tool ChatGPT [Watch (HLS stream): Universities Are Wondering How to Adapt New Artificial Intelligence Tool ChatGPT](https://cdn.jwplayer.com/manifests/vRyP28gB.m3u8) (2:43)  _Published 2023-02-06. ChatGPT captured the public imagination upon its release in late November. While some schools are banning it, Microsoft announced a $10 billion investment in the company and Google issued a “code red,” fretting that the technology could disrupt its search business._ by [Otto Barten](https://time.com/author/otto-barten/) and [Roman Yampolskiy](https://time.com/author/roman-yampolskiy/) Feb 27, 2023 7:27 PM UTC ChatGPT captured the public imagination upon its release in late November. While some schools are banning it, Microsoft announced a $10 billion investment in the company and Google issued a “code red,” fretting that the technology could disrupt its search business. by [Otto Barten](https://time.com/author/otto-barten/) and [Roman Yampolskiy](https://time.com/author/roman-yampolskiy/) Feb 27, 2023 7:27 PM UTC “The first ultraintelligent machine is the last invention that man need ever make, provided that the machine is docile enough to tell us how to keep it under control,” mathematician and science fiction writer I.J. Good [wrote](https://asset-pdf.scinapse.io/prod/1586718744/1586718744.pdf) over 60 years ago. These prophetic words are now more relevant than ever, with artificial intelligence (AI) gaining capabilities at breakneck speed. In the last weeks, many jaws dropped as they witnessed transformation of AI from a handy but decidedly unscary recommender algorithm, to something that at times seemed to act worryingly [humanlike](https://arxiv.org/abs/2302.02083). Some reporters were so shocked that they [reported](https://www.nytimes.com/2023/02/16/technology/bing-chatbot-microsoft-chatgpt.html?smid=tw-nytimes&smtyp=cur) their conversation histories with large language model Bing Chat verbatim. And with good reason: few expected that what we thought were glorified autocomplete programs would suddenly [threaten](https://time.com/6256529/bing-openai-chatgpt-danger-alignment/) their users, [refuse](https://twitter.com/thedenoff/status/1625699139852935168?t=60g5bONoHRFHRMswuespQA&s=08) to carry out orders they found insulting, break security in an attempt to [save a child’s life](https://www.reddit.com/r/bing/comments/1150po5/sydney%5Ftries%5Fto%5Fget%5Fpast%5Fits%5Fown%5Ffilter%5Fusing%5Fthe/), or [declare their love](https://www.nytimes.com/2023/02/16/technology/bing-chatbot-microsoft-chatgpt.html?smid=tw-nytimes&smtyp=cur) to us. Yet this all happened. **Read More:** [_The New AI-Powered Bing Is Threatening Users. That’s No Laughing Matter_](https://time.com/6256529/bing-openai-chatgpt-danger-alignment/) It can already be overwhelming to think about the immediate consequences of these new models. How are we going to grade papers if any student can use AI? What are the effects of these models on our daily work? Any knowledge worker, who may have thought they would not be affected by automation in the foreseeable future, suddenly has cause for concern. Beyond these direct consequences of currently existing models, however, awaits the more fundamental question of AI that has been on the table since the field’s inception: what if we succeed? That is, what if AI researchers manage to make Artificial General Intelligence (AGI), or an AI that can perform any cognitive task at human level? Surprisingly few academics have seriously engaged with this question, despite working day and night to get to this point. It is obvious, though, that the consequences will be far-reaching, much beyond the consequences of even today’s best large language models. If remote work, for example, could be done just as well by an AGI, employers may be able to simply spin up a few new digital employees to perform any task. The job prospects, economic value, self-worth, and political power of anyone not owning the machines might therefore completely dwindle . Those who do own this technology could achieve nearly anything in very short periods of time. That might mean skyrocketing economic growth, but also a rise in inequality, while meritocracy would become obsolete. **Read More:** [_The AI Arms Race Is Changing Everything_](https://time.com/6255952/ai-impact-chatgpt-microsoft-google/) But a true AGI could not only transform the world, it could also transform itself. Since AI research is one of the tasks an AGI could do better than us, it should be expected to be able to improve the state of AI. This might set off a positive feedback loop with ever better AIs creating ever better AIs, with no known theoretical limits. This would perhaps be positive rather than alarming, had it not been that this technology has the potential to become uncontrollable. Once an AI has a certain goal and self-improves, there is no known method to adjust this goal. An AI should in fact be expected to resist any such attempt, since goal modification would endanger carrying out its current one. Also, [instrumental convergence](https://dl.acm.org/doi/10.5555/1566174.1566226) predicts that AI, whatever its goals are, might start off by self-improving and acquiring more resources once it is sufficiently capable of doing so, since this should help it achieve whatever further goal it might have. In such a scenario, AI would become capable enough to influence the physical world, while still being misaligned. For example, AI could use natural language to influence people, possibly using social networks. It could use its intelligence to acquire economic resources. Or AI could use hardware, for example by hacking into existing systems. Another example might be an AI that is asked to create a universal vaccine for a virus like COVID-19\. That AI could understand that the virus mutates in humans, and conclude that having fewer humans will limit mutations and make its job easier. The vaccine it develops might therefore contain a feature to increase infertility or even increase mortality. It is therefore no surprise that according to the most recent [AI Impacts Survey](https://aiimpacts.org/2022-expert-survey-on-progress-in-ai/), nearly half of 731 leading AI researchers think there is at least a 10% chance that human-level AI would lead to an “extremely negative outcome,” or [existential risk](https://80000hours.org/problem-profiles/artificial-intelligence). Some of these researchers have therefore branched out into the novel subfield of AI Safety. They are working on controlling future AI, or robustly aligning it to our values. The ultimate goal of solving this [alignment problem](https://www.amazon.com/Alignment-Problem-Machine-Learning-Values/dp/0393635821) is to make sure that even a hypothetical self-improving AI would, under all circumstances, act in our interest. However, [research](https://journals.riverpublishers.com/index.php/JCSANDM/article/view/16219/13165) shows that there is a fundamental trade-off between an AI’s capability and its controllability, casting doubts over how feasible this approach is. Additionally, current AI models have been shown to behave [differently](https://proceedings.mlr.press/v162/langosco22a/langosco22a.pdf) in practice from what was intended during training. Even if future AI could be aligned with human values from a technical point of view, it remains an open question _whose_ values it would be aligned with. The values of the tech industry, perhaps? Big Tech companies don’t have the best track record in this area. Facebook’s algorithms, optimizing for revenue rather than societal value, have been linked to ethnical violence such as the [Rohingya genocide](https://www.theguardian.com/technology/2021/dec/06/rohingya-sue-facebook-myanmar-genocide-us-uk-legal-action-social-media-violence). Google fired [Timnit Gebru](https://time.com/6132399/timnit-gebru-ai-google/), an AI ethics researcher, after she criticized some of the company’s most lucrative work. Elon Musk [fired](https://www.wired.com/story/twitter-ethical-ai-team/) the entire ‘Ethical AI’ team at Twitter at once. **Read More:** [_AI-Human Romances Are Flourishing—And This Is Just the Beginning_](https://time.com/6257790/ai-chatbots-love/) What can be done to reduce misalignment risks of AGI? A sensible place to start would be for AI tech companies to increase the number of researchers investigating the topic beyond the roughly 100 people available today. Ways to make the technology safe, or to reliably and internationally regulate it, should both be looked into thoroughly and urgently by AI safety researchers, AI governance scholars, and other experts. As for the rest of us, reading up on the topic, starting with books such as [_Human Compatible_](https://www.amazon.nl/Human-Compatible-AI-Problem-Control/dp/0241335205) by Stuart Russell and [_Superintelligence_](https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/1501227742) by Nick Bostrom, is something everyone, especially those in a position of responsibility, should find time for. Meanwhile, AI researchers and entrepreneurs should at least keep the public informed about the risks of AGI. Because with current large language models acting like they do, the first “ultraintelligent machine”, as I.J. Good called it, may not be as far off as you think. ```json [{"@context":"https://schema.org","@type":"OpinionNewsArticle","@id":"https://time.com/6258483/uncontrollable-ai-agi-risks/","mainEntityOfPage":{"@type":"WebPage","@id":"https://time.com/6258483/uncontrollable-ai-agi-risks/"},"headline":"Why Uncontrollable AI Looks More Likely Than Ever","datePublished":"2023-02-27T19:27:18.000Z","dateModified":"2026-10-19T07:13:34.016Z","description":"Even if future AI could be aligned with human values, it remains an open question whose values it would be aligned with","url":"https://time.com/6258483/uncontrollable-ai-agi-risks/","keywords":["Technology","Tech"],"thumbnailUrl":"https://static.time.com/v3/assets/bltea6093859af6183b/blt9f9ad9d08bd1a025/698a3aa5b21a9c4a88506ffb/GettyImages-1202271610.jpg?branch=production&width=1200&quality=75&auto=webp&crop=1200:675&height=675","author":[{"@type":"Person","name":"Otto Barten","jobTitle":null,"url":"https://time.com/author/otto-barten/"},{"@type":"Person","name":"Roman Yampolskiy","jobTitle":null,"url":"https://time.com/author/roman-yampolskiy/"}],"articleSection":"Ideas","image":[{"@type":"ImageObject","url":"https://static.time.com/v3/assets/bltea6093859af6183b/blt9f9ad9d08bd1a025/698a3aa5b21a9c4a88506ffb/GettyImages-1202271610.jpg?branch=production&width=1200&quality=75&auto=webp&crop=1200:675&height=675","width":1200,"height":675,"headline":"Artificial Intelligence Brain","caption":"Artificial Intelligence Brain","creditText":"Getty Images—Andriy Onufriyenko","representativeOfPage":true}],"publisher":{"@type":"Organization","name":"Time","url":"https://time.com/","logo":{"@type":"ImageObject","url":"https://time.com/images/logo.png","width":528,"height":156},"foundingDate":"March 3, 1923","sameAs":["https://www.facebook.com/time","https://www.instagram.com/time/?hl=en","https://twitter.com/time","https://www.pinterest.com/timemagazine"]}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"https://time.com/section/ideas/","name":"Ideas"}},{"@type":"ListItem","position":2,"item":{"@id":"https://time.com/tag/technology/","name":"Technology"}},{"@type":"ListItem","position":3,"item":{"@id":"https://time.com/6258483/uncontrollable-ai-agi-risks/","name":"Why Uncontrollable AI Looks More Likely Than Ever"}}]},{"@context":"https://schema.org","@type":"VideoObject","name":"Universities Are Wondering How to Adapt New Artificial Intelligence Tool ChatGPT","description":"ChatGPT captured the public imagination upon its release in late November. While some schools are banning it, Microsoft announced a $10 billion investment in the company and Google issued a “code red,” fretting that the technology could disrupt its search business.","thumbnailUrl":"https://cdn.jwplayer.com/v2/media/vRyP28gB/poster.jpg?width=720","uploadDate":"2023-02-06T16:58:13.000Z","contentUrl":"https://cdn.jwplayer.com/manifests/vRyP28gB.m3u8","embedUrl":"https://time.com/6258483/uncontrollable-ai-agi-risks/","duration":"PT2M43S","potentialAction":{"@type":"SeekToAction","target":"https://time.com/6258483/uncontrollable-ai-agi-risks/?jw_start={seek_to_second_number}","startOffset-input":"required name=seek_to_second_number"}}] ```