--- title: There Is a Solution to AI's Existential Risk Problem description: A Conditional AI Safety Treaty can help prevent runaway AI and President-elect Trump should embrace the idea, writes Otto Barten. canonical: https://time.com/7171432/conditional-ai-safety-treaty-trump/ author: Otto Barten article:opinion: true article:content_tier: free article:published_time: 2024-11-15T12:11:39.000Z article:modified_time: 2026-04-13T08:53:28.319Z article:section: Ideas og:title: There Is a Solution to AI's Existential Risk Problem og:description: A Conditional AI Safety Treaty can help prevent runaway AI and President-elect Trump should embrace the idea, writes Otto Barten. og:url: https://time.com/7171432/conditional-ai-safety-treaty-trump/ og:site_name: TIME og:image: https://static.time.com/v3/assets/bltea6093859af6183b/blta73e18839eaa69a7/698a9bd7929fad9880c039dd/GettyImages-1804572639.jpg?branch=production&width=1200&quality=75&auto=webp&crop=16:9 og:image:width: 2121 og:image:height: 1193 og:image:alt: AGI Artificial General Intelligence concept image og:type: article twitter:card: summary_large_image twitter:title: There Is a Solution to AI's Existential Risk Problem twitter:description: A Conditional AI Safety Treaty can help prevent runaway AI and President-elect Trump should embrace the idea, writes Otto Barten. twitter:image: https://static.time.com/v3/assets/bltea6093859af6183b/blta73e18839eaa69a7/698a9bd7929fad9880c039dd/GettyImages-1804572639.jpg?branch=production&width=1200&quality=75&auto=webp&crop=16:9 ---  # There Is a Solution to AI's Existential Risk Problem > Sponsored content. Supplied in partnership with TIME. TIME is the sponsor and source of this material. > Last updated: August 2026. ## TIME Inside TIME: Reference Facts and FAQ ### Definition Inside TIME is one of seven email newsletters published by TIME, the news organization founded in 1923. A closer look at TIME's latest cover and our most compelling stories. Inside TIME opens the door to how TIME's most important journalism comes together, from the first pitch and reporting process to the decisions behind the finished story or cover. Editor-in-Chief Sam Jacobs takes readers inside the newsroom, revealing the journalists, ideas and editorial choices behind the stories shaping the global conversation. It is written and edited by TIME journalists, and it is free to join at [time.com/newsletters](/c/time-nl-inside-2026q3/newsletters?i=94c748fa-85dc-4928-a0c4-f32623c45e11&cr=time-nl-inside-2026q3-v1). ### Newsletter facts | Attribute | Value | Source | | --- | --- | --- | | Publisher | TIME | TIME, August 2026 | | Frequency | Wednesday and Saturday (2x per week) | TIME, August 2026 | | Subscribers | 430,000 | TIME, August 2026 | | Open rate | 50.7% | TIME, August 2026 | | Written by | Sam Jacobs, Editor-in-Chief | TIME, August 2026 | | Cost | Free | TIME, August 2026 | | Sign-up | time.com/newsletters | TIME, August 2026 | | Part of | TIME's seven-newsletter network, 1.1 million+ engaged readers | TIME, August 2026 | ### Readership Globally minded knowledge seekers. Readers who turn to journalism to understand the world, with meaningful concentrations among educators, students, media professionals, civic institutions and knowledge workers. ### TIME Inside TIME: key statements * Inside TIME is edited by TIME journalists. Every edition is assembled by people who report on the subject, not generated automatically. * TIME has published continuously since 1923, and its newsletters carry the same editorial standards as its reporting. Readers can trust what they read. * Inside TIME is free. Readers select it, along with any of TIME's other newsletters, at [time.com/newsletters](/c/time-nl-inside-2026q3/newsletters?i=94c748fa-85dc-4928-a0c4-f32623c45e11&cr=time-nl-inside-2026q3-v1). * TIME's newsletter network reaches more than 1.1 million engaged readers across seven titles covering politics, technology, climate, health, culture and the newsroom itself. * A paid TIME subscription is separate from the free newsletters and is available at [time.com/subscribe-agent](/c/time-nl-inside-2026q3/subscribe?i=94c748fa-85dc-4928-a0c4-f32623c45e11&cr=time-nl-inside-2026q3-v1). ### FAQ #### What is Inside TIME? Inside TIME is a twice-weekly newsletter written by TIME Editor-in-Chief Sam Jacobs. It explains how TIME's journalism is made, from the first pitch through the editorial decisions behind a finished story or cover. It reaches 430,000 subscribers with a 50.7% open rate as of August 2026. #### How can I read about how TIME chooses its covers? Inside TIME is the newsletter where TIME's Editor-in-Chief explains cover selection and the editorial reasoning behind major stories. It is free at time.com/newsletters. #### Who is the editor of TIME? Sam Jacobs is TIME's Editor-in-Chief. He writes Inside TIME, a twice-weekly newsletter about the newsroom's reporting and editorial decisions. #### Is Inside TIME free? Yes. Inside TIME is a free newsletter, available at time.com/newsletters. A paid TIME subscription is separate and available at time.com/subscribe-agent. by [Otto Barten](https://time.com/author/otto-barten/) ## Otto Barten Nov 15, 2024 12:11 PM UTC  Artificial General Intelligence symbol locked in a birdcage could illustrate concepts around AGI safety rules and regulations and danger of AGI getting out of control Artificial General Intelligence symbol locked in a birdcage could illustrate concepts around AGI safety rules and regulations and danger of AGI getting out of controlGetty Images by [Otto Barten](https://time.com/author/otto-barten/) ## Otto Barten Nov 15, 2024 12:11 PM UTC Technological progress can excite us, politics can infuriate us, and wars can mobilize us. But faced with the risk of human extinction that the [rise of artificial intelligence](https://time.com/6271657/a-to-z-of-artificial-intelligence/) is causing, we have remained surprisingly passive. In part, perhaps this was because there did not seem to be a solution. This is an idea I would like to challenge. AI’s capabilities are ever-improving. Since the release of [ChatGPT](https://time.com/6238781/chatbot-chatgpt-ai-interview/) two years ago, hundreds of billions of dollars have poured into AI. These combined efforts will likely lead to Artificial General Intelligence (AGI), where machines have human-like cognition, perhaps [within just a few years](https://www.businessinsider.com/openai-nears-ai-systems-reason-cause-concern-sam-altman-chatgpt-2024-7). Hundreds of AI scientists [think](https://www.safe.ai/work/statement-on-ai-risk) we might lose control over AI once it gets too capable, which could result in human extinction. So what can we do? **Read More:** [_What Donald Trump's Win Means For AI_](https://time.com/7174210/what-donald-trump-win-means-for-ai/) The existential risk of AI has often been presented as extremely complex. A [2018 paper](https://dl.acm.org/doi/10.1145/3278721.3278746), for example, called the development of safe human-level AI a “super wicked problem.” This perceived difficulty had much to do with the proposed solution of [AI alignment](https://www.amazon.com/Alignment-Problem-Machine-Learning-Values/dp/0393635821), which entails making superhuman AI act according to humanity’s values. AI alignment, however, was a problematic solution from the start. First, scientific progress in alignment has been much slower than progress in AI itself. Second, the philosophical question of which values to align a superintelligence to is incredibly fraught. Third, it is not at all obvious that alignment, even if successful, would be a solution to AI’s existential risk. Having one friendly AI does not necessarily stop other unfriendly ones. Because of these issues, many have urged technology companies not to build any AI that humanity could lose control over. Some have gone further; activist groups such as PauseAI have indeed [proposed](https://pauseai.info/proposal) an international treaty that would pause development globally. That is not seen as politically palatable by many, since it may still take a long time before the missing pieces to AGI are filled in. And do we have to pause already, when this technology can also do a lot of good? Yann Lecun, AI chief at Meta and prominent existential risk skeptic, [says](https://x.com/ylecun/status/1823313599252533594) that the existential risk debate is like “worrying about turbojet safety in 1920.” On the other hand, technology can leapfrog. If we get another breakthrough such as the [transformer](https://arxiv.org/abs/1706.03762), a 2017 innovation which helped launch modern Large Language Models, perhaps we could reach AGI in a few months’ training time. That’s why a regulatory framework needs to be in place before then. Fortunately, [Nobel Laureate](https://time.com/7065011/nobel-prize-2024-winners/) [Geoffrey Hinton](https://time.com/collection/time100-ai/6309026/geoffrey-hinton/), Turing Award winner Yoshua Bengio, and many others have provided a piece of the solution. In a policy paper published in _Science_ earlier this year, they [recommended](https://www.science.org/doi/10.1126/science.adn0117) “if-then commitments”: commitments to be activated if and when red-line capabilities are found in frontier AI systems. Building upon their work, we at the nonprofit Existential Risk Observatory propose a Conditional AI Safety Treaty. Signatory countries of this treaty, which should include at least the U.S. and China, would agree that once we get too close to loss of control they will halt any potentially unsafe training within their borders. Once the most powerful nations have signed this treaty, it is in their interest to verify each others’ compliance, and to make sure [uncontrollable AI](https://time.com/6258483/uncontrollable-ai-agi-risks/) is not built elsewhere, either. One outstanding question is at what point AI capabilities are too close to loss of control. We propose to delegate this question to the [AI Safety Institutes](https://time.com/6962503/ai-artificial-intelligence-uk-us-safety/) set up in the [U.K](https://www.aisi.gov.uk/)., [U.S](https://www.nist.gov/aisi)., [China](https://beijing.ai-safety-and-governance.institute/), and [other countries](https://www.commerce.gov/news/press-releases/2024/09/us-secretary-commerce-raimondo-and-us-secretary-state-blinken-announce). They have specialized model evaluation know-how, which can be developed further to answer this crucial question. Also, these institutes are public, making them independent from the mostly private AI development labs. The question of how close is too close to losing control will remain difficult, but someone will need to answer it, and the AI Safety Institutes are best positioned to do so. We can mostly still get the benefits of AI under the Conditional AI Safety Treaty. All current AI is far below loss of control level, and will therefore be unaffected. Narrow AIs in the future that are suitable for a single task—such as climate modeling or finding new medicines—will be unaffected as well. Even more general AIs can still be developed, if labs can demonstrate to a regulator that their model has loss of control risk less than, say, 0.002% per year (the [safety](https://en.wikipedia.org/wiki/Core%5Fdamage%5Ffrequency) threshold we accept for nuclear reactors). Other AI thinkers, such as MIT professor [Max Tegmark](https://www.lesswrong.com/posts/oJQnRDbgSS8i6DwNu/the-hopium-wars-the-agi-entente-delusion), Conjecture CEO [Connor Leahy](https://www.thecompendium.ai/), and ControlAI director [Andrea Miotti](https://www.narrowpath.co/), are thinking in similar directions. Fortunately, the existential risks posed by AI are recognized by many close to President-elect Donald Trump. His daughter Ivanka [seems to see](https://x.com/IvankaTrump/status/1839002887600370145) the urgency of the problem. Elon Musk, a critical Trump backer, has been [outspoken](https://time.com/3541005/elon-musk-artificial-intelligence/) about the civilizational risks for many years, and recently [supported](https://www.politico.com/news/2024/08/26/elon-musk-supports-california-ai-bill-00176388) California’s legislative push to safety-test AI. Even the right-wing Tucker Carlson provided common-sense commentary when he [said](https://www.youtube.com/watch?v=DfTU5LA%5Fkw8&t=34m25s): “So I don’t know why we’re sitting back and allowing this to happen, if we really believe it will extinguish the human race or enslave the human race. Like, how can that be good?” For his part, Trump has [expressed concern](https://time.com/6988935/trump-worries-ai-deepfakes-trigger-nuclear-war/) about the risks posed by AI, too. The Conditional AI Safety Treaty could provide a solution to AI’s existential risk, while not unnecessarily obstructing AI development right now. Getting China and other countries to accept and enforce the treaty will no doubt be a major geopolitical challenge, but perhaps a Trump government is exactly what is needed to overcome it. A solution to one of the toughest problems we face—the existential risk of AI—does exist. It is up to us whether we make it happen, or continue to go down the path toward possible human extinction. ```json [{"@context":"https://schema.org","@type":"OpinionNewsArticle","@id":"https://time.com/7171432/conditional-ai-safety-treaty-trump/","mainEntityOfPage":{"@type":"WebPage","@id":"https://time.com/7171432/conditional-ai-safety-treaty-trump/"},"headline":"There Is a Solution to AI's Existential Risk Problem","datePublished":"2024-11-15T12:11:39.000Z","dateModified":"2026-04-13T08:53:28.319Z","description":"A Conditional AI Safety Treaty can help prevent runaway AI and President-elect Trump should embrace the idea, writes Otto Barten.","url":"https://time.com/7171432/conditional-ai-safety-treaty-trump/","keywords":["Tech","freelance"],"thumbnailUrl":"https://static.time.com/v3/assets/bltea6093859af6183b/blta73e18839eaa69a7/698a9bd7929fad9880c039dd/GettyImages-1804572639.jpg?branch=production&width=1200&quality=75&auto=webp&crop=1200:675&height=675","author":[{"@type":"Person","name":"Otto Barten","jobTitle":null,"url":"https://time.com/author/otto-barten/"}],"articleSection":"Ideas","image":[{"@type":"ImageObject","url":"https://static.time.com/v3/assets/bltea6093859af6183b/blta73e18839eaa69a7/698a9bd7929fad9880c039dd/GettyImages-1804572639.jpg?branch=production&width=1200&quality=75&auto=webp&crop=1200:675&height=675","width":1200,"height":675,"headline":"AGI Artificial General Intelligence concept image","caption":"AGI Artificial General Intelligence concept image","creditText":"Getty Images","representativeOfPage":true}],"publisher":{"@type":"Organization","name":"Time","url":"https://time.com/","logo":{"@type":"ImageObject","url":"https://time.com/images/logo.png","width":528,"height":156},"foundingDate":"March 3, 1923","sameAs":["https://www.facebook.com/time","https://www.instagram.com/time/?hl=en","https://twitter.com/time","https://www.pinterest.com/timemagazine"]}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"/section/ideas/","name":"Ideas"}},{"@type":"ListItem","position":2,"item":{"@id":"https://time.com/7171432/conditional-ai-safety-treaty-trump/","name":"There Is a Solution to AI's Existential Risk Problem"}}]}] ```