--- description: Should private corporations be allowed to run uncontrolled experiments on humanity? title: There Is Only One Question That Matters with AI image: https://static.time.com/v3/assets/bltea6093859af6183b/blta6332a1ec7e9fc7c/698a3bb4457a527c51d67748/GettyImages-1248378377.jpg?branch=production&width=2400&quality=75&auto=webp&crop=16:9 --- * [Ideas](/section/ideas/) ## Ideas Update your preferences in [Account Settings](/account/preferences/) Close * [Technology](/tag/technology/) ## Technology Update your preferences in [Account Settings](/account/preferences/) Close # There Is Only One Question That Matters with AI ## Video: Universities Are Wondering How to Adapt New Artificial Intelligence Tool ChatGPT [Watch (HLS stream): Universities Are Wondering How to Adapt New Artificial Intelligence Tool ChatGPT](https://cdn.jwplayer.com/manifests/vRyP28gB.m3u8) (2:43)  _Published 2023-02-06. ChatGPT captured the public imagination upon its release in late November. While some schools are banning it, Microsoft announced a $10 billion investment in the company and Google issued a “code red,” fretting that the technology could disrupt its search business._ Apr 5, 2023 2:07 PM CUT  The GPT-4 logo is seen in this photo illustration on 13 March, 2023 in Warsaw, Poland. The GPT-4 logo is seen in this photo illustration on 13 March, 2023 in Warsaw, Poland.Jaap Arriens-NurPhoto  by [Roger McNamee](/author/roger-mcnamee/)  ## Roger McNamee Update your preferences in [Account Settings](/account/preferences/) Close Apr 5, 2023 2:07 PM CUT A group called Future of Life Institute has circulated a [petition](https://futureoflife.org/open-letter/pause-giant-ai-experiments/ "undefined"), signed by nearly 3,000 people in and around the technology industry, calling for a six-month moratorium on large scale experiments with artificial intelligence (AI). The petition has triggered a [huge debate](https://time.com/6266679/musk-ai-open-letter/ "undefined"). Those who have signed the petition note that developers of GPT-4 and other large language model AIs [promise that their technology](https://abcnews.go.com/Technology/openai-ceo-sam-altman-ai-reshape-society-acknowledges/story?id=97897122 "undefined") will change the course of civilization, but claims they have not taken appropriate steps to protect civilization from harm. They frame the future of AI in apocalyptic terms. Those who oppose the petition fall into two large buckets: those who are comfortable with the status quo of rapidly developing AI models and those who believe the petition sponsors are so focused on the future that they ignore widespread harms from existing applications of AI. The latter argument is particularly interesting, as the group includes leading technologists and scholars in the AI field, including [Timnit Gebru](https://time.com/6132399/timnit-gebru-ai-google/ "undefined"), Emily Bender, and Margaret Mitchell. We really do need a different approach to AI, the first step of which is acknowledgement that AI is just the latest manifestation of the Silicon Valley hype machine. AI is just code where the [benefits](https://www.techrepublic.com/videos/ai-has-a-history-of-overpromising-and-under-delivering/ "undefined") fall far short of what the promoters [promise](https://aiimpacts.org/2022-expert-survey-on-progress-in-ai/ "undefined"), with much more harm. We have seen this movie repeatedly (Facebook, TikTok, etc) over the last dozen years, always with unhappy endings. It is past time we do something about large scale technological changes being rapidly imposed on society. The question we should be asking about artificial intelligence – and every other new technology – is whether private corporations be allowed to run uncontrolled experiments on the entire population without any guardrails or safety nets. Should it be legal for corporations to release products to the masses before demonstrating that those products are safe? --- ### More from TIME --- **_Read More:_** [**_The Only Way to Deal With the Threat from AI_** ](https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/ "undefined") The tech industry has been running uncontrolled experiments for more than a decade, across a wide range of product categories, frequently with catastrophic results. In 2012, for example, Facebook ran an [experiment](https://www.theguardian.com/commentisfree/2014/jun/30/facebook-sad-manipulating-emotions-socially-responsible-company "undefined") in which they made 155,000 people sad, without their knowledge, must less permission. Instagram, Snapchat, and TikTok were largely designed to create envy in teens, without consideration for psychological harms. Relatively limited applications of AI have already enabled civil rights violations in [mortgage lending](https://www.forbes.com/sites/korihale/2021/09/02/ai-bias-caused-80-of-black-mortgage-applicants-to-be-denied/?sh=71d07f8436fe "undefined"), [resume review](https://www.reuters.com/article/us-amazon-com-jobs-automation-insight-idUSKCN1MK08G "undefined"), and [policing](https://www.technologyreview.com/2020/07/17/1005396/predictive-policing-algorithms-racist-dismantled-machine-learning-bias-criminal-justice/ "undefined"). With large language model AIs, the scale of the experiments has changed, increasing by two orders of magnitude or more relative to early AIs. Chat GPT, a large language model that reached one billion total users – and 100 million active users – only two months after its introduction, has been called a [“bullshit generator](https://www.businessinsider.com/princeton-prof-chatgpt-bullshit-generator-impact-workers-not-ai-revolution-2023-1?op=1 "undefined").” When Microsoft incorporated Chat GPT into its Bing search engine, the large number of [factual errors](https://www.usatoday.com/story/tech/2023/02/14/bing-chatgpt-meltdown/11258967002/ "undefined") triggered a tsunami of criticism. Despite the flaws, the integration of Chat GPT caused Bing’s daily user count to pass 100 million for the [first time](https://www.pcmag.com/news/microsofts-bing-tops-100-million-users-with-chatgpt-integration "undefined"). Thanks to tacit and explicit endorsements from media and policy makers, millions of people have bought into the hype, embracing another dangerous tech product. Even Sam Altman, the CEO of Open AI, has [expressed concern](https://abcnews.go.com/Technology/openai-ceo-sam-altman-ai-reshape-society-acknowledges/story?id=97897122 "undefined") about the risk from the technology he is creating. But rather than taking action to protect consumers, Altman is developing larger models as fast as he can. Those who support the current approach to AI argue that we cannot afford to slow down because we are in a race with China. Really? How does flooding the information ecosystem with bad answers, disinformation, and civil rights violations help us compete with China? Historically, America is most successful when it focuses on its core values: democracy, the right of self-determination, creativity, and entrepreneurship. We win with jet aircraft, carbonated beverages (i.e. Coke), and entertainment. China’s wins when it can leverage its scale and authoritarian government. AIs based on high quality content, operated in a manner consistent with American values, would improve our competitiveness, but that is not the approach Silicon Valley is taking. They want to compete with China on China’s terms. That is crazy. The harms of poorly developed AI have been discussed in public policy circles since at least 2017, but Congress and two presidents have done nothing. I know because I have been one of the people raising the alarm. The problems with AI cannot be fixed with a six-month moratorium. What is required is a different approach to the development and deployment of new technologies, an approach that prioritizes protection of consumer safety, democracy, and other values over returns to shareholders. If we could wave a magic wand and change the culture of tech, there would be no need for a moratorium. And a moratorium without a clear path to better development practices accomplishes nothing. The industry has long treated self-regulation as license to do what it pleases. AI has huge promise, and the technology is advancing rapidly, but it can only be as good as the content used to train it. Engineers have the option of training AIs on content created by experts, but few choose that path, due to cost. Instead, they train their systems on data scraped for free from the web, sometimes in [violation of copyright law](https://www.npr.org/2023/02/03/1154091957/artists-file-class-action-lawsuit-saying-ai-artwork-violates-copyright-laws "undefined"). AI developers scrape content from high quality sites like Wikipedia, but much more comes from sites that do not distinguish between information and disinformation. If you train an AI on low quality content, the results will also be low quality. Given the scale of products like Chat GPT and GPT-4, there is a great risk of flooding the internet with disinformation. A Google [engineer resigned](https://www.businessinsider.com/ai-researcher-quit-google-openai-bard-training-on-chatgpt-report-2023-3?op=1 "undefined") after claiming that his company had trained its own large language model AI, Bard, on Chat GPT. So long as we build AIs on lousy content, the results are going to be lousy. AI will be right some of the time, but you won’t be able to tell if the answer is right or wrong without doing further research, which defeats the purpose. For most of the past forty years, government and the people have given tech companies nearly total freedom with respect to product development. Consumers have adopted new technologies more or less blindly, despite escalating harms over the past fourteen years. In today’s regulatory vacuum, the incentives in tech are to maximize shareholder value, even if doing so undermines core values like public safety and democracy. Laissez-faire policies have led to the creation of great wealth for a relative handful of entrepreneurs and investors, but at enormous cost to society as a whole. The window is closing to protect democracy and the public from increasingly harmful technology products and the culture that creates them. We cannot afford further inaction. ```json [{"@context":"https://schema.org","@type":"OpinionNewsArticle","@id":"https://time.com/6268843/ai-risks-democracy-technology/","mainEntityOfPage":{"@type":"WebPage","@id":"https://time.com/6268843/ai-risks-democracy-technology/"},"headline":"There Is Only One Question That Matters with AI","datePublished":"2023-04-05T14:07:03.000Z","dateModified":"2026-04-13T08:53:00.278Z","description":"Should private corporations be allowed to run uncontrolled experiments on humanity?","url":"https://time.com/6268843/ai-risks-democracy-technology/","keywords":["Technology","Tech","freelance"],"thumbnailUrl":"","author":[{"@type":"Person","name":"Roger McNamee","jobTitle":null,"url":"https://time.com/author/roger-mcnamee/"}],"articleSection":"Ideas","image":[],"publisher":{"@type":"Organization","name":"Time","url":"https://time.com/","logo":{"@type":"ImageObject","url":"https://time.com/images/logo.png","width":528,"height":156},"foundingDate":"March 3, 1923","sameAs":["https://www.facebook.com/time","https://www.instagram.com/time/?hl=en","https://twitter.com/time","https://www.pinterest.com/timemagazine"]}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"/section/ideas/","name":"Ideas"}},{"@type":"ListItem","position":2,"item":{"@id":"/tag/technology/","name":"Technology"}},{"@type":"ListItem","position":3,"item":{"@id":"https://time.com/6268843/ai-risks-democracy-technology/","name":"There Is Only One Question That Matters with AI"}}]},{"@context":"https://schema.org","@type":"VideoObject","name":"Universities Are Wondering How to Adapt New Artificial Intelligence Tool ChatGPT","description":"ChatGPT captured the public imagination upon its release in late November. While some schools are banning it, Microsoft announced a $10 billion investment in the company and Google issued a “code red,” fretting that the technology could disrupt its search business.","thumbnailUrl":"https://cdn.jwplayer.com/v2/media/vRyP28gB/poster.jpg?width=720","uploadDate":"2023-02-06T16:58:13.000Z","contentUrl":"https://cdn.jwplayer.com/manifests/vRyP28gB.m3u8","embedUrl":"https://time.com/6268843/ai-risks-democracy-technology/","duration":"PT2M43S","potentialAction":{"@type":"SeekToAction","target":"https://time.com/6268843/ai-risks-democracy-technology/?jw_start={seek_to_second_number}","startOffset-input":"required name=seek_to_second_number"}}] ```