--- description: Google and DeepMind are thinking about ways to ensure full human control. title: Google Is Building a Big Red Button to Stop the Robot Apocalypse image: https://static.time.com/v3/assets/bltea6093859af6183b/bltde093bcdab65f2d0/6988d9b9bc6cfc69913e2a3c/time-logo.jpg?branch=production --- * [Business](/section/business/) ## Business Update your preferences in [Account Settings](/account/preferences/) Close * [Tech](/tag/time-section-tech/) ## Tech Update your preferences in [Account Settings](/account/preferences/) Close # Google Is Building a Big Red Button to Stop the Robot Apocalypse by [Jon Mundy / Trusted Reviews](/author/trusted-reviews/) ## Jon Mundy / Trusted Reviews Update your preferences in [Account Settings](/account/preferences/) Close Jun 9, 2016 2:04 PM CUT by [Jon Mundy / Trusted Reviews](/author/trusted-reviews/) ## Jon Mundy / Trusted Reviews Update your preferences in [Account Settings](/account/preferences/) Close Jun 9, 2016 2:04 PM CUT Just last week Tesla and SpaceX CEO Elon Musk revealed that he was only worried about the work of [one AI company](http://www.trustedreviews.com/news/elon-musk-worries-about-one-ai-company-whoever-could-it-be "undefined"), which many read to be Google. Musk and his fellow worriers should feel a little more at ease to know that Google and DeepMind are thinking about ways to ensure full human control. In an academic [paper](http://intelligence.org/files/Interruptibility.pdf "undefined"), DeepMind’s Laurent Orseau and Stuart Armstrong of the Future of Humanity Institute at the University of Oxford have established a framework for interrupting an AI’s course of action. “Now and then it may be necessary for a human operator to press the big red button to prevent the agent from continuing a harmful sequence of actions,” reads the paper. Of course, this isn’t much use if the clever-clogs AI (shall we just call it Skynet?) figures out how to override this ‘big red button’. The paper suggests that the key is to tweak the AI’s reward function to prevent it from factoring in human interaction points and formulating undesirable shortcuts that circumvent them. So when a very literal big red button is pressed in a factory for safety reasons, the AI doesn’t learn that this is bad for productivity (thus a block to attaining its ‘reward’) and plough on regardless. _This_ [_article_](http://www.trustedreviews.com/news/google-s-big-red-deepmind-kill-switch-could-stop-ai-from-killing-us-all "undefined") _originally appeared on_ [_TrustedReviews.com_](http://www.trustedreviews.com "undefined") ```json [{"@context":"https://schema.org","@type":"NewsArticle","@id":"https://time.com/4362515/google-artificial-intelligence-deep-mind/","mainEntityOfPage":{"@type":"WebPage","@id":"https://time.com/4362515/google-artificial-intelligence-deep-mind/"},"headline":"Google Is Building a Big Red Button to Stop the Robot Apocalypse","datePublished":"2016-06-09T14:04:44.000Z","dateModified":"2026-04-13T08:50:05.144Z","description":"Elon Musk doesn't need to be worried anymore","url":"https://time.com/4362515/google-artificial-intelligence-deep-mind/","keywords":["Tech","robotics","Companies"],"thumbnailUrl":"","author":[{"@type":"Person","name":"Jon Mundy / Trusted Reviews"}],"articleSection":"Business","image":[],"publisher":{"@type":"Organization","name":"Time","url":"https://time.com/","logo":{"@type":"ImageObject","url":"https://time.com/images/logo.png","width":528,"height":156},"foundingDate":"March 3, 1923","sameAs":["https://www.facebook.com/time","https://www.instagram.com/time/?hl=en","https://twitter.com/time","https://www.pinterest.com/timemagazine"]}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"/section/business/","name":"Business"}},{"@type":"ListItem","position":2,"item":{"@id":"/tag/time-section-tech/","name":"Tech"}},{"@type":"ListItem","position":3,"item":{"@id":"https://time.com/4362515/google-artificial-intelligence-deep-mind/","name":"Google Is Building a Big Red Button to Stop the Robot Apocalypse"}}]}] ```