<!-- mobian-agent-page publisher="time" canonical="https://time.com/3939528/googles-chatbot-ai-artificial-intelligence-robot/" -->

---
description: The Google project was yet another attempt to fashion a &quot;conversational model&quot; of artificial intelligence
title: The Dark Heart of Google&#x27;s Latest Chatbot
image: https://static.time.com/v3/assets/bltea6093859af6183b/bltde093bcdab65f2d0/6988d9b9bc6cfc69913e2a3c/time-logo.jpg?branch=production
---

* [Business](/section/business/)  
## Business  

Update your preferences in [Account Settings](/account/preferences/)  
Close
* [Tech](/tag/time-section-tech/)  
## Tech  

Update your preferences in [Account Settings](/account/preferences/)  
Close

# 'I Don't Have Ethics': The Dark Heart of Google's Latest Chatbot


by 

[TIME Staff](/author/time-staff/)


## TIME Staff


Update your preferences in [Account Settings](/account/preferences/)

Close

Jun 29, 2015 9:12 AM CUT

by 

[TIME Staff](/author/time-staff/)


## TIME Staff


Update your preferences in [Account Settings](/account/preferences/)

Close

Jun 29, 2015 9:12 AM CUT

A new research paper released by Google this week reaffirms what’s been more or less obvious since HAL 9000 murdered four astronauts in Stanley Kubrick’s 1968 film _2001: A Space Odyssey:_ computers do not make particularly dependable friends.

The Google project—an admittedly more benign exercise than Kubrick’s—was [yet another attempt](http://www.vice.com/read/dirty-talking-sex-chatbots-are-going-to-steal-your-girlfriend-236 "undefined") to fashion a “conversational model” of artificial intelligence. Colloquially, we refer to these systems as “chatbots”—programs that can somewhat convincingly engage in human discourse.

The researchers behind the experiment, Oriol Vinyals and Quoc V. Le, programmed their particular chatbot with two sets of data: guidelines from an IT troubleshooting help desk and a database of movie subtitles. The ensuing dialogue was mostly awkward and occasionally nihilistic.

“What is the color of water?” the researchers asked.

“Water,” the computer replied simply.

“Where are you now?” they asked.

“I’m in the middle of nowhere.”

“Tell me the definition of morality,” the researchers requested.

“I don’t have ethics,” the machine advised them.

According to the transcript, this went on for awhile. Philosophical banter proving futile, Vinyals and Le switched gears, with more coherent results.

“What do you think about Cleopatra?” they asked.

“Oh, she’s very regal.”

Read more dialogue [here](http://arxiv.org/pdf/1506.05869v2.pdf "undefined").

### These Vintage Computer Ads Show We've Come a Long, Long Way

![http://pop.bitpig.com/oldads/nov/pdp-11-70.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/blt23269ffdfeb5d895/69869c9a3bc99916c31a4a14/1974.jpg?branch=production&width=2400&quality=75&auto=webp)

1974 

![<b>1976</b>](https://static.time.com/v3/assets/bltea6093859af6183b/blt03c2bfbca1331d4e/69869c8cd0b6f2882c305607/1976.jpg?branch=production&width=1440&quality=75&auto=webp)

1976 

![<b>1976</b>](https://static.time.com/v3/assets/bltea6093859af6183b/blt0da54c7253615015/69869c8c35ba6f04c4c03175/19762.jpg?branch=production&width=1080&quality=75&auto=webp)

1976 

![http://www.everyjoe.com/2009/07/30/technology/blast-from-the-past-the-3398-10mb-hard-disk/](https://static.time.com/v3/assets/bltea6093859af6183b/blt278096788290ed51/69869c8e169ab030ff27a6ca/1980.jpg?branch=production&width=1080&quality=75&auto=webp)

1977 Picasa 3.0


![http://www.mopo.ca/uploaded_images/honeywell_email-763551.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/blt6cca4a7f8f8cfca2/69869c8ce8524b4e34603fa6/1977.jpg?branch=production&width=1920&quality=75&auto=webp)

1977 

![http://www.vintagecomputing.com/wp-content/images/retroscan/ibm5110_large.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/bltdede170128e96ca4/69869c8d810bbb978cc92af2/1978.jpg?branch=production&width=1440&quality=75&auto=webp)

1978 

![<b>1978</b>](https://static.time.com/v3/assets/bltea6093859af6183b/blt69d3b0d2df616693/69869c8de53abaf20a4d3aa6/19783.jpg?branch=production&width=2400&quality=75&auto=webp)

1978 


![<b>1980</b>](https://static.time.com/v3/assets/bltea6093859af6183b/blt67998b65933c9fe9/69869c9b13c79fe0281932d7/19804.jpg?branch=production&width=1080&quality=75&auto=webp)

1980 

![http://www.macmothership.com/gallery/MiscAds/AdamAd.JPG](https://static.time.com/v3/assets/bltea6093859af6183b/bltc2455e021bb14038/69869c8e55a8599759a81ded/19802.jpg?branch=production&width=2400&quality=75&auto=webp)

1980 

![http://www.vintagecomputing.com/wp-content/images/retroscan/ibm_pc_woman_large.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/bltacb886a2b9d5a4e6/69869c8e13c79f566d1932cc/1981.jpg?branch=production&width=2400&quality=75&auto=webp)

1981 


![http://www.aresluna.org/attached/computerhistory/ads/international/lotus/pics/byte8311](https://static.time.com/v3/assets/bltea6093859af6183b/bltb0fecad6b891468f/69869c8f169ab0e01227a6ce/1983.jpg?branch=production&width=2400&quality=75&auto=webp)

1983 

![http://www.vintagecomputing.com/wp-content/images/retroscan/msmouse_large.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/blt193f94ec567080a9/69869c8f06f2c18cc332ffd0/19832.jpg?branch=production&width=2400&quality=75&auto=webp)

1983 

![http://www.vintagecomputing.com/wp-content/images/retroscan/osborne_large.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/blt3aefbb1fbf08a472/69869c8fadae447c9e5443b8/19833.jpg?branch=production&width=2400&quality=75&auto=webp)

1983 


![http://pop.bitpig.com/oldads/nov/keeping-up.jpg](https://static.time.com/v3/assets/bltea6093859af6183b/bltcd891e562b90400f/69869c9ce53aba35614d3aba/1984.jpg?branch=production&width=2400&quality=75&auto=webp)

1984

```json
[{"@context":"https://schema.org","@type":"NewsArticle","@id":"https://time.com/3939528/googles-chatbot-ai-artificial-intelligence-robot/","mainEntityOfPage":{"@type":"WebPage","@id":"https://time.com/3939528/googles-chatbot-ai-artificial-intelligence-robot/"},"headline":"'I Don't Have Ethics': The Dark Heart of Google's Latest Chatbot","datePublished":"2015-06-29T09:12:43.000Z","dateModified":"2026-05-11T04:47:20.027Z","description":"\"I'm in the middle of nowhere\"","url":"https://time.com/3939528/googles-chatbot-ai-artificial-intelligence-robot/","keywords":["Tech","Newsfeed","Innovation","Google","Computers","AI"],"thumbnailUrl":"","author":[{"@type":"Person","name":"TIME Staff","jobTitle":null,"url":"https://time.com/author/time-staff/"}],"articleSection":"Business","image":[],"publisher":{"@type":"Organization","name":"Time","url":"https://time.com/","logo":{"@type":"ImageObject","url":"https://time.com/images/logo.png","width":528,"height":156},"foundingDate":"March 3, 1923","sameAs":["https://www.facebook.com/time","https://www.instagram.com/time/?hl=en","https://twitter.com/time","https://www.pinterest.com/timemagazine"]}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"/section/business/","name":"Business"}},{"@type":"ListItem","position":2,"item":{"@id":"/tag/time-section-tech/","name":"Tech"}},{"@type":"ListItem","position":3,"item":{"@id":"https://time.com/3939528/googles-chatbot-ai-artificial-intelligence-robot/","name":"'I Don't Have Ethics': The Dark Heart of Google's Latest Chatbot"}}]}]
```
