Watch Justin Bieber and Ellen Degeneres Scare Fans While Hiding in a Women’s Bathroom

February 5, 2015 8:20 PM EST

“Either lucky or unfortunate women,” as talk-show host Ellen DeGeneres put called them, got the experience of walking in on Justin Bieber and DeGeneres in a women’s bathroom Thursday.

Before Bieber, 20, was to appear as a guest on The Ellen DeGeneres Show, the two decided it would be fun to freak out as many bathroom-goers as possible in the appropriately titled prank segment “Bieber in the Bathroom.”

It started out relatively tame, with Bieber and DeGeneres embracing while waiting for each woman to come in. Some women screamed. Some women laughed. And some immediately hugged Bieber.

From there, it escalated to the point where Bieber and DeGeneres were sitting at a small table—instruments and dolls were involved, and DeGeneres, naturally, was wearing an alien mask.

On a more serious note, during his appearance on the talk show, Bieber discussed his reason for releasing an apology video last week, in which he opened up about his previous inappropriate behavior.

“Just being young and growing up in this business is hard. Just growing up in general is hard,” Bieber told Ellen.