October 8, 2014 11:30 AM EDT

Robert Downey Jr. told David Letterman Tuesday night that there are no plans for an Iron Man 4. Fans were buzzing at the prospect of a fourth film after Downey Jr. hinted about it on Ellen that same day.

In a recent article on Deadline, Downey Jr. said he would do another Iron Man movie if Mel Gibson directed it, propelling the rumors for a fourth movie.

Although he quashed hopes of a new Iron Man release on Late Night, he did tell Letterman on Late Night that he’s “going to do other stuff with Marvel.” Avengers, assemble?

Contact us at editors@time.com.

Read More From TIME

Related Stories

EDIT POST