June 19, 2015 3:24 PM EDT

For some reason, Stephen Colbert made a surprise appearance at the 46th annual Songwriter Hall Of Fame awards dinner Thursday night, where he inducted country icon Toby Keith.

To honor the singer, Colbert did a little performance of his own, covering “As Good As I Once Was.” Decked out in a denim jacket and a black cowboy hat, Colbert busted out his best twangy singing, backed by a full band.

This all may seem pretty unexpected, but Keith has appeared on Colbert’s show several times over the years, so it’s entirely possible they’ve become pals.

Contact us at letters@time.com.

Read More From TIME

Related Stories