June 19, 2015 3:24 PM EDT

For some reason, Stephen Colbert made a surprise appearance at the 46th annual Songwriter Hall Of Fame awards dinner Thursday night, where he inducted country icon Toby Keith.

To honor the singer, Colbert did a little performance of his own, covering “As Good As I Once Was.” Decked out in a denim jacket and a black cowboy hat, Colbert busted out his best twangy singing, backed by a full band.

This all may seem pretty unexpected, but Keith has appeared on Colbert’s show several times over the years, so it’s entirely possible they’ve become pals.

More Must-Reads From TIME

Contact us at letters@time.com.

You May Also Like