While the Grammys recognize the best of the best in the music industry, the ceremony is also a huge night for fashion, a fact that’s not lost on style-savvy artists.

While some go for full-on glamour like J. Lo in her infamous green Versace dress in 2000, others have used red carpet fashion as yet another medium to express themselves. Case in point: Lady Gaga’s show-stopping ensembles that could function as performance art.

Throughout the years, there have been some especially unforgettable style moments at the Grammy ceremony — take a look at the most memorable looks of all time below.

More Must-Reads From TIME

Write to Cady Lang at cady.lang@timemagazine.com.

Read More From TIME