Fifty Shades of Grey Director Didn’t Enjoy Working With Book’s Author

Apparently there was a lot of tension on the set of the upcoming Fifty Shades of Grey — and not the sexual variety.

In an interview with The Hollywood Reporter, director Sam Taylor-Johnson described what it was like shooting the film alongside the very hands-on author of the series, EL James. According to Taylor-Johnson, the two sometimes struggled over their respective visions, as she noted:

There have also been rumors swirling that the film’s stars, Jamie Dornan and Dakota Johnson, don’t get along either, though Taylor-Johnson doesn’t mention it to THR. Instead, the photographer-turned-director describes the “strong trust and bond” she has with Johnson, and how after being initially disappointed that actor Charlie Hunnam dropped out of the film, she “now can’t imagine anyone else but Jamie playing [lead character Christian Grey].”

[THR]

Read next: Watch Jamie Dornan Read Fifty Shades of Grey in a Scottish Accent

Listen to the most important stories of the day.

Fifty Shades of Grey: TIME's Exclusive Portraits of the Cast and Director