Harry Styles reveals why he and Taylor Swift didn't work out

The former One Direction star briefly dated the American singer in 2012