When is it acceptable to wear a flat cap?

A man was recently told to remove his flat cap in Tesco. But where is it OK to sport one?