Goff to critics: 'Never had problem' with hand size