Should brands worry about their ads receiving complaints?

They can lead to spots being banned, but are the complaints themselves a source of concern for brands?