What time can builders make noise in a residential area?

For retired neighbours or people working from home, this can present a whole host of problems.