Celebrity Traitors has a problem, it keeps getting rid of its best stars