Trump threatens conservatives with midterm consequences: 'We must fight them'