The thing is that most of these folks were elected officials. So he'd have to get them voted out. He can, of course, not appoint them to seats and things like that.
Those that aren't politicians? Unless they are in a position where he has some control over their career, there isn't much he can do.