The dilemma of Trump's corrupt flunkies

Isn't this the problem with all of Trump's heavy-handed and corrupt appointees? We need to hold them accountable for their corruption, but that opens the door to a less overtly corrupt and more insidiously competent successor to take over.