Afraid of being confronted by angry voters? Why not stay longer so you can do more things to piss voters off?
This is probably just an empty threat to get GOPers to come to a deal on how to ruin American health care, but there really is no reason not to cancel their recess. It's not like their members want to go home to face their constituents.