Yeah, I totally get where you are coming from. IT in general can be draining, infosec even more so. Maintaining your own sanity is incredbly hard.
Stepping back when it is becoming too much (or already has been too much) is the best decision you can possibly make. Nothing but respect for that.