FWIW - it can be done. What you describe is very similar to the situation I faced some years back.

Similar feelings motivated me to make a change, which is how I ended up working day-to-day with the late stage cancer patients I mentioned upthread.

It's definitely not an easy change (and not a cheap one, either) but I'm pretty sure I'd make the same choice if I had to do it all over again.