The tax cuts weren't just for the wealthy though. You're basically just doing the Buffet-rule by only removing Bush tax cuts for the wealthy. Not going to help much.
I never implied the rich didn't disproportionately benefit or you couldn't end the Bush tax cuts and help the poor at the same time. However, the net effect of that new tax structure wouldn't help the economy much, and therefore wouldn't help tax revenue.