Keep them. It teaches RED that it's important to stay alive.
EDIT: Also, what I've seen on other servers, if times are shortened, you make it almost impossibru for BLU to have a chance at trying to push in and win. The predicament I hear people complaining about are the times and that RED barely has a fighting chance. Though, with a a well coordinated team, the match can go either way.