If you are scared to stay then you need to leave. He's done it twice, chances are he'll do it again. Everytime it happens and you stay you validate his behavior. After all if it was truly unacceptable, you'd leave. It's silly not to want to tell anyone. That implies that you are expecting to be blamed. Silence is part of an abusers arsenal.