Sorry to hear you're having such a hard time. It concerns me that he continually tells you to put up with it or he's leaving. This suggests to me that he has no intentions of trying to make things better. I know it's easier said than done but don't let the fear of being alone dictate you staying in a relationship that makes you miserable. You don't have to put up with being mistreated.