I'm not mad at you at all. It is your relationship and your decision. The only time it becomes a problem is when it starts to affect your kids and the older they get the more each time he does it will affect them. You can not only think of yourself and your feelings once kids are involved as well. They do not have the understanding you have.
If you think he has Bi Polar disorder or simaliar has he been to the Dr. to discuss? I know if he is like my husband he feels he doesn't have to go to the Dr. for anything. But I make the appointments anyway. You may have already approached him on it but maybe trying to let him know that you are very concerned you love him and so do your kids, but seeing him in pain hurts you and them as well. I have a girlfriend and her husband is bi polar so I know they can do some pretty off the wall stuff that only makes sense to them. His meds do help him most of the time but there are still times when he won't take them.
I really do feel for you, I know you love him. You can't just stop loving someone just like that. The reason I gave those options is that it seems that it isn't the first time and each time gets worse. He needs help and maybe if you do something that would be out of the norm for you it would make him realize you feel at your wits end and want to help him. He needs to realize what he is putting you and your kids through, you have his best interests at heart but he needs to give you the same respect and do what ever it takes to get back to what it is you have that makes you love him enough to be tough with him.
You know him the best and probably love him the most so you have to follow your heart. Just don't allow it to go to a level where you lose who you are trying to make life easy for him.