I agree with Caroline. If you keep getting into these fights after parties and social events, why not make an agreement that he has a two-drink maximum?
I think his "I don't remember" is a pretty thin veil for "You almost caught me." Disappearing with random women is unacceptable, for any amount of time, and what's he's also doing is making both of you look foolish, and you don't deserve that.
You know what's going on, and you have power as an equal partner in your marriage to make it stop.