Do I ever know how you feel !!! I have been suffering with this for 20 years of marriage, so one of your comments rings an alarm for me: "where it was headed, or some type of further commitment was made... but I guess it's just not the right time."
Trust me, don't assume it will get better because it may not. My wife and I had a very active sex life before we were married and living together, then things changed and for me it has never been worse.
Find a time when you are clear headed, and sit him down to openly discuss your desires and his, and try to figure this out now before making any kind of long term commitment. There is hope, as long as you both can communicate about sex, friendship, finances, desires, short and long term plans, etc.