No your not being harsh at all
Pickiing your bestie for the 3 some is a bit fishy
You should only go into something like that knowing what damage it could cause to you and possibly your friendship with your friend
If he is soo soo serious about it maybe yall have some working to do on your relationship since he obviously does not respect your feelings and opinions