Raisindot I completely understand where you're coming from! I remember the first time I told hubby I planned on flying out of state to attend Tony and Sharlene's wedding. Let's just say he had a hard time processing it.
But, he got over it, had no issues with me going to the last con, and wouldn't let work mess with this year's schedule to make sure I can go to this con.
Now, telling other family members, that earned at least a brief look of confusion. Anyone else, I simply say I'm meeting friends. If I say more it's just that I'm going to an event for a best selling author where I'll get to hear readings, go to a signing, etc., and I stop there.
Anyway, if you decide to come let me know! You won't be left on your own or have a dull moment - promise!
buggerit 
so go and sink a pint for me. 
Live long and prosper Dotsie the Wise 