Yes, I've had some people say things like, "Why would you want to go away to get married, you're not going to have many people there because it's too expensive" (too expensive for our guests maybe, but we are saving lots of money and this is the reason we are having an AHR) and "There are churchs here?" (I don't want to get married in a church) and "Why did you choose that resort, there is a window looking into the bathroom" (why does this matter if you are going with your husband or wife? There is a frosted glass door infront of the shower and toilet. If this really bothers them, I told them to bring thumb tacks and tack a towel infront of the window).
But you are right... it's your wedding day and it's all about the two of you. You had reasons for choosing to get married away, don't forget those reasons. When it comes down to it, it doesn't matter where you are getting married because YOU'RE GETTING MARRIED!!!! CONGRATULATIONS! Enjoy your planning and your day!