i can totally relate too! We were planning to marry in Puerto Rico April 2009 and just postponed. I was so frustrated with hearing everyone complain about finances. The difficult thing is that FI and I have started talking about the wedding date/location again and we STILL want a destination wedding!
We are going to set a date in 2010. We figure that it's plenty of time for those who want to come to save money. And if they can't make it that's okay too.
You really do need to do what you want to do. It's hard but it's your wedding. If it's most important to have your entire family there, it's possible.
We are here for you!