I've travelled alot of times with my kids and without my FI. All the times we would have a letter handy just in case but not always notarized. I've found that customs (well CA customs anyway) would question me more when returning back to Canada as opposed to entering another country. So I would definitely have a letter just in case anything happens, signed by both parents. good luck!