What would you do about this?

Don't worry what other people think. It's what YOU see. Your guy friends are obviously "protecting" you because they secretly don't want to see you get hurt. They have your back, so in case things don't work out (hope they do), they want you to know they're there for you. If you see something different then your friends, you stick to it.