I think being buff is good but if you were super buff but had poor body language could be an issue.

way I see it is character/game + looks/body = Casanova