Actually you have to distinguish between "worrying about if good looks matter" and "worrying about the way you look"

Personally, I'm happy how I look and consider myself a good looking guy, but that doesn't mean that I don't think about it, consider it and work on it (in the gym and such)