Appearance matters to the extent that you don't go out looking like a hobo (retard) and make a little bit of an effort with your appearence, even though your not blessed with the best looks in the world like Ross Jeffries, Neil Strauss, Jeffy or Hoobie. If you work with what you got, you will get pussy - fact.
In fact, I think Phil will agree with me on this