Confidence, though, comes from two things: 1) knowing you're attractive, or 2) knowing you have other things to bring to the table.
Self-confidence comes from believing yourself to be right. The reason dressing well makes you confident in yourself is because you believe you look attractive in fine clothes, and the attention you're getting is providing the confirmation you need to keep believing it.
Fact of the matter is, you could wear @#%^ all and you'd still get attention from ladies. As long as you believe that you're right in what you do and say, you'll have confidence in yourself. Just make sure it's always merited, otherwise confidence turns to arrogance.
What I'm saying is that you're right. Believing you're attractive makes you confident. Getting positive attention enhances that confidence. Doesn't matter what you wear, or how you look, though.
Edit: For the record, I think you're attractive. For a man. No homo, etc. You've got good genes. Edited, Jun 19th 2012 10:53am by Mazra