I would hazard that, maybe, one in ten of those people in their ironically striped sweaters with their giant headphones actually care about and notice the difference in sound quality. Many more of them will tell you that they do. They are lying.
Yes, tiny headphones are super annoying and don't stay in your ears and have pretty lousy sound quality as a rule. There are solutions to this that do not take you back to a 1980s stereo ad.
You don't look musical. You look like a poseur. Because you are one.