Yep. Most people know Timex, Casio, and Rolex. Some who THINK they know about watches include Seiko, Movado, and Tag in that mix. Rest are jewelers and horology buffs. As for jewelers, most of theym are exactly that, jewelers. I don't give a rat's ass whether I wear a rep or gen to AD's/jewelers. It's my wrist, and it's my watch. I bought it cuz I like it. Hell, most modded PAMs are better quality and more expensive than gen Movados anyway. If I wanna pull the "I'm richer than you, or I'm better than you" stunt somehow, then even wearing a real Panerai is NOT even in my mind as to achieving the smug assholeness; I'll be doing that some other way, i.e., years of education, car, fancy pants, nice underwear, etc.
When I do wear my "ultimates" to AD's, noone notices, or if they do, they kiss my ass for the entire stay; I just have a stance and a look that says "it's not a good idea to be an asshole and pull my wrist towards your nose and sniff without buying me dinner first, because I'll probably poke your eyeball" look. Again, as for AD's, it's no different than a Lexus sales manager not being able to tell you anything about the torque in the engine. Now for horology buffs and (mostly) a-hole paneristis, they'll simply say, "nice rep, gotta do something about that hue tho'."
Thus, wear it proud. If it looks good, and most people don't know a seiko from a psycho, just wear it well.