Why are they so prejudiced against my security blanket?

My problem is that I have a silk hankerchief "security blanket" that I've had since I was a little kid. I've become kind of dependent on it, but so what? It's not hurting anybody. Anyway, I think word must have got out about it because people in work look at me funny and avoid me. I mean, I'm discreet, I keep it in my pocket and rub it at odd moments. Sometimes I have to rub it a lot. Occasionally I rub it in meetings and all anybody seems to be doing is watching me. What's wrong with having a security blanket?