Consensus

A person has told me several times "you are the only one with that opinion" as if it would matter to me.
First of all, unless he is a mindreader, how does he know what opinion everybody else has?
Secondly, even if I was the only one of earth having an opinion, wouldn't make a difference to me, on the contrary.
If I have the ability to think differently than the lot, I'm happy. If I see things for a different angle I contribute. Consensus isn't my bag.