I wonder if it was the beard, itself, or the color.
I've traveled with my Mom who was a red-head, and the attention
paid to her hair was impressive, particularly by kids.
Recently I read an article about beliefs and discrimination towards red-heads in European art,
and Wikipedia devotes space to the (negative) beliefs among some cultures (
here)