Why most players don't take [Down Syndrome] perk?

Most players have a build for happiness and this perk gives you a lot of it, in fact more than any other perk.