Sex and sexual orientation related differences in processing of happy and sad facial emotions were examined using an experimental facial emotion recognition paradigm with a large sample (N=240). Analysis of covariance (controlling for age and IQ) revealed that women (irrespective of sexual orientation) had faster reaction times than men for accurate identification of facial emotion and were more accurate in identifying male faces than female ones, whereas men performed the same regardless of the sex of the face. However, there were no overall sex differences in accuracy. These findings suggest a limited role for sex in the perception of facial affect.