“Ejaculatory control” and “bother/distress” are key criteria for diagnosing men with premature ejaculation (PE), yet compared with ejaculatory latency (EL), these constructs have received only minimal attention. In addition, they have not been characterized in men having different sexual orientations or subtypes of PE. This study aimed to characterize relationships among ejaculatory control, bother/distress, and EL; to assess differences across men having different sexual orientations, PE status, and PE subtypes (i.e., lifelong vs. acquired); and to determine the importance of ejaculatory control to men’s sexual partners. In total, 1071 men and sexual partners of men rated their ejaculatory control and bother/distress and estimated their EL; these measures were compared across sexual orientation, PE status, PE subtype, and male and female partners of men. Results revealed a monotonic though slightly curvilinear relationship between ejaculatory control and bother/distress. These PE criteria differed significantly between PE and non-PE men, to a lesser extent between gay and straight men, and not at all between men having lifelong vs. acquired PE. Female and male partners of men affirmed the importance of ejaculatory control during partnered sex, indicating lack of control as a potential reason for ending a relationship.