Yes but, depending on their situation, they may have other things in common such as being oppressed, ridiculed, marginalized. Also there is
much more to gender that just attraction to a sex. This is a definite basis for coming together (no pun), sharing, and creating culture.