gender preference

I recently got a 4 year old green cheek conure. His past owners were women and I'm not sure if he was ever around men. That's why I'm a bit suspicious he had a bad experience or something. My brother and dad can hold him and pet them all they want, and he won't even give them a nibble. Then...