While all men are potential rapists, I suspect you'd be offended if you were treated like one or referred to as one, no?
I'm no expert, but I think the vast majority of people who have or whom are transitioning from men to women, do not consider themselves to be men.
Most of them, I believe...