You do realize your gender is dependent on your parents as well, right? Assuming a conventional conception, you have a 50/50 chance based on your father's sperm containing either an x or y chromosome. Now let's assume that "you" as a philosophical entity rather than a physical entity (basically, you as a conscience, not the physical you) could have been born to any set of parents, but you were born to x race of parents. Would it be fair to say that the odds of your gender are any less of a mistake than the odds of your parents' race? Of course not, there is no mistake in any of this, it's all just random chance.

And would it be fair to complain about having rolled unfavorably? Of course it would be, the result was not wanted and you have no way to change the result and through no choice of your own did it come about. It is entirely unfair for anybody to be born into any circumstance that they did not want, and it would be unreasonable to deny them from changing their circumstances, particularly if it does not effect others negatively.