Empathizing is the capacity to predict and to respond to the behavior of agents (usually people) by inferring their mental states and responding to these with an appropriate emotion. Systemizing is the capacity to predict and to respond to the behavior of nonagentive deterministic systems by analyzing input-operation-output relations and inferring the rules that govern such systems. At a population level, females are stronger empathizers and males are stronger systemizers. The ``extreme male brain'' theory posits that autism represents an extreme of the male pattern (impaired empathizing and enhanced systemizing). Here we suggest that specific aspects of autistic neuroanatomy may also be extremes of typical male neuroanatomy.