See what he says in Dakshinamurthy Stotram (see who he is clubbing the women with):
“Some, deeply deluded, argue that ‘I’ am the body, the life-force, the senses, the restless mind, the intellect, or even mere emptiness—just as women, children, the blind, or the dull-witted might imagine.”