I would assume it's just as hard for a male vlogger as well...
Anyways, if you haven't already, try advertising your videos on social media sites such as twitter, a facebook page, google+, pinterest, tumblr, etc. But don't always just link your video and be done with it. Always try to be active on these sites, talk to people with similar interests as you and who knows? Maybe they will check out your channel and if they like you enough they will share your channel with their followers and so on...
Being active on here works too since you can save up enough YTTalk cash from posting a lot and get VIP to have a video in your signature and post in the video section of the forums. I've been able to get quite a lot of views and subs this way so it definitely helps
And Idk how long you have been on YouTube but don't forget that it can takes months to years to start building a large audience so you have to be patient and just give it some time.
But Good luck to you and your channel

hope you get the audience you're looking for!