Well no one (and this goes for everyone) can expect to be an overnight YouTube sensation. As someone else pointed out, so many new channels are created everyday.
I think it all boils down to the mentality. We can't all create a channel and go "I *have* to make it big on YouTube" because what does make it big on YouTube is very inconsistent--it could be babies one day, cats another, vlogs and music videos another day. As I said in another thread, I think what you can do while you're in your starting stages of YouTube is experiment with content. Because that is what a lot of people will respond to.
I've had roughly 70 subscribers for the past year that I created my new channel. I just keep making more videos. Just like when the Vlogbrothers suddenly experienced a burst of new subscribers with their Accio Deathly Hallows video, they had very few before that. So just keep trying. Don't get frustrated.
In fact, if I were you, I'd hide the numbers for six months or so. It can bog you down.