It's all in the way you present yourself and advertise. Plus, as mentioned by virtually everyone, all sized channels get hate.
I do agree to a certain extent that some people may see your subscription numbers and make comments about how crappy your channel must be just based on that fact. "No wonder why you only have 2k subs blahblah" That happens to me all the time, but people are just trolls!