I think its one of the sad truths that people make quick judgements based on statistics, their logic is like first impressions, if other people aren't watching it or subscribed then it cant be all that good choosing more established videos with more views which really does it make harder for newer channels, it gets worse when you consider how far down the search rankings they need to go before even seeing your thumbnail.
I cannot blame them for thinking like that still, if you see a video with 3 views from a person who's just searchings perspective you would probably assume it isnt as good as the one with 3 million and ignore it. I think its also partially why so many channels never take off, they make great content, have excellent SEO, upload consistently but they cannot perform anywhere near as well as the more established channels and that leads to them giving up.
The only thing that you can do is do things better and keep doing them better and eventually take off because of that. It is the same with websites in Google search, new websites struggle to outrank more popular websites but when they find a niche and try to establish themselves in it they do things better and keep doing it until they are eventually overtaking the sites they only dreamt of outranking, it is possible but is a long hard ride to get there for many.