In 3 Words...

You're gonna die.

"I’m not trying to scare you — I’m being practical. You get one life and one chance to make yourself happy. Instead of sitting and complaining about not pursuing the things you want in life, do something about it."

- Motivation from Gary Vaynerchuk
Views don't matter

If you are doing what you want to do, enjoyment is the only thing that matters whether it be for one of a million audience make the videos you want for the people who want to watch them regardless of channel size
Enjoy your content.

If you enjoy your own videos, then don't you think that having enjoyment in life is something to keep doing? Besides, if you enjoy it and keep doing it, I'm sure someone else will enjoy your content as well eventually and that's where the the up trend of your channel begins. :)