Do both. Do not separate the channel content nor address it. Your channel is aptly titled as a vlog and if people expect only one certain type of video, then they're ignorant to begin with. You don't need those type of followers.
Case in point: Casey Neistat. The dude (used to) make daily vlogs with the occasional non-vlog video detailing different topics. People are in it for his directing style, personality, and overall interesting lifestyle. This can be you as well. Casey deploys different types of content. In his case, he has the general vlog content that gives his most loyal subscribers more content to watch. He also has something that is categorized as "hero" content (which can be the same as your drone content), where it is to cater to a wider audience and grabbing their attention towards your channel. There will be some that will subscribe to see more of the hero content, but there are also others that will subscribe to just simply see any of your content. You want both and cater to both. At the end, you're set in a winning scenario of having a wider grasp.
Just watching your content, I feel that your potential is pretty high. Definitely stick with what you're already doing. I wouldn't even bother replying to those that say things like "THIS IS NOT WHAT I SUBSCRIBED FOR. UNSUBSCRIBED." Just let them get their two cents and move on. You're also free to ban hammer them. They serve no good purpose.
Best of luck.