This was a situation that I was in for a few years, and unfortunately for me I just didn't work out to make content while I was actually on campus so I would make all my videos on the breaks. There were times when I wanted to quit and just do YouTube, I had some early success and that gave me a lot of confidence. The problem, as was stated above, is that it takes time for most channels to get off the ground. If you were to quit college and instead pursue YouTube you would have to factor in time before you would start earning anything. Especially these days having to get monetized makes that to me even more daunting. If you can do both it's best, but personally I couldn't get comfortable recording on campus or in front of roommates. It was too noisy and I would get super nervous with my lack of experience at the time.
I'm glad I finished, but also regret not having most of those 2 years to make videos and follow up the initial success I had. I came back to a mostly dead channel after I graduated because I was never able to follow up on several successful series of videos. I'd really love to be 2 years farther ahead right about now. Then again it would have been rough mentally dealing with all the questions from family and friends about why I didn't finish.
What I would say is try to start while you are still in college and get a feel for it while continuing college if at all possible. YouTube is not a linear thing and it's hard to know if you'll be any good at it until you try it out.