Yes, I do this.
It doesn't actually prevent the comments from being initially displayed. So viewers are non the wiser you have the review process running.
What it does is highlight/advise you of each new comment for all videos, so you can read it and decide if it's suitable.
It's a good way to delete inappropriate comments and flag idiot viewers who's comments should all be hidden (blacklisted).
Plus it enables you to respond to comments that you wouldn't otherwise read (for previous videos etc). This is essential if you want to grow community involvement in your channel.
I'm pretty lenient on adverse comments as we don't live in a perfect world, but there is a red line they can't go past..
If a viewer puts up a particularly nasty or malicious comment you can bet they will do it again, and I have no hesitation in hiding all their comments. These viewers are often easy to spot by their thumbnail design (skull and cross bones etc) or their name (Dr Chaos etc).
Generally a comment delete is all that's required.
If you don't control comments you will finish up with spam and all sorts of depravity accumulating on your channel. The 99.999999999% of good commenters don't want to read that crap either.
So YES do it.
Cheers Rob