Not even just anime or video games when it comes to VR. Imagine the other possibilities with it and how it could become so much more. Think about how colleges could make VR classrooms where instead of you getting up and going to class, you literally just put on some NerveGear and you're in your class. (Imagine how awesome it would be to be the professor teaching that class haha, they literally wake up and put on their VR gear and then they're in class.) If something like SAO style VR became to exist, it would change the world in more ways then possible. With calculations and sensors on the body, they could see how certain things react to the body without actually hurting you or physically testing something on you.
Also with everything, people are bound to find negatives, so why even worry about them right now?