One of my investment principles is to "always bet on laziness"
VR goggles are the opposite of laziness for me.
Too much effort required to set everything up. Why do that much work for little reward if I can just sit back in my couch with a remote and play a game?
Which is why Oculus Go is being a (moderate) success. It's quick and easy to grab and use. It has its problems, sure, lack of 6dof in headset and controller, and lack of content, but we'll get there soon I think.
I think you're right overall. That said, VR seems to be a great fit for certain types of games, especially if they've been designed from the ground-up for VR.
As an example, I'm not sure if playing Civilization 6 in VR would be so earth shattering that I'd go through the effort (though who knows?). On the other hand, for a game like Elite: Dangerous, where essentially it's all about immersion in the experience of flying a spaceship, VR could / can be awesome. Even a simple head-tracking device can transform the setting from "hey, I'm playing a game here" to "hey, I'm sitting in a space ship here".
VR goggles are the opposite of laziness for me.
Too much effort required to set everything up. Why do that much work for little reward if I can just sit back in my couch with a remote and play a game?