> Until you can do matrix/vector math using hardware, webGL is pretty much useless.

Modern matrix libraries like glMatrix

https://github.com/toji/gl-matrix

use typed arrays effectively to do very fast matrix and vector math in JS. A modern JS engine can transform such code into something very efficient, more than fast enough to do things like even first person shooters.