I mostly agree, and would say you should just play it blind. If you care about getting 100% (112% after the DLC) there are probably a couple of things where looking them up would be useful. It is also a very big world, so trying to do cleanup once you have all exploration tools can be quite involved
How do you know if you enjoy playing the game without a guide if you don't do it? Looking something up to unstuck yourself is one thing, but following a guide from beginning to end is robbing yourself of the opportunity to enjoy the game as presented.
"beating the game as quickly as possible" is such an obviously flawed reason to use a guide that I won't even respond to it. If you don't have the time to play the game, don't.
It's the thing about type I fun and type II fun, where type I is "fun while it's happening" and type II is "not fun while it's happening but fun in retrospect": if you don't use a guide, the type II fun that results may be greater in quality and impact than the type I fun you'd get using a guide
If you don't like the backtracking (I hated it), then the game is probably not for you.