Yes. In reality, users would have a connection open with one or a small number of routing nodes.
The end result is very cheap and quick funds transfers to any node on the network. This lightning network infrastructure would make micropayments feasible.
Granted, there are still problems to solve. But this is the dream.
