Some people refuse to learn. I've always been fascinated that people forget that the sun rises in the east and sets in the west and if you can see the sun, you can have a general idea of where you are going (assuming you know roughly when noon is).
Some are just amazed that I can tell where we are going until I remind them I can see their shadows.
Tip: Having tried to communicate the same thing, shadows are easier for people to work with. They point precisely in a certain direction rather than 'that big bright ball is over there'.
Now coming up with the precise direction the shadow is pointing is trickier but usually people need little precision, maybe the 8 most cardinal directions on the compass.
Some are just amazed that I can tell where we are going until I remind them I can see their shadows.