In general I agree with you, but I think we need to figure out how to do really long context lengths before that's really true. A sci fi AI with a real identity would be able to relate to everything that happened in its "life", not just the last 4k tokens.