State Representation
A language model trains once and stops learning. Memory is not the feature that's missing. State is: a living, revisable record of everything the model has met since, and the discipline of keeping it navigable, current, and fluent.