You're oversimplifying the way they're trained. Saying it's based on "how often that sequence appears in the training data" is making it sound like memorization when that's not what's really happening.
And judging from a lot of comments I see, I think this is a commun misconception. It seems like a lot of people genuinely think an LLM is only capable of copy-pasting its training data as is.
8
u/Creepslend Sep 02 '26
You're oversimplifying the way they're trained. Saying it's based on "how often that sequence appears in the training data" is making it sound like memorization when that's not what's really happening.
And judging from a lot of comments I see, I think this is a commun misconception. It seems like a lot of people genuinely think an LLM is only capable of copy-pasting its training data as is.