> the LLM perceives [...] the word as a single indivisible thing (a token). Two ...

		kaoD 5 months ago \| parent \| context \| favorite \| on: GPT-5: "How many times does the letter b appear in... > the LLM perceives [...] the word as a single indivisible thing (a token). Two actually, "blue" and "berry". https://platform.openai.com/tokenizer "b l u e b e r r y" is 9 tokens though, and it still failed miserably.