Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
jdspiral
8 months ago
|
parent
|
context
|
favorite
| on:
Meaning Machine – Visualize how LLMs break down an...
Yes, tokenization and embeddings are exactly how LLMs process input—they break text into tokens and map them to vectors. POS tags and SVOs aren't part of the model pipeline but help visualize structures the models learn implicitly.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: