Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

341 is two orders of magnitude faster than your 1 tok/s so it doesn’t seem like their stuff is all that obvious. I also have no baseline for training to know if 341tok/s is slow but it seems speedy for a 3090.
 help



OP said 1k, not 1

:) Coffee is good

1k tok/s = 1000 tok/s...

OOM is log10



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: