Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

GP is likely referring to network latency here. There's a tradeoff between smaller GPUs/etc at home that have no latency to use and beefier hardware in the cloud that have a minimum latency to use.


Sure, but if the model takes multiple seconds to execute, then even 100 milliseconds of network latency seems more or less irrelevant




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: