Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
a_t48
on July 16, 2024
|
parent
|
context
|
favorite
| on:
Exo: Run your own AI cluster at home with everyday...
GP is likely referring to network latency here. There's a tradeoff between smaller GPUs/etc at home that have no latency to use and beefier hardware in the cloud that have a minimum latency to use.
yjftsjthsd-h
on July 16, 2024
[–]
Sure, but if the model takes multiple seconds to execute, then even 100 milliseconds of network latency seems more or less irrelevant
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: