Don't even need to use llama-swap anymore now that llama-server supports the sam... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		circularfoyers 26 days ago \| parent \| context \| favorite \| on: Hypura – A storage-tier-aware LLM inference schedu... Don't even need to use llama-swap anymore now that llama-server supports the same functionality.

rubiquity 26 days ago [–]

I did not know that. Thanks for sharing!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact