There's a Python binding for llama.cpp which is actively maintained and has work...

		simonw on April 29, 2024 \| parent \| context \| favorite \| on: Ollama v0.1.33 with Llama 3, Phi 3, and Qwen 110B There's a Python binding for llama.cpp which is actively maintained and has worked well for me: https://github.com/abetlen/llama-cpp-python