KoboldCpp
KoboldCpp is a self-contained local AI inference tool with a built-in web UI. It runs GGUF text, image, and speech models with no installation beyond a single binary, primarily aimed at creative writing and roleplay workflows.
Self-hosted Local AI
The Local AI we recommend, filtered to Self-hosted. See all Local AI →