KoboldCpp
KoboldCpp is a self-contained local AI inference tool with a built-in web UI. It runs GGUF text, image, and speech models with no installation beyond a single binary, primarily aimed at creative writing and roleplay workflows.
For experts Local AI
The Local AI we recommend, filtered to For experts. See all Local AI →