verifier.org

Text Generation WebUI

oobabooga's gradio interface for running local models and loaders

#open-source#gradio

Text Generation WebUI is listed here for coverage of the category. the entry is ours, not the vendor's: we have not tested it, there is no score, and no pricing is quoted because we have not read it off their own page on a date we can cite.

if you work on Text Generation WebUI, claim the listing through /submit and replace this with your own description.

the description above is supplied by the vendor and is not something we have tested. pricing is as they state it.

pricing
not stated
website
github.com

more local llm tools

vLLM

high-throughput serving engine you can run on your own gpu

#serving#throughput

MLX LM

apple's framework for running and fine-tuning models on apple silicon

#apple-silicon

Jan

we checked thisfree

gui, server and inference engine all apache 2.0 — the only tool here where every layer is genuinely open.

#anyone-who-wants-ollama-

llama.cpp

we checked thisfree

mit, and the engine most of this list is quietly built on top of.

#anyone-comfortable-at-a-#anyone-who-wants-the-new