verifier.org

GPT4All

mit, with local document chat built into the free app instead of sold as a feature.

free#chatting-with-your-own-f

unrestricted mit and the easiest local document chat here — on a project whose development pace we could not confirm is keeping up.

localdocs is the reason to pick it: point the app at a folder and ask questions about its contents, entirely locally, with no vector database to stand up and no configuration. rivals either omit this or treat it as an advanced feature.

the licence is mit with no conditions, the gui is qt-based and available on macos, windows and linux, and there are python bindings and a local server alongside cuda, vulkan, metal and cpu backends.

the description above is ours, condensed from the ranking. pricing moves — check it on the vendor's own page before you rely on it.

pricing
free
website
github.com
our verdict

unrestricted mit and the easiest local document chat here — on a project whose development pace we could not confirm is keeping up.

we researched this category against vendors' own pricing pages and licence files. that is where this line comes from — not from the vendor, and not from anything they paid for.

more local llm tools

Text Generation WebUI

oobabooga's gradio interface for running local models and loaders

#open-source#gradio

vLLM

high-throughput serving engine you can run on your own gpu

#serving#throughput

MLX LM

apple's framework for running and fine-tuning models on apple silicon

#apple-silicon

Jan

we checked thisfree

gui, server and inference engine all apache 2.0 — the only tool here where every layer is genuinely open.

#anyone-who-wants-ollama-