verifier.org

PyRIT

microsoft's mit-licensed red-team framework — build your own attacks, and the repository just moved.

free#security-teams-with-engi

the most flexible free option and the one that gives you least out of the box — it's a toolkit, not a scan.

mit-licensed and maintained by microsoft, pyrit is a framework for building red-team orchestration against generative ai systems, covering prompt injection, jailbreaks and harmful-content generation among its stated risk categories. because it's a toolkit rather than a fixed probe catalogue, what it actually tests depends on what you build with it.

that is the trade against garak. garak ships twenty-plus probes you can run immediately; pyrit ships the machinery to construct attacks specific to your system and threat model. for a team with the engineering capacity to use it, that's more powerful. for a team wanting a scan this afternoon, it's more work.

the description above is ours, condensed from the ranking. pricing moves — check it on the vendor's own page before you rely on it.

pricing
free
website
github.com
our verdict

the most flexible free option and the one that gives you least out of the box — it's a toolkit, not a scan.

we researched this category against vendors' own pricing pages and licence files. that is where this line comes from — not from the vendor, and not from anything they paid for.

more ai red-teaming tools

NeMo Guardrails

nvidia's toolkit for constraining llm behaviour, used alongside testing

#guardrails#open-source

Giskard

open-source scanner for llm vulnerabilities and quality regressions

#open-source#scanner

ModelScan

scans model files for unsafe serialisation before you load them

#supply-chain#open-source

HiddenLayer

we checked thisnot published

fifty disclosed cves and thirty patents, across the broadest claimed scope here.

#enterprises-wanting-mode