data labeling vendors
ranked on what they'll tell you: what it costs, who actually does the labelling, and what the public record says about how those people are treated.
11 listed · 8 of them researched by us · featured first, then most upvoted
Snorkel AI
we checked thisnot publishedreduces how much human labelling you need in the first place, which is the only structural answer to this category's problems.
Argilla
we checked thisfreefree open-source annotation tooling with no workforce attached — which is both its strength and the reason it can't finish first.
Labelbox
we checked thisnot publishedannotation platform plus an expert marketplace, with the highest reported pay band of the crowd-model vendors.
Toloka
we checked thisnot publishedthe largest open crowd here at the lowest reported pay, and a corporate lineage worth tracing before you sign.
Surge AI
we checked thisnot publishedbootstrapped, profitable and serving the frontier labs — facing a class action over how it classifies the people doing the work.
Invisible Technologies
we checked thisnot publishedhuman-plus-automation services at enterprise scale, with worker complaints that echo the category's pattern.
missing something? a free listing takes two minutes, $50 pins it to the top of this page.
add a tool →