verifier.org

Labelbox

annotation platform plus an expert marketplace, with the highest reported pay band of the crowd-model vendors.

not published#teams-wanting-tooling#on-demand-domain-experts#including-medical

the most complete combination of platform and workforce here, reported to pay contributors well — with an unpaid screening stage that only shows up in worker reviews.

labelbox pairs its annotation platform with alignerr, its expert contractor marketplace, claiming 250,000-plus specialised hours a month spanning entry-level work up to medical and legal domain experts. a third-party review site reports contractor pay of roughly $15 to $60 an hour depending on domain — the highest reported band among the crowd-model vendors here, though labelbox publishes no figure itself.

the same review site reports unpaid or low-paid multi-hour evaluation stages before contributors reach paid projects. we found no court filing or regulatory action on this, so it stands as aggregated worker anecdote rather than a documented dispute, and we're labelling it that way rather than either amplifying or ignoring it.

the description above is ours, condensed from the ranking. pricing moves — check it on the vendor's own page before you rely on it.

pricing
not published
our verdict

the most complete combination of platform and workforce here, reported to pay contributors well — with an unpaid screening stage that only shows up in worker reviews.

we researched this category against vendors' own pricing pages and licence files. that is where this line comes from — not from the vendor, and not from anything they paid for.

more data labeling vendors

Label Studio

the open-source annotation tool behind heartex, self-hostable

#open-source#self-hosted

Sama

managed annotation workforce with published ethical-sourcing commitments

#managed#impact

CloudFactory

long-running managed teams for annotation and data work

#managed#teams

Snorkel AI

we checked thisnot published

reduces how much human labelling you need in the first place, which is the only structural answer to this category's problems.

#teams-with-domain-heavy-#documents-who-would-rath