verifier.org

Toloka

the largest open crowd here at the lowest reported pay, and a corporate lineage worth tracing before you sign.

not published#very-high-volume-microta

genuine global reach at genuine crowd-labour rates — around $1 to $6 an hour by third-party reports — from a company still majority-owned by nebius.

toloka runs an open crowd platform across a claimed 100-plus countries and 40-plus languages, where workers sign up directly and complete microtasks. for sheer breadth and unit economics at volume, nothing else here matches it, and it reportedly serves amazon, microsoft and anthropic.

worker pay is where the model shows. third-party review sites report roughly $1 to $6 an hour for casual tasks, rarely above $8 even for experienced workers, with typical monthly earnings from $20 to $400 depending on intensity. toloka publishes no wage floor and no country-level pay breakdown, so those figures are worker-reported rather than disclosed. we found no litigation specific to toloka.

the description above is ours, condensed from the ranking. pricing moves — check it on the vendor's own page before you rely on it.

pricing
not published
website
toloka.ai
our verdict

genuine global reach at genuine crowd-labour rates — around $1 to $6 an hour by third-party reports — from a company still majority-owned by nebius.

we researched this category against vendors' own pricing pages and licence files. that is where this line comes from — not from the vendor, and not from anything they paid for.

more data labeling vendors

Snorkel AI

we checked thisnot published

reduces how much human labelling you need in the first place, which is the only structural answer to this category's problems.

#teams-with-domain-heavy-#documents-who-would-rath

Argilla

we checked thisfree

free open-source annotation tooling with no workforce attached — which is both its strength and the reason it can't finish first.

#teams-with-their-own-ann#or-open-communities-labe

Labelbox

we checked thisnot published

annotation platform plus an expert marketplace, with the highest reported pay band of the crowd-model vendors.

#teams-wanting-tooling#on-demand-domain-experts#including-medical

Surge AI

we checked thisnot published

bootstrapped, profitable and serving the frontier labs — facing a class action over how it classifies the people doing the work.

#frontier-lab-grade-rlhf#reasoning-data-where-qua