Mercor ranks #7 of 8 in our data labeling vendors testing. the only vendor that publishes what it pays, and the only one that lost its contractors' passports and biometrics..
60/100
the best pay transparency in this category by a wide margin, and the worst documented harm to the people it pays.
why people look for an alternative
−2026 breach reportedly exposed ssns, passports and biometrics
−at least six class actions arising from that breach
−separate suit alleges undisclosed monitoring on personal devices
−misclassification class action covering ~30,000 contractors
stay with Mercor if publishes contractor rate bands, unique in this category is the thing you care about most — nothing below beats it on that.
#1 in data labeling vendors · reduces how much human labelling you need in the first place, which is the only structural answer to this category's problems.
80/100
verdictthe only vendor whose product reduces the amount of contract labour involved rather than organising it — and like everyone here, it won't tell you what that costs.
Snorkel AI vs Mercor
Mercor
Snorkel AI
price
$60-120/hr contractor bands
not published
free tier
no
no
published pricing
contractor bands only
none — page 404s
workforce
expert contractor marketplace
programmatic + expert contractors
pay disclosed
yes — $60-120/hr bands
no
documented disputes
breach + misclassification suits
none found
rlhf
implied, not branded
yes
switch forteams with domain-heavy text and documents who would rather write labelling functions than commission a crowd.
#2 in data labeling vendors · free open-source annotation tooling with no workforce attached — which is both its strength and the reason it can't finish first.
78/100
verdictthe only entry with no labour record to examine, because it employs nobody — you supply the people, and their working conditions become your problem rather than a vendor's.
Argilla vs Mercor
Mercor
Argilla
price
$60-120/hr contractor bands
free
free tier
no
yes
published pricing
contractor bands only
free, open source
workforce
expert contractor marketplace
none — you supply it
pay disclosed
yes — $60-120/hr bands
n/a
documented disputes
breach + misclassification suits
none — no workforce
rlhf
implied, not branded
tooling only
switch forteams with their own annotators, or open communities labelling public datasets.
pros
+free and open source, no software cost
+deep integration with the hugging face hub
+datasets stay under your control
+no contractor labour risk because there is no contractor labour
cons
−supplies no workforce at all
−you must source annotators separately
−no argilla-specific enterprise pricing published
−reuse terms for private enterprise deployments unverified
#3 in data labeling vendors · annotation platform plus an expert marketplace, with the highest reported pay band of the crowd-model vendors.
74/100
verdictthe most complete combination of platform and workforce here, reported to pay contributors well — with an unpaid screening stage that only shows up in worker reviews.
Labelbox vs Mercor
Mercor
Labelbox
price
$60-120/hr contractor bands
not published
free tier
no
no
published pricing
contractor bands only
none — page 404s
workforce
expert contractor marketplace
alignerr contractor marketplace
pay disclosed
yes — $60-120/hr bands
no — $15-60/hr reported
documented disputes
breach + misclassification suits
none found; reviews only
rlhf
implied, not branded
yes
switch forteams wanting tooling and on-demand domain experts from one vendor, including medical and legal specialists.
pros
+platform and expert marketplace from one vendor
+highest reported contractor pay band of the crowd vendors
+domain experts including medical and legal
+no litigation or regulatory action found
cons
−pricing page returns 404
−unpaid multi-hour evaluation stages reported by contributors
#4 in data labeling vendors · the largest open crowd here at the lowest reported pay, and a corporate lineage worth tracing before you sign.
70/100
verdictgenuine global reach at genuine crowd-labour rates — around $1 to $6 an hour by third-party reports — from a company still majority-owned by nebius.
Toloka vs Mercor
Mercor
Toloka
price
$60-120/hr contractor bands
not published
free tier
no
no
published pricing
contractor bands only
none
workforce
expert contractor marketplace
open crowd platform
pay disclosed
yes — $60-120/hr bands
no — $1-6/hr reported
documented disputes
breach + misclassification suits
none found
rlhf
implied, not branded
yes
switch forvery high-volume microtask labelling across many languages where unit cost dominates.
pros
+100+ countries and 40+ languages
+the deepest crowd for high-volume microtasks
+reportedly serves amazon, microsoft and anthropic
+no litigation found specific to toloka
cons
−reported crowd pay of roughly $1-6 an hour
−no published wage floor or pay breakdown
−no customer pricing published anywhere
−still majority economically owned by nebius group
#5 in data labeling vendors · bootstrapped, profitable and serving the frontier labs — facing a class action over how it classifies the people doing the work.
68/100
verdictthe quality reputation in this category and no venture capital behind it — with a misclassification class action that goes to the heart of how the work is organised.
Surge AI vs Mercor
Mercor
Surge AI
price
$60-120/hr contractor bands
not published
free tier
no
no
published pricing
contractor bands only
none
workforce
expert contractor marketplace
~50,000 expert contractors
pay disclosed
yes — $60-120/hr bands
no — 30-40c/min reported
documented disputes
breach + misclassification suits
misclassification class action
rlhf
implied, not branded
yes — core focus
switch forfrontier-lab-grade rlhf and reasoning data where quality outweighs procurement transparency.
pros
+bootstrapped and profitable, no external investors
+reported contractor rates well above crowd platforms
+focused specifically on rlhf and rl environments
+reportedly serves openai, anthropic, meta and microsoft
cons
−contractor-misclassification class action pending
#6 in data labeling vendors · human-plus-automation services at enterprise scale, with worker complaints that echo the category's pattern.
64/100
verdicta genuine enterprise operation with a dedicated rlhf practice — and worker accounts describing the misclassification and monitoring pattern seen elsewhere here.
Invisible Technologies vs Mercor
Mercor
Invisible Technologies
price
$60-120/hr contractor bands
not published
free tier
no
no
published pricing
contractor bands only
none
workforce
expert contractor marketplace
~24,000 vetted contractors
pay disclosed
yes — $60-120/hr bands
no
documented disputes
breach + misclassification suits
worker reviews only
rlhf
implied, not branded
yes — dedicated practice
switch forenterprises outsourcing blended human-and-automation work rather than pure annotation.
pros
+dedicated ai training and rlhf service line
+soc 2, hipaa and gdpr compliance cited
+blends human work with automation at enterprise scale
#8 in data labeling vendors · the biggest vendor in the category, part-owned by one of your competitors, with the longest labour record to read.
54/100
verdictunmatched capacity and capital, ranked last here because this page measures transparency and labour record — and on both, scale has the most on the record.
Scale AI vs Mercor
Mercor
Scale AI
price
$60-120/hr contractor bands
not published
free tier
no
yes
published pricing
contractor bands only
none beyond a free teaser
workforce
expert contractor marketplace
remotasks crowd + outlier experts
pay disclosed
yes — $60-120/hr bands
no — ~1c/task reported
documented disputes
breach + misclassification suits
two pending us suits
rlhf
implied, not branded
yes — core offering
switch forfrontier-scale programmes and government work, for buyers who have weighed the meta relationship.
pros
+deepest capacity for frontier training data and rlhf
+most capital and the strongest government contract position
+covers text, image, video, audio and code
+free tier of 1,000 labelling units and 10,000 images
cons
−meta holds a reported 49% stake, creating a competitive conflict
−major labs reportedly reduced engagements after that deal
−kenya operation closed in 2024 with wages reportedly owed
−two pending us suits over wages and content-moderation harm
every tool on this page went through the same test as Mercor — same tasks, same order, scored the same way. the comparison tables are the figures from that testing, not vendor spec sheets.