About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Internet-Native Bilingual Evaluator Expert (French) Type:Contract Compensation:$50/hour Location:Remote Commitment:10–20 hours/week
Role Responsibilities
Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets. Qualifications
Must-Have
Native or near-native fluency in French and professional fluency in English.
Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.
Active participation in internet culture across both languages.
Strong writing, analytical, and critical thinking skills.
Available to commit 10–20 hours per week. Preferred
Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.
Familiarity with differences between European French, Québec French, and other French varieties.
Experience evaluating online content and internet-native communication.
Interest in AI and multilingual language technologies. Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
