RemoteJobs.org mascotRemoteJobs.org
Remote JobsCompaniesAPIPost a Job
RemoteJobs.org mascotRemoteJobs.org

Find your dream remote job. Browse thousands of remote positions from top companies worldwide.

Job Categories

  • General
  • Programming
  • Design
  • Marketing
  • Sales
  • Customer Support

Resources

  • Browse Jobs
  • Companies
  • Post a Job
  • For Developers
  • Blog

Company

  • About Us
  • Contact
  • Privacy Policy
  • Terms of Service
© 2026 RemoteJobs.org. All rights reserved.
    ← Back to all jobs
    mercor

    Language Model Evaluator - Fully Remote | Upto $20/hr Part-time

    mercor
    Contract
    Verified Remote
    RemoteUSD 15 - 20Human Resources2 weeks ago

    About this role

    About the job

    Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

    Position: Generalist - English & Bengali Type:Contract Compensation:$15–$20/hour Location:Remote

    Role Responsibilities

    • Conduct fact-checking using trusted public sources and external tools.

    • Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.

    • Assess reasoning quality, clarity, tone, and completeness of responses.

    • Ensure model responses align with expected conversational behavior and system guidelines.

    • Work independently and asynchronously to meet deadlines while improving AI model performance. Qualifications

    Must-Have

    • Bachelor's degree

    • Native speaker in Bengali

    • Significant experience using large language models (LLMs)

    • Excellent writing skills in English

    • Strong attention to detail

    • Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering) Preferred

    • Prior experience with RLHF, model evaluation, or data annotation work

    • Experience writing or editing high-quality written content

    • Experience comparing multiple outputs and making fine-grained qualitative judgments Application Process (Takes 20–30 mins to complete)

    • Upload resume

    • AI interview based on your resume

    • Submit form Resources & Support

    • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome

    • For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    About mercor

    mercor
    mercor

    Hiring remote talent?

    Reach active remote job seekers from $149.

    Related Jobs

    Junior Recruitment Coordinator

    Hire Hangar · USD 500 - 1,000

    Sr Compensation Partner

    Globalization Partners

    HR Operations Administrator - Remote, Austin/San Antonio Metro Areas

    James Avery Jewelry