We are looking for Generative Audio EvaluationSpecialists! A great entry point into ongoing work within one of our most active AI markets! Job Type: Freelance Location: Remote (Spain) Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want! Rate: 12 USD/hourHelp Shape the Future of AI
We’re currently hiring Generative Audio Evaluators to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model. What You’ll Be Doing
You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:
Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.
What We’re Looking For
Native-level fluency in Spanish
Strong attention to detail and excellent listening skills
Ability to follow detailed evaluation guidelines consistently
Good understanding of spoken language, audio quality, and context
Reliable equipment — high-quality headphones are required
Ability to complete the evaluation test within 48 hours of receiving the assignment
Qualification Process
Application (You are here!)
Screening Survey
Language Knowledge Assessments
Target Language
English
RWS Vendor Onboarding
Internal Testing
Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.
Vendor Type
When applying, please select the option that best describes your working status.Are you a Freelancer or Private Individual?
A Freelancer is someone who has a business license and may have a VAT number or EIN for tax purposes. A VAT (Value Added Tax) number is a unique identifier assigned to a registered business in many countries; an EIN (Employer Identification Number) is a similar identifier used in the US. A Private Individual does not have a business license. If you aren’t sure, you are probably a private individual. RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
RWS Group is a company focused on improving artificial intelligence systems through data annotation, evaluation, and quality assurance. They work with native speakers across multiple languages to enhance AI-generated content by performing tasks such as data collection, evaluation, pairwise comparisons, and object tagging across audio, video, and image content. The company also engages subject matter experts to create high-quality question-and-answer content for training advanced AI reasoning capabilities. RWS is committed to shaping the development and safety of AI models while promoting diversity, equity, and inclusion in their workforce.
