
Headquarters: California
URL: https://imerit.ai/
iMerit is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
What you bring:
Good to know
To apply: https://weworkremotely.com/remote-jobs/imerit-ai-response-evaluator
iMerit is an AI evaluation and data labeling company that specializes in training and improving AI models through human evaluation of AI-generated responses. The company focuses on assessing AI outputs against defined quality criteria including accuracy, relevance, clarity, safety, and instruction adherence. iMerit engages detail-oriented analysts to evaluate AI responses to image-based prompts, comparing multiple answers and verifying factual claims to ensure AI models produce reliable and contextually appropriate outputs.