Overview
The work iMerit, an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will review AI generated responses and decide which ones actually hold up: accurate, relevant, concise, safe, well localized, and true to what the user asked for. Every ranking comes with a short written rationale, and those comments feed directly into ho
Full job description
The work iMerit, an EXL company, is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will review AI generated responses and decide which ones actually hold up: accurate, relevant, concise, safe, well localized, and true to what the user asked for. Every ranking comes with a short written rationale, and those comments feed directly into how the models improve. Careful reading and good judgment matter far more than speed here. What you will do Interpret conversational context and identify what the user really wanted Rate and rank responses against defined quality criteria Compare multiple answers and explain in writing why one wins Verify factual claims using approved research sources Flag tasks that cannot be reliably assessed rather than guessing What you bring Strong critical thinking and sound judgment in ambiguous cases Solid research skills and attention to detail Excellent reading comprehension Professional written English that is clear and concise Self direction and the discipline to hit deadlines without supervision Prior experience in AI evaluation, annotation, writing, editing, research, or translation is a plus, though not required. Good to know Independent contractor engagement for the length of the project. Fully remote and flexible. You choose your hours as long as volume and deadlines are met. Task volume varies with project demand. A paid qualification assessment is required before live work begins.
Requirements: criteria Compare multiple answers and explain in writing why one wins Verify factual claims using approved research sources Flag tasks that cannot be reliably assessed rather than guessing What you bring Strong critical thinking and sound judgment in ambiguous cases Solid research skills and attention to detail Excellent reading comprehension Professional written English that is clear and concise Self direction and the discipline to hit deadlines without supervision Prior experience in AI evaluation, annotation, writing, editing, research, or translation is a plus, though not required. Good to know Independent contractor engagement for the length of the project. Fully remote and flexible. You choose your hours as long as volume and deadlines are met. Task volume varies with project demand. A paid qualification assessment is required before live work begins.
Requirements & qualifications
criteria Compare multiple answers and explain in writing why one wins Verify factual claims using approved research sources Flag tasks that cannot be reliably assessed rather than guessing What you bring Strong critical thinking and sound judgment in ambiguous cases Solid research skills and attention to detail Excellent reading comprehension Professional written English that is clear and concise Self direction and the discipline to hit deadlines without supervision Prior experience in AI evaluation, annotation, writing, editing, research, or translation is a plus, though not required. Good to know Independent contractor engagement for the length of the project. Fully remote and flexible. You choose your hours as long as volume and deadlines are met. Task volume varies with project demand. A paid qualification assessment is required before live work begins.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
JobOpportunity is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →Browse current JobOpportunity listings from Working Nomads →