Referral disclosure: the Apply button uses TechJobs360’s Mercor referral link. If you are hired through it, TechJobs360 may receive a referral bonus from Mercor. You apply on Mercor’s own site, in the same way as applying there directly.
- Pay: $70–$90 per hour (USD)
- Type: Contract, hourly, remote
- Open to: India
- Hours: About 40 hours a week
- Field: Software Engineering
- Posted on Mercor: 2026-08-28
About the role
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Basic Qualifications
- 3+ years professional software development
- Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
- Strong code-reading and debugging skills across full-stack or backend systems
- Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications
- Experience with Kiro or Amazon CodeCatalyst
- Prior work evaluating or grading AI-generated code
- Contributions to developer tooling
How applying works
You apply on Mercor’s site: create a Mercor profile, upload your CV and complete the steps the listing asks for, which usually include a short interview. Mercor decides who is selected, and pay is agreed with Mercor.
Browse more paid AI training roles in Worldwide Remote Jobs, or see all the platforms we list. Not the right fit? Alignerr, micro1, Ethos and Handshake AI also have paid remote AI work for professionals (referral links).
To apply for this job please visit work.mercor.com.
