Jobs

Join the teams that are changing the world.
59
companies
426
Jobs

Code Reviewer for LLM Data Training (JavaScript)

SuperAnnotate

SuperAnnotate

Software Engineering
India
Posted on Apr 18, 2025

About the Role

We are looking for a Code Reviewer with expertise in JavaScript to join our AI training QA team. You will be responsible for auditing annotator evaluations of AI-generated responses written in JavaScript. Your role will be to ensure technical correctness, instruction adherence, proof-of-work validation, and consistent application of evaluation rubrics.

Responsibilities

  • Audit annotator evaluations of AI-generated JavaScript responses
  • Verify if responses follow prompt requirements regarding syntax, scope handling, and client-side scripting patterns.
  • Evaluate JavaScript code for correctness, performance, security, and readability
  • Run and validate proof-of-work code submitted by annotators to confirm functionality
  • Review annotator-submitted Loom videos to assess evaluation and testing accuracy
  • Ensure responses align with instruction-following expectations including style, tone, and clarity
  • Identify and document errors, omissions, or rating inconsistencies
  • Provide clear, constructive QA feedback based on rubric and guideline criteria
  • Collaborate with internal teams for clarifications on complex or ambiguous items

Required Qualifications

  • 5–7+ years of experience in JavaScript development, QA, or code review
  • Strong understanding of core JavaScript concepts and development best practices
  • Experience with debugging, testing tools, and code execution environments
  • Strong analytical and critical thinking skills
  • Excellent written communication for documenting evaluations and feedback
  • English proficiency at B2, C1, C2, or Native level

Preferred Qualifications

  • Experience with AI/LLM workflows, human-in-the-loop QA, or model evaluation
  • Familiarity with structured code evaluation processes and rubrics
  • Experience using QA/annotation platforms such as SuperAnnotate

Why Join Us

Join a forward-thinking team shaping how AI learns to understand and write JavaScript code. Your expertise will directly influence the quality, reliability, and instructional value of AI-generated content. This is a fully remote role offering flexible hours, milestone-based structure, and competitive compensation.