Jobs

Join the teams that are changing the world.
59
companies
307
Jobs

Code Reviewer for LLM Data Training (C Programming)

SuperAnnotate

SuperAnnotate

India
Posted on May 6, 2025

About the Role

We are looking for a Code Reviewer with expertise in C to join our AI training QA team. You will be responsible for auditing annotator evaluations of AI-generated responses written in C. Your role will be to ensure technical correctness, instruction adherence, proof-of-work validation, and consistent application of evaluation rubrics.

Responsibilities

  • Audit annotator evaluations of AI-generated C responses
  • Verify if responses follow prompt requirements regarding procedural structure, memory management, and correct syntax in C.
  • Evaluate C code for correctness, performance, security, and readability
  • Run and validate proof-of-work code submitted by annotators to confirm functionality
  • Review annotator-submitted Loom videos to assess evaluation and testing accuracy
  • Ensure responses align with instruction-following expectations including style, tone, and clarity
  • Identify and document errors, omissions, or rating inconsistencies
  • Provide clear, constructive QA feedback based on rubric and guideline criteria
  • Collaborate with internal teams for clarifications on complex or ambiguous items

Required Qualifications

  • 5–7+ years of experience in C development, QA, or code review
  • Strong understanding of core C concepts and development best practices
  • Experience with debugging, testing tools, and code execution environments
  • Strong analytical and critical thinking skills
  • Excellent written communication for documenting evaluations and feedback
  • English proficiency at B2, C1, C2, or Native level

Preferred Qualifications

  • Experience with AI/LLM workflows, human-in-the-loop QA, or model evaluation
  • Familiarity with structured code evaluation processes and rubrics
  • Experience using QA/annotation platforms such as SuperAnnotate

Why Join Us

Join a forward-thinking team shaping how AI learns to understand and write C code. Your expertise will directly influence the quality, reliability, and instructional value of AI-generated content. This is a fully remote role offering flexible hours, milestone-based structure, and competitive compensation.