QA Specialist - AI Chatbot Response Evaluations (TypeScript)
SuperAnnotate
Role Overview:
We are seeking an experienced QA Specialist with strong TypeScript expertise to review and audit evaluation tasks completed by Data Annotators assessing AI-generated code. You will ensure accuracy in how annotators rate instruction-following and factual correctness, validate their testing logic, and review submitted proof-of-work code for proper functionality and completeness. Your insights will help maintain the integrity of our AI training pipeline.
Responsibilities:
- Audit annotator evaluations of AI-generated TypeScript code responses.
- Ensure annotators correctly apply guidelines for instruction-following and code correctness.
- Review, test, and validate proof-of-work code submitted by annotators.
- Identify errors, logical inconsistencies, or incomplete testing in annotator evaluations.
- Deliver structured and actionable written feedback to annotators.
- Collaborate with QA leads to maintain consistency and guideline adherence.
Required Qualifications:
- 7+ years of professional experience in TypeScript or JavaScript QA, debugging, or code evaluation.
- Strong understanding of TypeScript features, type safety, and modern JavaScript standards.
- Experience with testing frameworks and browser-based debugging tools.
- Attention to detail in validating correctness, safety, performance, and instruction alignment.
- Excellent documentation and written communication skills.
- English proficiency at B2, C1, C2, or Native level.
Preferred Qualifications:
- Experience with annotation quality assurance or AI model training data.
- Familiarity with evaluating AI-generated code responses, LLMs, or RLHF workflows.
- Understanding of functional vs. type errors, async/await patterns, and code clarity in TypeScript.
Contract Type: Freelance/Contract/Part-Time
Why Join Us?
Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.
If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.
#TypeScript #QA #CodeReview #AI #RemoteJobs #TechHiring #Freelance