Role Overview:

We are seeking a detail-focused QA Specialist with strong expertise in C# to audit evaluation tasks performed by Data Annotators assessing AI-generated code responses. You will be responsible for ensuring annotators correctly rate instruction-following and correctness, test code snippets, and provide valid proof of work in alignment with structured evaluation guidelines. This is a critical quality gate for AI training workflows.

Responsibilities:

• Audit annotator evaluations of AI-generated C# code responses.
• Verify accurate application of rating rubrics for instruction-following and correctness.
• Review and test annotator-submitted proof-of-work code to validate code behavior and accuracy.
• Identify discrepancies in annotator feedback, flawed logic in conclusions, or missed code errors.
• Provide concise, actionable feedback to annotators and maintain quality standards.
• Collaborate with the QA lead to align with evaluation goals and guideline updates.

Required Qualifications:

• 7+ years of experience in C# software QA, debugging, or code evaluation roles.
• Proficiency in C# syntax, .NET framework basics, and object-oriented programming principles.
• Experience with code testing, debugging, and performance validation tools.
• Strong analytical skills and attention to detail in evaluating code correctness and usability.
• Excellent written communication and feedback delivery skills.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

• Experience with annotation workflows or quality assurance for AI model training data.
• Familiarity with evaluating LLM responses, proof-of-work validation, or RLHF processes.
• Understanding of secure coding practices, error handling, and documentation standards in C#.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#CSharp #QA #AI #LLM #RemoteJobs #CodeReview #TechHiring #Freelance #C#