Role Overview: We are seeking an experienced and detail-oriented QA Specialist with strong Java expertise to ensure the quality of AI-generated Java code evaluations. In this role, you will independently review and validate evaluations conducted by Data Annotators, enhancing accuracy, consistency, and reliability through detailed audits and clear feedback.

Responsibilities:

• Conduct thorough quality assurance audits of Java code evaluations provided by annotators.
• Verify adherence to evaluation guidelines, ensuring annotators correctly identify issues related to functionality, executability, safety, performance, and documentation.
• Clearly document and communicate any discrepancies or errors found during evaluations, providing constructive and actionable feedback.
• Collaborate with annotation teams and stakeholders to refine standards and resolve quality-related concerns.
• Contribute to ongoing improvements in annotation quality, reliability, and efficiency.

Requirements:

• 7+ years of professional experience in Java quality assurance, software testing, or technical evaluations.
• Strong expertise in Java programming, debugging, testing methodologies (unit and integration testing), and performance analysis.
• Exceptional analytical and problem-solving skills, with the ability to clearly articulate findings in written communication.
• English proficiency at B2, C1, C2, or Native levels.

Preferred Qualifications:

• Prior experience with AI/ML training datasets, chatbot response evaluation, or data annotation verification.
• Familiarity with large language models (LLMs), reinforcement learning with human feedback (RLHF), or annotation platforms such as SuperAnnotate.
• Comfortable managing ambiguity and able to clarify complex technical requirements effectively.

Contract Type: Freelance/Contract/Part-Time

Why Join Us? Become part of an innovative team at the forefront of AI technology. Your Java QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#Java #QA #AI #Hiring #QualityAssurance #RemoteJobs #TechJobs