Jobs

Join the teams that are changing the world.
59
companies
424
Jobs

QA Specialist - AI Chatbot Response Evaluations (PHP)

SuperAnnotate

SuperAnnotate

Software Engineering, Data Science, Quality Assurance
Latin America
Posted on Mar 28, 2025

Role Overview:

We are seeking a detail-oriented QA Specialist with strong PHP experience to audit evaluation work performed by Data Annotators assessing AI-generated code. You will review ratings for instruction-following, factual correctness, and functional validation. Your work will help maintain high-quality standards in AI training datasets.

Responsibilities:

  • Audit annotator evaluations of AI-generated PHP code responses.
  • Ensure annotators follow guidelines accurately in assessing instruction-following and code correctness.
  • Test proof-of-work code snippets submitted by annotators to verify output, functionality, and security.
  • Identify logical flaws, incomplete evaluations, or misapplied rubric criteria.
  • Deliver structured and helpful feedback to improve evaluation quality.
  • Collaborate with QA leads to ensure consistency in review processes.

Required Qualifications:

  • 7+ years of professional experience with PHP development or technical QA.
  • Strong understanding of PHP syntax, logic, and server-side scripting practices.
  • Experience with web debugging, backend testing, and functional validation.
  • Familiarity with frameworks like Laravel, Symfony, or plain PHP scripting.
  • Strong documentation and written communication skills.
  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

  • Experience with annotation QA or model training workflows.
  • Familiarity with AI-generated code evaluation, RLHF, or prompt-based testing.
  • Understanding of security best practices and PHP error handling.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#PHP #QA #AI #CodeReview #LLM #RemoteJobs #BackendDevelopment #TechHiring