Jobs

Join the teams that are changing the world.
59
companies
433
Jobs

QA Specialist - AI Chatbot Response Evaluations (MATLAB)

SuperAnnotate

SuperAnnotate

Software Engineering, Data Science, Quality Assurance
Middle East
Posted on Mar 28, 2025

Role Overview:

We are seeking a QA Specialist with strong MATLAB expertise to review and audit Data Annotator evaluations of AI-generated code responses. Your role will include validating annotator accuracy in instruction-following, code correctness, and simulation proof-of-work. The ideal candidate will have experience in numerical computing, signal processing, or modeling using MATLAB.

Responsibilities:

  • Audit annotator evaluations of AI-generated MATLAB code and related simulation tasks.
  • Validate proper application of evaluation rubrics for instruction-following and correctness.
  • Review and test annotator-submitted proof-of-work to ensure code functionality and alignment with instructions.
  • Identify misjudged ratings, flawed logic, or incomplete testing by annotators.
  • Provide detailed, actionable feedback to maintain high-quality standards.
  • Work with QA leads to uphold rubric consistency and evaluation integrity.

Required Qualifications:

  • 7+ years of hands-on experience in MATLAB programming, modeling, or code QA.
  • Strong understanding of MATLAB syntax, data structures, plotting, and mathematical functions.
  • Experience with simulation, algorithm development, or data analysis in MATLAB.
  • Familiarity with testing code behavior and reproducibility.
  • Strong communication skills and attention to technical detail.
  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

  • Experience auditing annotation work or AI-generated technical outputs.
  • Background in engineering, control systems, numerical methods, or data science.
  • Understanding of model evaluation workflows, LLM responses, or RLHF pipelines.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#MATLAB #QA #CodeReview #AI #NumericalComputing #Simulation #RemoteJobs #TechHiring #Freelance