Role Overview:

We are looking for a QA Specialist with strong experience in Bash or shell scripting to audit Data Annotator evaluations of AI-generated terminal scripts. Your responsibility will be to ensure the accuracy and completeness of annotators’ evaluations based on structured guidelines, confirm proof-of-work validation, and provide clear feedback to uphold code quality standards across the AI training workflow.

Responsibilities:

• Audit annotator evaluations of AI-generated Bash or shell scripts.
• Verify proper application of instruction-following and factual correctness rubrics.
• Test annotator-submitted code using local or secure shell environments.
• Evaluate annotator explanations and test coverage for accuracy and completeness.
• Identify gaps, errors, or inconsistencies in code execution, functionality, or safety.
• Provide clear, actionable feedback to annotators to improve future evaluations.
• Work with QA leads to uphold consistent review standards.

Required Qualifications:

• 7+ years of experience in Bash or shell scripting, automation, or Linux-based QA.
• Deep understanding of scripting logic, command-line utilities, file operations, and permissions.
• Familiarity with script safety, error handling, and real-world usability.
• Experience testing scripts in Unix/Linux terminal environments.
• Excellent analytical and documentation skills.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

• Experience with annotation QA, model evaluation, or AI training workflows.
• Familiarity with auditing proof-of-work, AI-generated script content, or RLHF practices.
• Awareness of secure scripting best practices and edge-case handling in production environments.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#Bash #ShellScripting #QA #AI #CodeReview #Linux #RemoteJobs #TechHiring #Freelance