Remote Software Quality Assurance (QA) & Automated Test Engineer | Flexible Hourly/Annual Role

RemoteWork Talent Agency has an immediate remote opening for a Remote Software Quality Assurance (QA) & Automated Test Engineer | Flexible Hourly/Annual Role earning $63 - $120/hour. In this flexible work-from-home engagement (open to candidates in the US, UK, Canada, Australia, NZ, and Ireland), you will apply practical mastery of software quality assurance, test case design, test execution, defect reporting to stress-test large language models, verify factual rigor, and build gold-standard evaluation datasets.

Key Duties & Project Scope

• Evaluate, analyze, and report on model predictions, identifying inconsistencies, errors, or patterns for continuous improvement.
• Collaborate with cross-functional teams to communicate findings, raise questions, and clarify project requirements.
• Contribute to the development and refinement of testing methodologies specific to AI-driven systems.
• Maintain detailed, organized records of evaluations, test results, and feedback through written documentation.
• Provide actionable recommendations to optimize data quality and model performance.
• Demonstrated professional or academic background in software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling.
• Strong analytical reasoning and ability to articulate complex concepts clearly in written English.

Candidate Requirements

• Prior experience with data labeling, annotation, reinforcement learning from human feedback (RLHF), or model evaluation.
• Proficiency in English at B2 level or above for effective collaboration and reporting.
• Compensation Band: $63 - $120/hour
• Work Location: Remote (100% Remote / Asynchronous Flexibility)
• Available Openings: 120 open positions
• Core Competencies: software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling, ai model evaluation, documentation, english communication, cross-functional collaboration
• High attention to detail when reviewing technical or domain-specific documentation.

Pay Rate & Contract Overview

• Compensation Rate: $63 - $120/hour (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling, ai model evaluation, documentation, english communication, cross-functional collaboration
• Hiring Agency: RemoteWork Talent Agency

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.