Overseas Contractor

Role AI Tester

Key Responsibilities

Functional Model Testing

Design and execute test cases for AIML models including classification NLP recommendation and generative AI systems

Validate model outputs for accuracy consistency and expected behavior across diverse inputs

Perform regression testing after model updates retraining cycles or data changes

Prompt LLM Testing

Develop and maintain prompt test libraries for large language model LLMbased features

Evaluate model responses for relevance tone factual accuracy and adherence to business rules

Identify hallucinations response drift and edgecase failures in generative outputs

AI Safety Red Teaming

Conduct adversarial testing to identify vulnerabilities such as prompt injection jailbreaks and unintended model behaviors

Assess outputs for bias fairness and compliance with responsible AI principles

Document risk findings and collaborate with model teams to drive remediation

Test Automation Tooling

Build and maintain automated test suites for AI pipelines using Pythonbased frameworks

Integrate AI testing into CICD workflows and contribute to evaluation infrastructure

Track and report quality metrics model performance benchmarks and defect trends

Collaboration Documentation

Partner with data scientists ML engineers and product teams throughout the development lifecycle

Write clear test plans defect reports and evaluation summaries

Contribute to internal QA standards and best practices for AI systems