We are seeking a highly skilled and detail-oriented AI Tester with a strong passion for machine learning technologies, including large language models (LLMs). In this role, you will be responsible for testing and validating artificial intelligence products, contributing to the development and deployment of high-quality AI solutions. You will work closely with engineers and scientists to ensure that AI systems function as intended and deliver accurate, bias-free, and reliable outputs.
Key Responsibilities:
- Design and implement comprehensive testing plans for AI models and systems, with a focus on LLMs and machine learning algorithms.
- Identify bugs, ethical concerns, and performance issues in AI behaviour, and collaborate with the development team to resolve them efficiently.
- Create and maintain test scripts, datasets, and evaluation benchmarks tailored to AI and machine learning applications.
- Analyse AI outputs for accuracy, fairness, transparency, and safety across varied scenarios and data sets.
- Participate in the development of tools and frameworks to streamline AI testing processes.
- Regularly report findings, risks and recommendations to relevant cross-functional teams.
Required Skills and Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Science, Artificial Intelligence, or a related field.
- Hands-on experience building and testing machine learning models, especially LLMs and NLP-based systems.
- Strong understanding of machine learning concepts and common frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.
- Proficiency in Python and familiarity with automation and testing frameworks.
- Excellent analytical and problem-solving skills with a keen eye for detail and accuracy.
- Good understanding of AI ethical considerations, including bias detection and mitigation.
- Strong communication skills and the ability to clearly document test plans and findings.
This is a unique opportunity for a driven professional to help ensure the robustness and integrity of cutting-edge AI products. You will be instrumental in building trustworthy and high-performance AI systems that serve a broad user base. If you thrive in collaborative, fast-paced environments and are passionate about quality assurance in AI, we would love to hear from you.
