SDET AI Engineer QA Testing

Description and Requirements

AI Engineer (Software Developer in Test/QA)

Role Overview

An AI Testing Engineer / SDET will be responsible for strengthening software quality across Agile, cloud-native, and AI-enabled delivery teams. The role requires strong programming fundamentals, test automation expertise, and the ability to validate traditional applications as well as emerging Generative AI, RAG, and Agentic AI solutions. The engineer will work closely with software developers, architects, AI engineers, and DevOps teams to improve release quality, automate validation, reduce manual effort, and support AI-driven SDLC initiatives.

Key Responsibilities

Quality Engineering and Testing

• Understand application architecture, APIs, databases, source code, authentication flows, cloud integrations, and business workflows.
• Design, execute, and maintain test plans, test cases, and validation strategies across unit, functional, integration, system, API, end-to-end, and regression testing.
• Identify, document, track, and verify defects while ensuring the new functionality does not impact existing features.

Automation and Reliability Engineering

• Develop and maintain reusable automation frameworks, test suites, validation scripts, and regression capabilities for UI, API, backend, and integration testing.
• Improve test coverage, release confidence, and engineering productivity by promoting automation-first quality practices.

AI Evaluation & Agentic Validation

• Design and execute evaluation strategies for Generative AI, LLM, RAG, and Agentic AI systems, including benchmark datasets and automated evaluation pipelines.
• Validate AI quality metrics such as accuracy, relevance, groundedness, faithfulness, hallucination detection, response quality, and latency.
• Test RAG workflows including ingestion, chunking, indexing, retrieval, ranking, response generation, prompt quality, agents, tools, workflows, and orchestration frameworks.

Candidate Qualifications

• 2 to 5 years of experience in software testing, quality engineering, test automation, reliability engineering, or similar roles.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Strong programming skills in Java, TypeScript, JavaScript, or Python with good understanding of OOP, data structures, algorithms, and design patterns.
• Hands-on experience with automation tools such as Selenium, Playwright, Cypress, TestNG, Cucumber, RestAssured, PyTest, Postman/Newman, or similar frameworks.
• Practical experience in Agile and DevOps environments with Azure DevOps, Docker, Jenkins, Selenium Grid, TDD/BDD, and CI/CD practices.
• Exposure to frontend, backend, REST API, microservices, cloud-native applications, and database validation.
• Experience with Azure services such as App Services, Azure SQL Database, Azure Storage, Azure OpenAI, and Entra ID/OAuth is preferred.
• Knowledge of AI/LLM applications, RAG systems, LangChain, LangGraph, Semantic Kernel, Agentic AI frameworks, AI coding assistants, ML concepts, AI observability, vector databases, and performance tools such as JMeter or BlazeMeter will be a strong advantage.

About MetLife

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.

As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.

Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!

BI-Hybrid