Discover your dream Career
For Recruiters

Test Consultant-AI SDET

Metlife Tokyo, Japan
Posted 1 hour ago Permanent Competitive

Test Consultant-AI SDET

Metlife Tokyo, Japan
Test Consultant-AI SDET
Description and Requirements

Summary of Position Responsibilities:

An AI Testing Engineer / SDET will be responsible for strengthening software quality across Agile, cloud-native, and AI-enabled delivery teams. The role requires strong programming fundamentals, test automation expertise, and the ability to validate traditional applications as well as emerging Generative AI, RAG, and Agentic AI solutions. The engineer will work closely with software developers, system analysts, and DevOps teams to improve release quality, automate validation, reduce manual effort, and support AI-driven SDLC initiatives.

Key Responsibilities

Quality Engineering and Testing
  • Understand application architecture, APIs, databases, source code, authentication flows, cloud integrations, and business workflows.
  • Design, execute, and maintain test plans, test cases, and validation strategies across unit, functional, integration, system, API, end-to-end, and regression testing.
  • Identify, document, track, and verify defects while ensuring the new functionality does not impact existing features.

Automation and Reliability Engineering
  • Develop and maintain reusable automation frameworks, test suites, validation scripts, and regression capabilities for UI, API, backend, and integration testing.
  • Improve test coverage, release confidence, and engineering productivity by promoting automation-first quality practices.

AI Evaluation & Agentic Validation
  • Creating and implementing AI agents to support end-to-end automation across software engineering processes, including task management, user story authoring, development, testing, and delivery-related activities.
  • Design and execute evaluation strategies for Generative AI, LLM, RAG, and Agentic AI systems, including benchmark datasets and automated evaluation pipelines.
  • Validate AI quality metrics such as accuracy, relevance, groundedness, faithfulness, hallucination detection, response quality, and latency.
  • Test RAG workflows including ingestion, chunking, indexing, retrieval, ranking, response generation, prompt quality, agents, tools, workflows, and orchestration frameworks.

Candidate Qualifications
  • 4 to 8 years of experience in software testing, quality engineering, test automation, reliability engineering, or similar roles.
  • Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
  • Strong programming skills in Java, TypeScript, JavaScript, or Python with good understanding of OOP, data structures, algorithms, and design patterns.
  • Hands-on experience with automation tools such as Selenium, Playwright, Cypress, TestNG, Cucumber, RestAssured , PyTest , Postman/Newman, or similar frameworks.
  • Practical experience in Agile and DevOps environments with Azure DevOps, Docker, Jenkins, Selenium Grid, TDD/BDD, and CI/CD practices.
  • Exposure to frontend, backend, REST API, microservices, cloud-native applications, and database validation.
  • Experience with Azure services such as App Services, Azure SQL Database, Azure Storage, Azure OpenAI, and Entra ID/OAuth is preferred.
  • Knowledge of AI/LLM applications, RAG systems, LangChain , LangGraph , Semantic Kernel, Agentic AI frameworks, AI coding assistants, ML concepts, AI observability, vector databases, and performance tools such as JMeter or BlazeMeter will be a strong advantage.

Preferable:

- Language skills ( Japanese/English bilingual )

- Insurance business knowledge

- Transformation project experience

福利厚生

メットライフ生命では、ワークライフバランスと社員の心身の健康を促進する福利厚生を提供しています。社員はフレックスタイム制度、年次有給休暇、特別連続休暇、リフレッシュ休暇等の休暇を利用できます。また、社会保険や団体保険の他、旅行や英会話教室で使える割引も提供しています。柔軟に働けるよう、オフィス勤務と在宅勤務を組み合わせた勤務形態の導入や、短時間勤務制度、また柔軟性のあるドレスコードなども設けています。

Benefits We Offer

MetLife Japan offers a comprehensive benefits package that promotes work-life balance and employee wellbeing. Employees can take advantage of flex time policy and a generous time-off policy, national holidays, annual paid leave, special consecutive leave, and refreshment leave. We also provide full social insurance coverage, a commuting expense reimbursement, group insurance, and discounts on travel and English language lessons. To support work flexibility, employees also have hybrid work options, shortened working hours for parents with children in third grade or below, and a casual dress code.

メットライフについて

メットライフは、グローバルで展開する金融サービス企業です。個人および法人のお客さまがより確かな未来を築けるよう、保険、年金、社員福利厚生給付、資産管理のサポートを提供しています。1868年に創業したメットライフは、世界40以上の市場で事業を展開し、米国、アジア、中南米、ヨーロッパ、中東において業界をリードしています。

メットライフは、New Frontier戦略の一環として、AIを活用し、人を中心に据えた未来を築いています。私たちは、AIを活用して顧客へのサービス向上、地域社会への支援、そして働き方の変革を推進していく中で、好奇心、適応力、そして成長意欲を持つ人材を求めています。メットライフにおいて、AIは、人間の判断力、創造性、継続的な改善を支える責任あるパートナーであり、信頼、インクルージョン、そして長期的な価値の構築に貢献しています。

メットライフ生命は、日本初の外資系生命保険会社として、1973年2月に国内での営業を開始しました。当社のPurpose「ともに歩んでゆく。よりたしかな未来に向けて。」は、メットライフが誇るグローバルネットワークと世界中のベストプラクティスを活かし、お客さまのニーズに応え、地域社会との信頼関係を築くという信念を表しています。

About MetLife

MetLife Inc., through its subsidiaries and affiliates (MetLife), is one of the world's leading financial services companies, providing insurance, annuities, employee benefits and asset management to help individual and institutional customers build a more confident future. Founded in 1868, MetLife has operations in more than 40 markets globally and holds leading positions in the United States, Asia, Latin America, Europe and the Middle East.

As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.

MetLife Japan began operations in February 1973 as Japan's first foreign-owned life insurance company. Our purpose, "Always with you, building a more confident future," encapsulates our strong commitment to leveraging our global network and best practices worldwide to stand with our customers and build trust with our communities.
Job ID  21550
More jobs From Metlife
Metlife
Lead Developer(Full Stack Software Engineer)
Metlife
Tokyo, Japan
1 day ago Full time Competitive
Metlife
Lead SRE(Site Reliability Engineer)
Metlife
Tokyo, Japan
1 day ago Full time Competitive
Metlife
IT Lead, Policy Servicing ART (PS ART)
Metlife
Tokyo, Japan
6 days ago Full time Competitive
Metlife
Mobile Device Management Engineer
Metlife
Tokyo, Japan
23 days ago Full time Competitive
Metlife
Lead Architect
Metlife
Tokyo, Japan
27 days ago Full time Competitive
Metlife
Sr. Technical Functional Analyst
Metlife
Tokyo, Japan
1 month ago Full time Competitive
Metlife
Business System Analyst
Metlife
Tokyo, Japan
1 month ago Full time Competitive
Metlife
Senior Server Engineer
Metlife
Tokyo, Japan
1 month ago Full time Competitive
Metlife
Test Consultant-AI SDET
Metlife
Tokyo, Japan
1 month ago Full time Competitive
Metlife
Head of Identity & Access Management (IAM) platform/GG13
Metlife
Tokyo, Japan
1 month ago Full time Competitive

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
More Jobs Like This