Senior Test Manager & Quality Engineer, Full-Time (f/m/d)

Tasks

• Ensure high-quality delivery and thorough testing of AI use cases
• Define and evolve the technical testing approach and framework architecture for the ML & AI ART, in line with the Bank's Test Strategy and Test Policy
• Design reusable, scalable testing patterns (page objects, API clients, test data builders) that other engineers across squads can adopt, ensuring technical consistency in testing across the ART
• Analyze and evaluate requirements, features, and user stories for testability during PI Planning, Backlog Refinement, and Iteration Planning
• Derive test cases from technical and risk-based analyses of functional and non-functional requirements (reliability, performance, safety, usability, load/stress)
• Automate identified test cases using Python-based frameworks (Playwright/Python for UI, requests automation (Pytest for APIs, Behave or pytest-bdd for BDD/Gherkin))
• Designing and implementing AI/ML-specific test cases: Evaluation pipelines for ML outputs
• Integrate and orchestrate automated tests in GitLab CI/CD pipelines, including the merge request pipeline and GitLab Runner
• Plan, schedule, and trigger automated test runs in various environments (DEV, INT, UAT, pre-PROD)
• Report triage results and defects in Jira with supporting evidence (logs, traces, screenshots, videos), and communicate quality signals to the squad and the product owner

Requirements

• Practical experience in integrating and executing tests for AI solutions and/or big data projects
• Solid understanding of Git and version control workflows, code review culture
• Practical experience with Docker; familiarity with the basics of Kubernetes (pods, namespaces)
• Experience with testing AI/ML systems or a strong motivation to develop this expertise
• Understanding of AI design, microservices, event-driven architectures, and authentication layers
• A collaborative team player with a strong sense of personal responsibility, capable of handling automation challenges—from analysis to execution to resolution—with minimal supervision
• Bachelor's or master's degree in computer science, engineering, or a related field
• At least 5–7 years of experience with data and ML platforms, including their quality assurance and/or testing, with extensive experience in Python
• Experience in a regulated environment (financial services, healthcare, pharmaceuticals) is strongly preferred
• ISTQB Certifications (Foundation as a Prerequisite)
• SAFe (SPC, SSM, or equivalent) or DevOps practices are a plus

We offer