Senior AI Test Automation Engineer

Tasks

As a Senior AI Test Automation Engineer, you will be responsible for the technical test automation solution that supports our AI and ML Ops platform. Your responsibilities will include:

• Definition and further development of our technical test automation approach and test framework architecture for ML and AI-ART
• Design of reusable, scalable test automation patterns (page objects, API clients, test data builders)
• Analysis and evaluation of requirements, features, and user stories in terms of testability
• Derivation of test cases from technical and risk analyses of functional and non-functional requirements
• Automation of test cases using Python-based frameworks (Playwright/Python, requests + pytest, Behave, or pytest-bdd)
• Design and implementation of A/M-specific test cases: Evaluation pipelines for LLM outputs
• Setup and maintenance of integration tests (e.g., Pact) for platform APIs and microservice boundaries
• Integration and orchestration of automated tests in GitLab CI/CD pipelines
• Planning, scheduling, and triggering automated test runs across environments
• Monitoring execution health, analysis, and quarantine of flaky test cases
• Triage of execution results, reporting errors in Jira with supporting evidence, and communicating quality signals

Requirements

The following requirements apply to this position:

• Proven expertise in Python-based test automation: Playwright/Python (UI), Behave or pytest-bdd (BDD), requests + pytest (API)
• Demonstrated ability to design and maintain test automation frameworks, not just write test scripts
• Practical experience with integrating and running automated tests in CI/CD pipelines
• Solid understanding of SATE and DevOps principles; experience in an Agile Release Train is a plus
• Experience with Jira for story/feature tracking and test management integration (Xray, Agile Hive)
• Demonstrated ability to think end-to-end, connecting user journeys, data flows, authentication layers, and system boundaries
• Proficiency in implementing an established testing strategy; collaboration with test managers on execution planning, reporting, and compliance
• Demonstrated knowledge of information security, data protection, and compliant test data handling in regulated environments
• A collaborative team player with a strong sense of personal responsibility, capable of handling automation challenges—from analysis to execution to resolution—with minimal supervision
• A strong communicator who can collaborate effectively with engineers, product owners, Scrum Masters, architects, and test managers
• Strong organizational skills, structured, reliable

We offer

Unfortunately, no information about the offer is available.