Senior Test Automation Engineer

Tasks

• Review and improvement of the current test automation approach and test framework architecture for ML and AI-ART
• Design of reusable, scalable test automation patterns (page objects, APIs, tests, test data builders)
• Analysis and evaluation of requirements, features, and user stories for testability during PI planning, backlog refinement, and iteration planning
• Derivation of test cases from technical and risk analyses of functional and non-functional requirements
• Automation of identified test cases using Python-based frameworks (Playwright/Python, requests + pytest, Behave, or pytest-bdd)
• Design and implementation of A/ML-specific test cases: evaluation pipelines for LLM outputs
• Creation and maintenance of context tests (e.g., Parc) for platform APIs and microservice boundaries
• Integration and orchestration of automated test cases in GitLab CI/CD pipelines
• Planning, scheduling, and triggering automated test runs across environments
• Monitoring execution health, investigating and quarantining flaky test cases, and maintaining a low false-positive rate
• Triage test execution results, report errors in Jira with supporting evidence, and communicate quality signals to the squad, product owners, and test managers

Requirements

• Proven expertise in Python-based test automation: Playwright/Python (UI), Behave or pytest-bdd (BDD), requests + pytest (AP) + service validation
• Proven ability to design and maintain test automation frameworks, not just write test scripts
• Practical experience integrating and running automated tests in CI/CD pipelines, ideally with experience in GitOps
• Experience with test automation execution, parameterization, flaky test management, and modern reporting tools (Allure, pytest-html)
• Solid understanding of ETL and version control workflows, experience with clean code principles and code review practices
• Practical knowledge of Docker, familiarity with Kubernetes fundamentals (pods, namespaces)
• Experience with A/ML systems through testing, development, or applied projects is a strong asset
• Understanding of A/ML design patterns, microservices, event-driven architectures, and authentication layers
• Understanding of SAFe and DevOps tracking principles, experience working in an Agile Release Train

We offer