DataOps Engineer

Job Description

The DataOps Engineer is responsible for the seamless integration, deployment, and monitoring of mission-critical data pipelines and workflows.

Tasks and responsibilities

• Assuming operational responsibility for specific data services (change management, quality assurance, SLA, SOP)
• Ensuring the operational continuity of critical data pipelines within the group during Asian business hours, using a follow-the-sun support model
• Design, implementation, and optimization of data pipelines in batch and streaming modes
• Using CI/CD practices to automate and optimize deployments and integrations
• Development, maintenance, and improvement of documentation and operating procedures as part of operational responsibilities
• Collaborating with cross-functional teams to review governance and improve integration processes
• Maintaining high standards of data quality, reliability, and performance
• Stay up to date with advancements in data engineering and DataOps technology to support continuous improvement

Requirements and qualifications

• Experience in data engineering and data operations roles
• Demonstrable practical experience with SQL, Python, PySpark, and Databricks
• Knowledge of microservices architecture, API management, and observability is highly desirable
• Solid understanding of CI/CD platforms and processes (e.g., Azure DevOps, GitLab CI, GitHub Actions)
• Experience with cloud data platforms (Azure preferred)
• Demonstrated ability to create rigorous, clear, and comprehensive documentation and procedures
• Familiarity with database design
• Excellent problem-solving skills and attention to detail
• Effective communication and collaboration skills

We offer

A supportive environment where your contributions are valued and recognized. A dynamic work environment based on mutual respect. An opportunity to be part of a team committed to diversity and inclusion.