Data Operations Engineer

Job description

The DataOps team is responsible for the seamless integration, deployment, and monitoring of mission-critical data pipelines and workflows. We are looking for a DataOps Engineer to take on operational responsibility for specific data services.

Tasks and responsibilities

The duties and responsibilities include:

• Assuming operational responsibility for specific data services (change management, quality assurance, SLA, SOP)
• Monitoring and ensuring the operational continuity of critical data pipelines during Asian business hours, using a follow-the-sun support model
• Design, implementation, and optimization of data pipelines in batch and streaming modes
• Using CI/CD practices to automate and streamline deployments and integrations
• Development, maintenance, and improvement of documentation and operating procedures as part of operational responsibilities
• Collaborating with cross-functional teams to review governance and improve integrations
• Maintaining high standards for data quality, reliability, and performance
• Stay up to date with advancements in data engineering technology and the DataOps technology stack to support continuous improvement

Requirements and qualifications

The requirements and qualifications include:

• Experience in data engineering and data operations roles
• Practical experience with SQL, Python, PySpark, and Databricks
• Knowledge of microservice architectures, API management, and observability is highly desirable
• Solid understanding of CI/CD platforms and processes (e.g., Azure DevOps, GitLab CI, GitHub Actions)
• Experience with cloud data platforms (Azure preferred)
• Demonstrated ability to create rigorous, clear, and comprehensive documentation and procedures
• Familiarity with database design
• Excellent problem-solving skills and attention to detail
• Effective communication and collaboration skills

We offer

We offer a supportive environment where your contributions are valued and recognized. Our values are rooted in mutual respect, and we strive to be an employer of choice.