Job offer
DataOps Engineer
EFG International is seeking a DataOps Engineer in Singapore who will be responsible for the integration, deployment, and monitoring of critical data pipelines as part of a follow-the-sun support model. The ideal candidate has experience with Python, SQL, CI/CD processes, and cloud platforms, particularly Azure.
Tasks
- Assuming operational responsibility for specific data streams; change management, quality assurance, risk management, and escalation management; developing communication plans.
- Monitoring and ensuring the continuity of critical data operations across the entire Group using the “Follow-the-Sun” support model.
- Design, implementation, and optimization of data pipelines in batch and streaming modes.
- Use of CI/CD practices to automate and optimize deployments and integrations.
- Development, maintenance, and improvement of documentation and operating procedures as part of operational maturity.
- Collaborate with cross-functional teams to review governance and improve the integration of data systems.
- Maintaining high standards for data quality, reliability, and performance.
- Up-to-date knowledge of advancements in the areas of data engineering, DataOps, and the tech stack to support the platform.
Requirements and qualifications
- Experience in data engineering and data operations.
- Software engineering experience with microservices, messaging/real-time systems, Kafka, API integration, and data processing.
- Proven experience in building large data pipelines on cloud platforms using Python and SQL.
- A solid understanding of CI/CD platforms and processes (e.g., Azure DevOps, Jira, Azure Pipelines, GitHub Actions, and Confluence).
- Experience with data platforms (Azure preferred).
- Proven ability to produce rigorous, clear, and comprehensive documentation, as well as strict adherence to best practices.
- Familiarity with database design.
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration skills.
- Fluency in spoken and written English.
Personal characteristics
- Responsible and reliable, especially during critical periods of operation.
- Thorough and methodical in monitoring and data quality assurance.
- Motivated and goal-oriented.
- Curious, enthusiastic, creative, and proactive.
- A passion for analytics and technology, coupled with a strong desire to continuously learn and grow.
Job details