Data Operations Engineer

Job Description

The DataOps Platform Team's mission is to ensure a reliable service level across all technological components of the EFG data platform (Databricks, Kafka, Spark, Elasticsearch, Apache MQ, and the uServices stack).

Main tasks

As our platform and data landscape continue to evolve, we’d like to strengthen our team with an experienced Ci/CID engineer who specializes in data pipeline implementations. - We’re looking for someone who is comfortable integrating Kafka, Spark, and Databricks operations using Python. - By leveraging our team of experts in specific data services (change management, quality assurance management, SLA, SOR), you will make a significant contribution to the continuity and quality of our operations:

• Daily Monitoring of Service Quality
• Monitoring and ensuring the smooth operation of critical data pipelines during Asian business hours, serving as the primary point of contact for critical issues in a "follow-the-sun" support model
• Design, implementation, and optimization of data pipelines in batch and streaming modes
• Adopting and implementing CICD practices to automate and streamline deployments and integrations
• Development, maintenance, and improvement of documentation and operating procedures for which operational responsibility is ensured
• Collaborate with cross-functional teams to improve and review governance related to integration operations
• Maintaining high standards of data quality, reliability, and performance
• Updates incorporating advancements in data engineering and DataOps technology to support continuous improvement

Requirements and qualifications

- At least 5 years of hands-on experience in data engineering and data pipeline deployments based on DevOps practices - Experience with Python, SQL, PySpark, and Databricks - Solid experience managing CI/CD platforms and processes in hybrid environments (e.g., Azure DevOps, GitLab CI, GitHub Actions) - Familiarity with microservices architecture, API management, and observability is a definite plus - Experience with Azure Databricks - Strong communication and collaboration skills - Rigorous and methodical in documentation and process creation - Strong interest in convergence, standardization, and reusability - Curious, enthusiastic, and proactive - Passionate about modern technologies, with a strong desire to learn and grow in a challenging environment - Fluent in spoken and written English; French is a plus

Our values

- Responsibility: Taking responsibility for tasks and challenges, and striving for continuous improvement - Hands-on: Proactively delivering high-quality results - Passionate: Committed and striving for excellence - Solution-oriented: Focusing on customer outcomes and treating customers fairly while maintaining a risk-aware mindset - Partnership-oriented: Fostering collaboration and teamwork, and working together with an entrepreneurial spirit

We offer

No information available