Data Ops Engineer

Aufgaben

• Cloud operations of data platform: platform deployment and configuration management and processing
• Full data operations in real time
• Participate in the design and implementation of centralised daily ETL pipelines used for batch processing activities required for data analytic requirements.
• Monitor the performance of ETL sessions/operations and identify root causes for performance issues to ensure key business processes are scheduled according to calendar.
• Map the respective operational requirements and create data quality and standardisation processes and KPIs.
• Assist the data team to roll out corporate services and deliver daily and periodic releases, RAs, KPIs.
• Administer and monitor UAT test and application testing for cloud/data platform.
• Work with the Data Science team and the Product Management team together with the business as partners and responsible for daily data operations (ETL jobs, validations, monitoring).
• Develop and maintain data integration infrastructure to support dashboards and visualisation tools.
• Collect and explore cloud/data operation requirements and design/implement data integrations.
• Create, validate, and update documentation, including technical requirements, design, implementation plans.
• Identify and manage issues related to operational activities.
• Monitor data platform operations, including monitoring performance, availability, and issue management.

Anforderungen

• A level 1 of your cloud operations is an excellent team player and possesses strong communication and problem-solving skills.
• Candidates must have experience in Big Data, SQL, Python and Apache Spark, as well as AWS, Azure, etc.
• Self-motivated, flexible, and able to write good documentation relevant to the tasks at hand (code, DBAs, SLAs, SQL, ELK Stack).
• Knowledgeable of data science methods, algorithms, machine learning libraries (MLlib, etc.).
• Experience in Azure DevOps
• Knowledge of distributed systems and scalability
• Experience in relational and non-relational databases in SQL
• High degree of complexity, vulnerability, and sensitivity
• Ability to maintain confidentiality and documentation of assets
• Eager to learn and grow in a challenging environment.
• Passionate about data and learning and tech, with a strong belief that data and products can be business driven and user driven.

Wir bieten

• Accountability: Taking ownership for safe and efficient data engineering, reporting systems
• Flexibility: Being responsive to project changes and meeting deadlines
• Dedication: Demonstrating responsibility and commitment to project deliverables and stakeholder initiatives
• Empowerment: Promoting inclusivity and training others to take responsibility for mission-critical operations