Senior Data Engineer

Tasks

The Senior Data Engineer position involves implementing methods and solutions to enhance data reliability and quality. This includes collaborating with data scientists and data analysts to develop data models and pipelines for research, reporting, and machine learning.

Requirements

The requirements for this position are:

• 5+ years of experience in data processing and workflow management tools
• 5+ years of experience in ETL/ELT, data warehousing, and/or business intelligence development
• 5+ years of experience in building and maintaining end-to-end data systems and supporting services in Python, Scala, or similar languages
• 5+ years of experience with SQL for data analysis and investigation
• 3+ years of experience with cloud data technologies
• Experience with structured, semi-structured, and unstructured data
• Experience with various databases, including data warehouses, RDBMSes, in-memory caches, and searchable document databases
• Strong design, implementation, and testing skills
• Experience with continuous integration and automated deployment

Preferred qualifications

Preferred qualifications are:

• Experience with microservices platforms (Kubernetes, Docker, Helm Charts)
• Experience with event-driven streaming systems (Kafka, Event Hub, Event Grid, Apache Flink)
• Knowledge and application of OBT
• Experience with data vaults and similar technologies
• Experience with BI tools
• 1+ years of software development with languages such as JavaScript, Java, or C#
• Ability to provide technical leadership to other developers

We offer

The position offers the opportunity to work in a global team and contribute to the development and success of the company. The position is advertised as a 12-month contract with an external agency provider.