Senior Data Engineer

Tasks

The main tasks include:

• Implementation of methods and solutions to improve data quality and reliability
• Collaborate with data scientists and data analysts to develop data models and pipelines for research, reporting, and machine learning
• Taking responsibility for maintaining and improving the data platform
• Development and implementation of data management strategies
• Creation of scalable data pipelines and robust backend services

Requirements

The requirements for this position are:

• 5+ years of experience in data processing and workflow management tools
• 5+ years of experience in ETL/ELT, data warehousing, and/or business intelligence development
• 5+ years of experience in building and maintaining end-to-end data systems and supporting services in Python, Scala, or similar languages
• 5+ years of experience with SQL for data analysis and investigation
• 2+ years of experience with cloud data technologies
• Experience with structured, semi-structured, and unstructured data
• Experience with various data stores, including data warehouses, RDBMSes, in-memory caches, and searchable document databases

Preferred qualifications

Preferred qualifications are:

• Experience with microservices platforms (Kubernetes, Docker, Helm Charts)
• Experience with event-driven streaming systems (Kafka, Event Hub, Event Grid, Apache Flink)
• Knowledge and application of OBT
• Experience with data validation tools and BI tools
• 1+ years of software development with languages such as JavaScript, Java, or C#
• Ability to provide technical leadership to other developers

We offer

We offer a challenging and interesting work environment where you can use your skills and experience to contribute to the success of our company.