Senior Data Engineer - Data Analytics Platform

Tasks

· Developing processes that ensure data security and quality

Your profile

· Bachelor’s or Master’s degree in Computer Science, Data Analytics, Information Systems, or a related technical field; or equivalent education and professional experience · 5+ years of experience in ETL/ELT, data warehousing, business intelligence, and integrating data processing/workflow management tools into pipeline design · 5+ years of experience building and maintaining end-to-end data systems using Python, Scala, or similar programming languages · Solid experience using SQL for data analysis, investigating data issues, diagnosing root causes, and designing effective solutions · Experience working with cloud-based data technologies, preferably on Microsoft Azure, in continuous integration and delivery (CI/CD) environments · Proven experience working with large data sets using Databricks, PySpark, Spark Streaming, and Delta Lake · Hands-on experience with structured, semi-structured, and unstructured data across various storage systems, including relational databases (RDBMS), data warehouses, in-memory caches, and document databases · Familiarity with cloud-based storage solutions such as Azure Data Lake and Blob Storage · Solid understanding of data modeling principles (experience with Data Vault is a plus) and strong skills in system design, implementation, and testing · Experience with event-driven architectures (e.g., Kafka, Event Hubs, Apache Flink) and containerization

We offer

No information available