Senior Data Engineer - Data Analytics Platform

Tasks

· Developing processes that ensure data security and quality

Your profile

• A bachelor's or master's degree in computer science, data analytics, information systems, or a related technical field, or equivalent education and professional experience
• 5+ years of experience in ETL/ELT, data warehousing, business intelligence, and integrating data processing and workflow management tools into pipeline design
• 5+ years of experience in developing and maintaining end-to-end data systems using Python, Scala, or similar programming languages
• Solid experience using SQL for data analysis, investigating data issues, diagnosing root causes, and developing effective solutions
• Experience working with cloud-based data technologies, preferably on Microsoft Azure, in continuous integration and delivery (CI/CD) environments
• Proven experience working with large datasets using Databricks, PySpark, Spark Streaming, and Delta Lake
• Practical experience with structured, semi-structured, and unstructured data in various storage systems, including relational databases (RDBMS), data warehouses, in-memory caches, and document databases
• Familiarity with cloud storage solutions such as Azure Data Lake and Blob Storage
• Solid understanding of data modeling principles (experience with Data Vault is a plus) and strong skills in system design, implementation, and testing
• Experience with event-driven architectures (e.g., Kafka, Event Hubs, Apache Flink) and containerized environments