Associate - Data Engineering

Tasks

• Design and development of automation solutions for data pipeline orchestration using Python and backend API development
• Development of software products and tools for implementing data pipelines and workflows, as well as designing data APIs
• Develop and improve API-driven platform features that support a scalable software architecture and meet the requirements of the data platform
• Design and development of internal platform services and APIs that support metadata, lineage, governance, ingestion, and operational control
• Maintenance of scalable platform services and APIs that support metadata, lineage, governance, ingestion, and operational control
• Development of backend components and service interfaces that enable the platform's growth through a new module
• Improving data platforms across the entire technology stack of shared platform components used in enterprise data workflows

Requirements

• Conversations, Code Quality, and the Development of Best Practices
• Support for the integration of AI-powered features and external AI services into platforms
• Productivity: Required Qualifications: Bachelor's degree in computer science, software engineering, or a related field; 3–5 years of experience with programming languages such as Python; experience in a front-end role; experience with Java; experience with cloud containers and enterprise-grade container orchestration platforms
• Experience designing scalable, maintainable solutions in Python/Go; strong hands-on programming experience; experience in API-driven platform engineering roles
• A deep understanding of requirements and the ability to translate them into solutions
• Experience designing data platforms using APIs; experience with Python and other first-party APIs; experience designing APIs that intersect with multiple applications and business context functions
• Experience building scalable, maintainable solutions using containers and enterprise-grade container orchestration platforms; experience with deployment environments; experience with at least one major cloud provider (AWS/Azure/GCP)
• Understanding of object-oriented design, software engineering best practices, and production-ready development practices
• Strong communication and collaboration skills, with the ability to work effectively with functional and non-technical stakeholders
• Ability to work effectively in a fast-paced environment with multiple priorities and tight deadlines
• Qualifications: Experience with distributed acyclic graph-based workflow management systems; workflows that use container technologies; experience with Spark and NoSQL technologies; experience with data APIs and data pipelines; experience with data APIs and data engineering best practices

We offer

• A Competitive Pension Plan Model
• Participation in Training and Continuing Education
• Flexible working arrangements
• And much more