Cloud Data Platform Engineer

Position Overview

The Cloud Data Platform Engineer is responsible for designing, implementing, operating, and evolving a scalable, secure, resilient, and high-performance Hadoop and Spark data platform in hybrid cloud environments (on-premises, private, and multi-cloud) for Northern Trust and managed client environments.

Key Responsibilities

• Design, develop, deploy, and manage all aspects and components (compute, storage, networking, security, and software stack) of the cloud data platform based on Apache big data technologies.
• Set up, configure, and maintain standardization of infrastructure environments (on-premises, PPE, UAT, DEV).
• Support unit testing and automation, including CI/CD strategies for provisioning and managing the cloud platform; including documentation, monitoring, profiling, and alerting; familiar with I/O patterns, monitoring, reliability, scalability, and uptime.
• Continuously improve, evolve, and rearchitect technology to create a more effective platform: identify issues, solve problems, and improve performance, stability, and scalability.
• Enable governance, security, and compliance standards for use: GDPR, HIPAA (SOC2).
• Define, quantify, implement, and manage platform utilities across multiple, integrated standards, tools, and specifications.
• Our own cloud platform operates on an on-call basis to ensure high-end reliability for business (24/7) and quick platform fixes.
• Supports multi-tenant management, data governance, and data development ready for integration.
• Design, implement, optimize, and continuously improve robust cloud data platform services and infrastructure that support production workloads.
• Develop, integrate, and maintain the Mule API.
• Design, deploy, and manage all aspects and components (compute, storage, networking, security, and compliance) of the Cloud Data Platform based on Apache Spark technologies, including implementation and optimization.
• Explore new infrastructure, templates, and automation standards that accelerate the development and deployment of data platforms.
• Lead strategic programs related to technology, architectures, APIs, and enterprise technologies.

Requirements

• Solid knowledge of networking, security, and threat mitigation.
• In-depth understanding of virtualization technologies and cloud platforms (VMware, Azure, AWS, GCP).
• Familiarity with design principles for multi-tenancy, service isolation, and security compliance.
• Cloud/infrastructure architecture, performance monitoring, and tuning.
• Knowledge of data security and compliance standards.
• Strong problem-solving, communication, and data transfer and configuration skills.
• Experience in writing detailed technical documentation, job aids, and standard operating procedures.
• Speed, performance, and stability of the Hadoop data platform.
• Be scalable, fault-tolerant, and automate its management, storage, and operations.
• Efficiency and scalability of data processing, performance monitoring, and tuning of distributed data processing environments such as Apache Spark, and related services.
• Cost optimization and best practices in cloud data engineering.
• Ability to write scripts and code in Scala and Python.

Salary Range

$133,586 - $206,000

Based on your 3 years of relevant experience, Northern Trust expects to compensate a successful candidate for this role with a starting base salary of $133,586–$206,000 within the total available budget range of $133,586–$206,000, which reflects internal pay equivalency standards and Northern Trust’s policies. Nothing in this job posting constitutes a guarantee of compensation.

Work Authorization

Applicants who do not have authorization to work in the United States must have statutory authorization to work (on or after the hire date). This is because this onshore position in the U.S. is with Northern Trust. To apply, you must have authorization to work in the U.S. without having been sponsored in the past or requiring sponsorship in the future.