Cloud Data Platform Engineer

Position Overview

The Cloud Data Platform Engineer is responsible for designing, implementing, operating, and evolving a scalable, secure, resilient and high-performance Hadoop and Spark data platform in hybrid cloud environments (on-premise, private, multi) for Northern Trust and managed client environments.

Key Responsibilities

• Design, develop, deploy and manage all aspects and components (compute, storage, networking, security and software stack) of the Cloud data platform based on Apache big data technologies.
• Setup, configure, and maintain standardization of infrastructure environments (on-prem, PPE, UAT, DEV).
• Support unit testing and automation, including CI/CD strategies for provisioning and management of the Cloud platform; including documentation, monitoring, profiling and alerting; familiar with I/O patterns, monitoring, reliability, scalability, and uptime.
• Continuously improve, evolve, and re-architect technology for a more effective platform: identify, problem-solve, and improve performance, stability, and scalability.
• Enable governance, security, and compliance standards for use; GDPR, HIPAA (SOC2).
• Define, quantify, implement, and manage platform utilities across multiple, integrated standards, and tools and specifications.
• Own cloud platform on-call lifecycle to ensure high-end reliability for business (24x7) and quick platform fixes.
• Support multi-tenant management, data governance, and integrated-ready data development.
• Design, implement, optimize, and continuously improve robust cloud data platform services and infrastructure supporting production workloads.
• Develop, interface, and maintain Mule API.
• Design, deploy, and manage all aspects and components (compute, storage, networking, security, and compliance) of the Cloud Data Platform based on Apache Spark technologies including implementation and optimization.
• Explore novel infrastructure, templates, and automation standards that accelerate development and production of data platform.
• Lead strategic programs on technology, architectures, APIs, and enterprise technologies.

Requirements

• Solid knowledge of networking and security and threat mitigation.
• Deep understanding of virtualization technologies and cloud platforms (VMWare, Azure, AWS, GCP).
• Familiarity with design for multi-tenancy, service isolation, and security compliance.
• Cloud/infrastructure architecture, performance monitoring and tuning.
• Knowledge of data security and compliance standards.
• Strong problem-solving, communication, and data transfer and configuration skills.
• Experience in writing detailed technical documentation, job aids and standard operating procedures.
• Spark, performance, and stability of the Hadoop data platform.
• Be scalable, fault-tolerant, and automating its management, storage, and operations.
• Efficiency and scalability of data processing, performance monitoring and tuning of distributed data processing environments such as Apache Spark, and related services.
• Cost optimization and best practices in cloud data engineering.
• Ability to write scripts and code in Scala and Python.

Salary Range

$133,586 - $206,000

Based on your 3 years of relevant experience, Northern Trust expects to compensate a successful candidate for this role by initiating a base salary at $133,586 - $206,000 against the total available budget range of $133,586 - $206,000 which reflects internal pay equivalency standards and Northern Trust's policies. Nothing in this job posting is a guarantee of compensation.

Work Authorization

Applicants without a work authorization to work in the United States must have statutory work authorization (on or after the hire date). Because this role onshore application US- to work for Northern Trust. To apply, you must have a work authorization to work in the US without past sponsorship now or in the future.