Skip to main content

This job has expired

You will need to login before you can apply for a job.

Senior Big Data Engineer

Employer
BNY Mellon
Location
Pittsburgh, USA
Salary
Competitive
Closing date
Aug 25, 2022

View more

Job Function
Other
Industry Sector
Finance - General
Employment Type
Full Time
Education
Bachelors
Overview

Our Team

Technology Services Group (TSG) powers BNY Mellon by providing scale, capacity, and capability to deliver the critical technology required to operate the global financial services markets.

TSG is defined by three core values:
  • Creative innovators, delivering excellence and simplicity
  • Always doing the right thing for the bank, colleagues, and clients
  • Fostering a collaborative, diverse and inclusive environment, where we challenge each other to execute as one TSG team.


As part of TSG, our Architecture & Engineering team is
  • Define enterprise technology architecture and engineering principles and best practices
  • Develop next-generation engineering solutions focused on Resiliency and Innovation
  • Engineer and integrate the critical systems and platforms used across the band and with external Clients

The Role

We're looking for a Senior Big Data Engineer with proven Cloudera Hadoop product expertise and engineering skillset. TSG Database Engineering is building the next generation of big data platforms such as Cloudera CDP, MongoDB Ops Manager and PostgreSQL v13. Building on top of our DBaaS automation to efficiently deploy big data services, we are aggressively strengthening our database services and safeguard our data layer resiliencies.

Responsibilities:
  • Work as a senior system engineer for the Hadoop enterprise data platform platforms
  • As an Engineer you will design and create highly complex big data/Hadoop platforms. You will have expert knowledge in distributed datalake systems.
  • You'll configure and tune service components to optimize platform performance. You will design and implement backup and restore strategies and disaster recovery solutions. You will support and troubleshoot performance related issues.
  • You'll consult with storage and host engineering services to create optimized big data ecosystems.
  • Assist in cross-team collaboration and design discussions
  • Provide sandbox functionality to users of the datasets to assist application analytics
  • Provide storage infrastructure system management including capacity planning, performance monitoring and tuning, security management etc.
  • Responsible for infrastructure Support and projects including system design, planning, installations, configurations, upgrades and planning.
  • Manage Tier-3 support following ITIL practice and incident management
  • Manage system configurations and solutions, and monitor the full lifecycles of storage area network (SAN) administration, architecture, and support.
  • Data storage tasks such as management, provisioning, troubleshooting and debugging
  • Lead technical assessments of hardware, software, tools, applications, firmware, and operating systems to support business operations.
  • You'll develop trusted corporations with application tenants. You'll advise applications with sounds data layer resiliencies.
  • You'll provide input into the selection of tools and any necessary migration into the company's environment.

Qualifications
  • Bachelor's degree in computer science or a related discipline, or equivalent work experience required.
  • 5-10 years of experience in Hadoop technologies, data lake design, experience in the securities or financial services industry is a plus.
  • Excellent knowledge with Hadoop components for big data platforms related to data ingestion, storage, transformations and analytics
  • Excellent DevOps skillsets and SDLC practices
  • Excellent knowledge of automation tools such as Ansible
  • Must have Python programming skills
  • Excellent knowledge of Docker containers
  • Collaborate with other developers and architects to enhance the capabilities of the platforms
  • Assist in cross-team collaboration and design discussions
  • Provide sandbox functionality to users of the datasets to assist application analytics
  • Knowledges of Kerberos, REST APIs are a plus

Preferred Skills:
  • 8+ years of experience on BigData Platform on Hadoop, Spark, Hive, HBase
  • 3+ years' experience on Python and DevOps tools such as Ansible
  • Strong Agile/Scrum development experience
  • Strong collaboration and communication skills within distributed project teams
  • Excellent written and verbal communication skills
  • Passion to stay on top of the latest happenings in the tech world and an attitude to discuss and bring those into play.
  • Working knowledge with PostgreSQL or Mongo DB databases a plus . BNY Mellon is an Equal Employment Opportunity/Affirmative Action Employer. Minorities/Females/Individuals with Disabilities/Protected Veterans. Our ambition is to build the best global team - one that is representative and inclusive of the diverse talent, clients and communities we work with and serve - and to empower our team to do their best work. We support wellbeing and a balanced life, and offer a range of family-friendly, inclusive employment policies and employee forums.


This person is a subject matter expert in several of the tools/technologies used in the space.Leads the development infrastructure engineering growth strategies and initiatives. Leads initiatives to analyze complex infrastructure problems to be solved with advanced design.Leads the evaluation of the effectiveness of the organization's existing infrastructure technology and tools. Analyzes trends to develop strategy for the implementation of upgrades that will enhance the reliability, Resiliency and efficiency of the IT infrastructure.Provides leadership to execute project plans and performance requirements for all stages/phases through the management of human capital resources.This person is a subject matter expert in at least one of the tools/techologies used in the space.Participates in or leads initiatives to analyze infrastructure problems to be solved with advanced design. Utilizes standard procedures and policies when selecting methods, techniques, and evaluation criteria for obtaining results.Participates in or leads initiatives to analyze infrastructure problems to be solved with advanced design. Utilizes standard procedures and policies when selecting methods, techniques, and evaluation criteria for obtaining results.Manages the processes for ensuring that all systems/applications/software/hardware are compliant with Corporate policy/procedures.Monitors project plans and budgets.Works closely with external vendors, internal partners and busienss teams to provide infrastructure/tool needs.Works with Application Development and Quality Assurance, Testing and Business teams to understand infrastructure needs during the development, testing and production BAU processes. Ensures these needs are taken into account when developing infrastructure.Acts as escalation point for major incidents.Leads strategy to increase automation across the organization.Contributes to the achievement of multiple teams' objectivesBachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred10-12 years of related experience required; experience in the securities or financial services industry is a plus. BNY Mellon is an Equal Employment Opportunity/Affirmative Action Employer. Minorities/Females/Individuals with Disabilities/Protected Veterans. Our ambition is to build the best global team - one that is representative and inclusive of the diverse talent, clients and communities we work with and serve - and to empower our team to do their best work. We support wellbeing and a balanced life, and offer a range of family-friendly, inclusive employment policies and employee forums.

Employer Description:

For over 230 years, the people of BNY Mellon have been at the forefront of finance, expanding the financial markets while supporting investors throughout the investment lifecycle. BNY Mellon can act as a single point of contact for clients looking to create, trade, hold, manage, service, distribute or restructure investments and safeguards nearly one-fifth of the world's financial assets. BNY Mellon remains one of the safest, most trusted and admired companies. Every day our employees make their mark by helping clients better manage and service their financial assets around the world. Whether providing financial services for institutions, corporations or individual investors, clients count on the people of BNY Mellon across time zones and in 35 countries and more than 100 markets. It's the collective ambition, innovative thinking and exceptionally focused client service paired with a commitment to doing what is right that continues to set us apart. Make your mark: bnymellon.com/careers.

EEO Statement:

BNY Mellon is an Equal Employment Opportunity/Affirmative Action Employer. Minorities/Females/Individuals With Disabilities/Protected Veterans. Our ambition is to build the best global team - one that is representative and inclusive of the diverse talent, clients and communities we work with and serve - and to empower our team to do their best work. We support wellbeing and a balanced life, and offer a range of family-friendly, inclusive employment policies and employee forums.

Sign in to create job alerts

Sign in or create an account to start creating job alerts and receive personalised job recommendations straight to your inbox.

Create alert