Sign in

Senior Hadoop Architect - Multiple Locations (Toronto, NJ, NY)

Company:
Spectra Group
Location:
New York, New York, United States
Posted:
July 13, 2018
Description:

Client wants Big Data/Hadoop Architect in Financial services- Risk/AML

Hadoop Architect

Primary location is Toronto

Can also consider those in NY/NJ - will work at Spectra office in Princeton

Job Description

Responsibilities

Act as a technology and project advisor to our customers

Determine database and system architecture requirements

Design, improve, and manage client data architecture

Organize data and create logical data models for use with the technology

Create data quality rules

Engineers and/or optimizes & tunes the data and queries used in analytics projects

Guide client on defining new analytical data and ETL processes

Provide recurring updates internally and client project team of deliverable progress

Manage project timelines and deliverable schedules and share concerns about deliverables, timelines, etc.

Required Skills:

Deliver on-site technical engagements with clients

Advise clients on data architecture, system architecture, data strategy, and best practices

Ability to interpret business problem needs into an executable design given the data available, processes, timing, prioritized needs, and capabilities within the tools used

Design and architect multi-node Hadoop and other large-scale enterprise environments

Strong knowledge and experience with MapReduce, SSH, HDFS, Hive, Spark, security, and Hadoop benchmarking

Test deliverable performance identifying opportunities for improvement prior to deployment

Provide coaching and feedback to junior team members on how to improve designs for

Leverage others (people, group, services) to achieve maximum project results.

Project Tasks:

Participate in and facilitate project meetings and discussions

Design and build databases, ETL processes, etc.

Install, configure, and tune Hadoop environments

Create complex queries and processes using client data

Communicate risks and issues as early as possible

Ensure alignment on project goals and deliverables.

Designing and executing a test plan for a database, query, ETL process or other deliverables

Creating documentation on project deliverables

Facilitating knowledge transfer sessions for project deliverables

Work with Program Managers, Team Leads and Solution Architects to resolve escalations.

Follow CoEnterprise Delivery Framework for approach, work products and deliverables