Sign in

Hadoop developer

Plano, Texas, United States
November 05, 2018



PigHiveMicrosoft SQL ServerHadoopScriptingOracleHBaseTeradataBig DataJavaTroubleshootingDesign ExperienceUnit TestingNoSQLShell ScriptingRESTJiraVersionOne

Job Description:

Develops, enhances, debugs, supports, maintains and tests software applications that support business units or supporting functions. These application program solutions may involve diverse development platforms, software, hardware, technologies and tools. Participates in the design, development and implementation of complex applications, often using new technologies. May provide technical direction and system architecture for individual initiatives. Serves as a fully seasoned/proficient technical resource. Will not have direct reports but may lead projects and direct activities of a team related to special initiatives or operations. May have responsibility for a project and project budget. May collaborate with external programmers to coordinate delivery of software application. Routine accountability is for technical knowledge and capabilities. Works under minimal supervision, with general guidance from more seasoned consultants. Typically requires 5-7 years of experience.

The candidate is expected to work independently to source authorized data from a variety of upstream systems across the enterprise. The candidate should be able to determine if the data received from the upstream systems are of good quality based on the rules and data quality validations defined and in case of any issues with the data quality analyze and come up with a preliminary summary of the root cause / issue. The candidate is expected to liaise with the business analysts, and other technology delivery manager.

Considering the portfolio of products in review, the candidate should have strong domain knowledge of financial services.

Primary Responsibilities:

Have a good understanding of the E2E process of the application/platform

Work with the Business Analysts to understand the enhancements / changes being propagated in a particular release cycle, design and work on the coding & unit testing tasks

Work with the QA team during the SIT phase and support the SIT

Work with Platform Support team during UAT phase

Identify improvement areas within the application and work with the respective component teams to implement the same

Be a good team player

Flexibility in adapting to team requirements

Ensuring adherence to defined process & quality standards, best practices

Ensuring high quality levels in all deliverables

Adhere to team’s governing principles and policies

Participate in mandatory training and cross functions across team

Demonstrate enthusiasm and zeal to acquire domain knowledge

Participate and contribute to Team/Project Reviews

Actively involved in Process improvements and automations.

Required Skills:

3+ years of experience in design and implementation of big data applications using Hadoop (MapReduce, Hive, Pig, Sqoop, Oozie) and NoSQL technologies.

Strong experience in UNIX & Shell Scripting

Experience in analysing text, streams with emerging Hadoop-based big data, NoSQL.

Analysing data with Hive, Pig and HBase

3+ years of experience in job scheduling tools like Autosys

6+ years experience in any one or more of the following databases –Teradata, Oracle, SQL Server

5+ years of experience in Java, REST,

Experience in Trifacta, Zaloni

Knowledge in Global Banking & Markets domain

Ability to troubleshoot issues and perform RCA at a short interval

Ability to think out of box and provide innovative solutions

Ability to work independently and take up E2E ownership of tasks

Strong analytical and problem solving skills

Good verbal and written communication skills

Desired Skills:

2 to 3 years of experience with Agile and Agile Management tools like JIRA, Version One

2+ years experience in Banking or financial services domain..