Hadoop Architect / Lead Hadoop Developer (Contract)

Job Description

Responsibilities

Act as a technology and project advisor to our customers

Determine database and system architecture requirements

Design, improve, and manage client data architecture

Organize data and create logical data models for use with the technology

Create data quality rules

Engineers and/or optimizes & tunes the data and queries used in analytics projects

Guide client on defining new analytical data and ETL processes

Provide recurring updates internally and client project team of deliverable progress

anage project timelines and deliverable schedules and share concerns about deliverables, timelines, etc.

Required Skills:

Hortonworks Hadoop, Linux, Spark, Python and/or Scala, Hive, HBase

Leading Visualization/BI Tools (Tableau, Qlickview, Power BI) that work with Hadoop based infrastructure

Experience implementing large-scale, enterprise Hadoop solutions

Ability to understand big data use-cases, and recommend standard design patterns commonly used in Hadoop-based deployments

Knowledge of the data management eco-system including: Concepts of data warehousing, ETL, data integration, etc.

Excellent communication skills

Experience working with large datasets with lineage/controls in overall data/process flows

Hands-on Data and Data Processing implementation experience across Relational and Hadoop technologiesWriting high-performance, reliable and maintainable code

Good knowledge of database structures, theories, principles, and practices

Analytical and problem solving skills, applied to Big Data domain

Experience in performance tuning/optimizing of big data processing, preferably in Risk/Compliance space

Credit Risk Data experience would be a plus

Working understanding of data science, predictive analytics