Data Scientist

REQUIREMENTS:

Bachelor’s Degree in a technical discipline (Computer Science, Math, statistics etc.)

- 7+ years of hands on Experience in Developing Big Data applications using Spark/Scala and building Predictive models using Spark Machine Learning APIs;

- Experienced in working with Hadoop ecosystem and related technologies (Cloudera, Hive, Impala, spark/Scala/spark ML etc.)

RESPONSIBILITIES:

- Responsible to build various Machine Learning-based tools or processes such as recommendation engines or automated Customer scoring systems using Apache Spark Machine Learning Libraries by mining data from a data lake or other large sources of Customer Data.

- Should be able to work with big data, experiment with various Machine Learning algorithms that will solve the task, create prototypes and productionize those prototypes.

- MUST have hands on experience with Scala and Spark ML APIs to build reliable predictive models.

- MUST have extensive background in data mining and statistical analysis. Required to clarify business requirements for new initiatives and; interfaces with the users, external and internal support teams to identify and help resolve production problems; prepare detailed specifications; and technical guidance to his/her development peers on their efforts.

- Will devise and/or suggest modifications to procedures that would in effect help to solve complex problems considering system applications, computer equipment capacity, operating time and desired results.

- Must report progress on initiatives to Director Master Data Management providing updates to critical requests and fulfillment of business and development needs.

- Provide guidance and direction to less experienced technologists; has direct responsibility for quality of the deliverables of the unit.

- Build predictive models via Apache Spark Machine Learning Libraries by mining data from a data lake or other sources utilizing Spark/ Scala and other interpretive languages such as Python with Hadoop

- Unit test applications

- Document the applications

- Provide 3rd tier support for production systems

- Mentor junior developers

- Responsible for the additional cost savings and opportunities to the company realizes through the predictive analysis of Customer’s data to provide insights to business teams and influence the business strategies and roadmap.

- Design and development Predictive models and Big Data Applications

- Software design and implementation decisions

- Provide recommendations on System/software architecture at all levels

- Direct Functional Guidance:

- Director Master Data Management