Data Engineer

a Strong Big data engineer with good coding and concepts in big data technologies (Hadoop, Spark, Hive etc)

Must have's

Python, Scala/Spark or maybe Java (Scala/Python preferred)

Spark

AWS - EMR a must. (EMR as it’s based on Hadoop platform also Ok) ßask your candidate ‘how do you spin up emr?’

SQL

Good Big Data experience and conceptual understanding

JD

• Extensive Experience with cloud based Big Data technologies like Hadoop, Hive, Spark, AWS EMR and Airflow.

• Experience in one or more programming languages like Java, Scala, and Python.

• Experience in solving complex problems using SQL.

• Experience with developing enterprise grade solutions in an iterative or Agile environment.

• Clear, effective communication with strong interpersonal skills.

• Ability to push the frontier of technology and independently pursue better alternatives.

• Ability to maintain focus and develop proficiency in new skills rapidly.

• Ability to utilize problem solving skills in a fast-paced environment

• Experience in AWS Cloud is required.