Role: Big Data Engineer
Location: Jersey City, NJ
FTE
Strong programming skills in PySpark in a BigData environment.
Familiarity with big data processing tools and techniques.
Experience with the Hadoop ecosystem including Hive, HDFS, Sqoop, Spark, Impala, Scala, etc.,
Well versed with shell scripting and Autosys scheduler.
Good understanding of distributed systems.
Should be familiar with data warehouse concepts.
Experience with streaming data platforms.
Excellent analytical and problem-solving skills.
Experience with writing complex SQL queries.
Knowledge on data modeling and data design is essential.
Should be independent and resourceful dealing with risks/issues and resolving them in a timely manner.
Excellent communication and articulation skills.