BigData Engineer

#LI-CGTS #TS-5662

Where we work: Our AWS partnered analytics organization owns the world’s biggest financial data store and runs continuous analytics on global stock data movement. Our mission is to ensure investor protection and market integrity. We are constantly working on how to “hack/break” market systems with the goal of being ahead of potential bad actors in the market.

Our environment

• Leading Innovator in Machine Learning/AI, Big Data, AWS, trading algorithms

• We work on the world’s largest financial store (21 petabytes when complete). There is no other comparable opportunity in the market. We look at 130 billion financial transactions every day. That's more than Twitter, Visa®, PayPal and Facebook combined

• Google, Amazon, Facebook & other tech icons follow the client as a model and recruiting base

• Amazon Web Services- select Partner: We use cloud computing to automate and store massive amounts of data

Location: Rockville 2 days/week

Interview: 3 rounds (They are deciding if the final interview round will be onsite or not?)

Must have's

Minimum 5 years of IT experience with 2-3+ years in big data

Spark, Strong SQL

Programming Languages any of these fine - python/Scala/Java/R

Can build scalable high pipelines

Good communicator + team player

Nice to have:

Finance expertise: will prefer but not necessary

JD: We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability of big data platforms. The ideal candidate will have deep expertise in distributed systems, cloud platforms, and modern big data technologies such as Hadoop, Spark etc