Senior Data Engineer

Job Description

We are looking for an experienced Senior Data Engineer to join our team in Oxford, Massachusetts. In this role, you will design and maintain data platforms, leveraging cutting-edge technologies to optimize processes and drive analytical insights. This position requires a strong background in Python development, cloud technologies, and big data tools. This role is hybrid, onsite 3 days a week. Candidates must have GC or be USC.

Responsibilities:

• Develop, implement, and maintain scalable data platforms to support business needs.

• Utilize Python and PySpark to design and optimize data workflows.

• Collaborate with cross-functional teams to integrate data solutions with existing systems.

• Leverage Snowflake and other cloud technologies to manage and store large datasets.

• Implement and refine algorithms for data processing and analytics.

• Work with Apache Spark and Hadoop to build robust data pipelines.

• Create APIs to enhance data accessibility and integration.

• Monitor and troubleshoot data platforms to ensure optimal performance.

• Stay updated on emerging trends in big data and cloud technologies to continuously improve solutions.

• Participate in technical discussions and provide expertise during team reviews.

• Minimum of 7 years of experience in data engineering or related fields.

• Proficiency in Python and PySpark for data development.

• Hands-on experience with Snowflake and other cloud-based platforms.

• Strong knowledge of big data tools such as Apache Spark, Hadoop, and Kafka.

• Strong experience with AWS technologies and services.

• Ability to design and implement APIs for data integration.

• Expertise in algorithm development and data visualization techniques.

• Excellent problem-solving and analytical skills, with attention to detail.

Full-time

Hybrid remote