Sr Data Engineer

Job Description

We are looking for a skilled and experienced Senior Data Engineer to join our team in New York, New York. This role is ideal for someone who thrives on working with complex datasets, building scalable data solutions, and collaborating with cross-functional teams. If you have a passion for leveraging data to drive strategic decisions, we encourage you to apply.

Responsibilities:

• Design, implement, and maintain scalable data architectures to support business intelligence and analytics needs.

• Develop and optimize data pipelines and workflows for efficient data processing and integration.

• Collaborate with stakeholders to understand data requirements and translate them into actionable solutions.

• Leverage cloud platforms, such as AWS, Azure, or Google Cloud, to manage and enhance data infrastructure.

• Utilize Big Data technologies, including Apache Spark and Databricks, to process and analyze large datasets.

• Write efficient scripts and perform data manipulation using Python and other relevant programming languages.

• Ensure data quality and integrity by implementing robust validation and monitoring processes.

• Provide technical guidance and support to team members on best practices in data engineering.

• Stay updated on emerging data technologies and tools to continuously improve systems.

• Partner with API developers to integrate data systems and enable seamless data access.• Proven experience in designing and managing data architectures.

• Expertise in Python for data analysis, scripting, and automation.

• Strong knowledge of cloud platforms, such as AWS, Azure, or Google Cloud, and their data services.

• Familiarity with Big Data frameworks, including Apache Spark and Databricks.

• Proficiency in working with databases and performing complex queries.

• Solid understanding of API development and integration.

• Excellent analytical and problem-solving skills to work with large datasets.

• Strong communication abilities to effectively collaborate with technical and non-technical stakeholders.

Full-time