Data Engineer

Data Engineer

Elmwood Park, NJ (Hybrid, 3 days on-site per week)

RedStream Technology is recruiting for a Data Engineer to work with our client, a leading mdeical services provider. The Data Engineer needs to be proficient with Matillion, Snowflake, and dbt in a hybrid Azure cloud environment. This role involves designing, implementing, and managing secure and efficient data solutions that support our advanced analytics and data science initiatives.

Responsibilities:

• Design and build scalable and efficient data pipelines using Matillion, Snowflake, and dbt within Azure cloud architecture.

• Manage data workflows and transformations, ensuring data integrity and availability for analytics and business intelligence uses.

• Develop, maintain, and optimize data models in Snowflake, supporting high-performance queries and data analysis.

• Utilize dbt to manage data transformation workflows and ensure data quality and consistency across all platforms.

• Collaborate with data scientists, analysts, and other stakeholders to gather requirements and deliver data solutions that support organizational objectives.

• Implement monitoring, logging, and alert systems to ensure performance and availability of data infrastructure.

• Document all data engineering processes, models, and schemas in a clear and concise manner.

• Maintain data security and compliance according to industry standards and regulatory requirements.

Qualifications:

• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field. Master’s degree preferred.

• Minimum of 3 years’ experience in data engineering, with expertise in Matillion, Snowflake, and dbt.

• Strong proficiency in SQL and experience with Azure cloud services.

• Solid understanding of data modeling, ETL processes, and data warehousing concepts.

• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.

• Problem-solving skills and ability to work under tight deadlines.

• Excellent interpersonal and communication skills.

Additional Skills:

• Experience in the healthcare or biotechnology sector is highly advantageous.

• Familiarity with other ETL tools, BI technologies, and data integration strategies is desirable.