Data Engineer

Data Engineer

Location: Chennai - Work from Office

Roles and Responsibilities:

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have 5 to 8 years of experience in data engineering and a strong background in building data pipelines, data warehousing, and data management solutions. In this role, you will work closely with data scientists, analysts, and other stakeholders to design, build, and maintain scalable and robust data

infrastructure.

• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, Glue.

• Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments.

• Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS.

• Excellent in Advanced SQL end to end development and Optimization of existing processes

• Ability to understand complex python queries and update existing code according to business requirement.

• Table Partition mechanism, Types of Partitions, column store index

• Maintenance and optimization of existing processes

• Requirement gathering and feasibility analysis, design, develop from scratch and deliver

• Experience in designing data warehouse/data mart.

• Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements

• Experience in deploying data pipelines using automated CI/CD approach.

Experience in writing production ready code in Python and test, participate in code reviews to maintain and improve code quality, stability, and supportability.

• Ability to write modularized reusable code components.

• Proficient in identifying data issues and anomalies during analysis.

• Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements

EXPERTISE AND QUALIFICATIONS

Experience: 5 to 8 years of relevant experience in Data Engineering

Must have Skills:

• Python

• Data Migration

• Data Warehousing

• AWS

• SQL

Full time