Cloud Data Engineer (AWS) - Hybrid

Title: Cloud Data Engineer (AWS) - Onsite Mandatory skills: AWS, Databricks, dynamoDB, Lambda, Redshift, elastic search, API, Streaming technology, Kinesis, Glue, AI tools, ML tools, Python, PySpark, Apache Spark, Kafka, Spark, Data Integration, Streaming, Batch, Error and Replay, GitHub, Jenkins, Terraform, Teradata, RDBMS, ETL, AWS glue, Databricks, Software development, Gitlab, Teradata Vantage, agile, scripting, data analysis, data pipelines, data ingestion, data transformation, data lake, AWS, S3, Lamda, SNS, SQS, RDS, performance issues, data skew issues, source code control systems, technical solution, object oriented design, NoSQL, SQL, relational database, non-relational databases, query optimization, data modelling, technical architecture, modular, cloud centric, API, streaming driven architecture, data steams, Cloud, CI, CD, continuous validation, automation tools Description: We are looking for a cloud data engineer with AWS expertise and data knowledge.

We need hands on data engineer who can deliver the work as required and collaborate with the team Skillset: AWS - s3, lamda, SNS, SQS, RDS and other services RDBMS - Teradata or any DB Good SQL knowledge Python and scripting API exposure Behaviors: Drive automation pyramid and integrate with CI/CD tools for continuous validation.

Understands when to automate and when not to.

Drive mentality of building well architected applications for Cloud Drive the mentality of quality being owned by the entire team.

Can identify code defects and work with other developers to address quality issues in product code.

Passion for finding bottlenecks and thresholds in existing code through the use of automation tools.

Passion for continuing education and improving code quality.

Responsibilities: Develop technical architecture to achieve more modular, cloud centric, API and streaming driven architecture for agile delivery.

Migrating On-Premise solution to cloud including Teradata Vantage Develop data pipelines to integrate with enterprise data steams – Cloud and on-perm Collaborate on architecture decisions and develop solutions in AWS – Including Python, Databricks, Redshift, elastic search, DynamoDB, Lambda, Kinesis, Glue and AI/ML tools.

Requirements and Skill sets needed: Bachelor’s degree required Experience with AWS capabilities – Databricks, DynamoDB, Lambda, Redshift, elastic search.

Experience with API and Streaming technologies.

Software development experience with Python, PySpark, Apache Spark and Kafka Strong knowledge of Data Integration (e.g.

Streaming, Batch, Error and Replay) and data analysis techniques.

Experience with GitHub, Jenkins, and Terraform.

Experience with Teradata (Vantage) or any RDBMS system/ ETL Tools Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.

Excellent in trouble shooting the performance and data skew issues.

Deep knowledge in partitioning, bucketing concepts of data ingestion.

Working knowledge on the implementation of data lake ETL using AWS glue, Databricks etc.

Proficiency in SQL, relational and non-relational databases, query optimization and data modelling.

Experience with source code control systems like Gitlab.

Experience with large scale distributed relational and NoSQL database systems.

Expertise in designing technical solutions using object-oriented design concepts Notes: onsite/hybrid 3 days onsite a week VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment.

The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran.

Please contact us at for any complaints, comments and suggestions.

Contact Details : Account co-ordinator: Nivas Palanisamy, Phone No:, Email: VIVA USA INC.

3601 Algonquin Road, Suite 425 Rolling Meadows, IL 60008