Platform Engineer

Summary:

We are seeking an experienced Platform Engineer who will be part of the Platform team managing the Data Science platform.

Job Responsibilities:

• Support ongoing Data Science Infrastructure operations.

• Develop and deploy AWS environments using CI/CD processes for a rapidly growing team of Data Scientists.

• Manage and support large-scale environments to meet the needs of current and future Data Science teams.

• Champion and mature the environment by implementing and overseeing the image management lifecycle process.

• Assist in setting up and managing AWS accounts specifically for the Data Science platform.

• Provide hands-on development using CI/CD tools such as Azure DevOps.

• Utilize Infrastructure as Code (IaC) tools such as Terraform for environment setup and management.

• Develop scripts and applications using programming languages such as Python.

• Manage database technologies including Athena, Oracle, MySQL, and Postgres.

• Leverage AWS services essential for Data Lake, Data Science, AI/ML teams.

• Handle and resolve requests from development and business users, addressing any roadblocks.

• Manage secured infrastructure, enforce security measures, and apply necessary guard rails.

• Resolve infrastructure vulnerabilities within SLAs and maintain audit logs.

• Perform system upgrades and patching, providing on-call support as needed.

• Conduct root cause analysis and knowledge transfer sessions with the internal team.

• Collaborate with Network, Database, Infrastructure, and Architecture teams to align on projects and strategies.

Basic Qualifications:

• Bachelor’s degree in computer science or a related field.

• 2+ years experience in Data Science Infrastructure.

• 2+ years extensive experience with Data Lake, Data Science, and AI/ML services hosted on AWS infrastructure.

• 2+ years working knowledge of the following technologies:

o Kubernetes

o AWS services such as SageMaker, Glue, Lambda, Athena

o CI/CD tools like Azure DevOps

o IaC tools like Terraform

o Docker and ECR (Elastic Container Registry)

o Security tools like AQUA and Kenna

• 2+ years experience in technical write-ups.

Preferred Qualifications:

• AWS and Terraform certified professionals. Kubernetes or CKA

• Familiarity with technical service management and product life cycle maintenance.

• Knowledge of programming and scripting languages such as Python and shell scripting.

• In-depth knowledge of database technologies like Athena, Oracle, MySQL.

• Extensive experience with CI/CD and IaC tools such as Azure DevOps and Terraform.