Platform Architect

About Tredence:

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South-East Asia.

Primary Roles and Responsibilities:

Cloud Architecture:

12+ years of experience in IT infrastructure, with at least 3-4 years in cloud architecture and hands-on provisioning of modern Data platforms like Databricks on AWS cloud.

Hands-on Databricks platform build and administration experience, understanding Databricks Data & AI platform and Delta Lake architecture.

Expertise in provisioning infrastructure on the AWS cloud, manually and through automation (Terraform/CloudFormation).

Network and Infrastructure Design:

Design the overall VPC environment (subnets, security groups, instances, availability zones, etc.).

Design the AWS network architecture, including VPN connectivity between regions and subnets.

Develop Infrastructure as Code to automate Databricks environment deployments.

High Availability and Troubleshooting:

Design Databricks HA and DR strategies.

Troubleshoot Databricks performance, connectivity, and security issues.

Collaboration and Compliance:

Collaborate with development teams to meet product requirements.

Establish and document operational and security standards.

Set up data storage, archival policies, and encryption.

Technical Skills:

Strong understanding of key infrastructure components (Compute, Networking, Storage).

Experience in designing and implementing application/database migration and disaster recovery strategies.

Familiarity with AWS well-architected framework and best practices.

Databricks and Security:

Proficiency in Databricks platform on AWS.

Enhance existing security frameworks and design new frameworks in cloud infrastructure as per standards, governance, and control practices.

Set up authentication and authorization protocols for cloud-based applications.

Data Engineering and Compliance:

Practical data engineering knowledge, moving data between different sources and Databricks.

Experience with compliance audits, reporting metrics, and managing security incidents.

DevOps and Automation:

Knowledge of Jenkins/CircleCI/GitHub Actions or any CI/CD tool.

Automate Databricks deployments using Infrastructure as Code.

Responsibilities and Qualifications:

Must have 12+ years in IT and 3-4 years of cloud architecture experience.

Hands-on Databricks platform experience, administering and understanding its architecture.

Must have expertise in deploying AWS services & Databricks features using Infrastructure as Code.

Experience with data security and access controls.

Experience in Agile development methodologies.