Data Engineer: IV (Lead)

Job Description

We are looking for an experienced Data Engineer to take on a leadership role in designing, deploying, and managing scalable AI platforms and cloud-based infrastructure. This is a contract position based in Eagan, Minnesota, with the potential for future conversion to a permanent role. The position requires a hybrid work schedule, with two in-office days per week (Tuesdays and Wednesdays).

Responsibilities:

• Lead the engineering and operations of AI platforms, including tools such as Dataiku, OpenAI, and Amazon Bedrock, ensuring optimal performance and scalability.

• Automate deployments, upgrades, and scaling processes for AI services to meet evolving business needs.

• Govern and secure enterprise use of cloud-based APIs, including managing key provisioning, access controls, and compliance with security standards.

• Design and maintain cloud infrastructure for AI and data platforms, utilizing tools like Terraform and CloudFormation for infrastructure-as-code.

• Collaborate with cross-functional teams to align architectural designs and ensure integrated operations across data platforms.

• Monitor and optimize platform performance, availability, and cost efficiency across hosted services.

• Implement secure configurations, audit logging, and encryption standards to meet regulatory and compliance requirements.

• Partner with Data Science, Analytics, and DevOps teams to enable advanced AI use cases and drive innovation.

• Provide support for platform incidents, performance tuning, and user onboarding processes.

• Evaluate and integrate emerging technologies to enhance platform resiliency and AI capabilities.• At least 5 years of experience in data or platform engineering roles, with a strong focus on AI platform operations and cloud infrastructure.

• Proven expertise in Python, Terraform, and other programming languages/frameworks for platform development and automation.

• Hands-on experience designing and managing containerized environments for AI workloads, ensuring performance and security.

• Proficiency in cloud technologies and infrastructure-as-code tools such as Terraform and CloudFormation.

• Strong communication skills with the ability to collaborate effectively across IT and business teams.

• Familiarity with monitoring tools and techniques for optimizing system performance and availability.

• Solid understanding of security and compliance standards for AI and data platforms.

• Demonstrated ability to evaluate and adopt emerging technologies to support enterprise AI initiatives.

Hybrid remote