Kafka Platform Engineer

Description:

• Design and implement Confluent Cloud environments across Development, QA, UAT, and Production.

• Configure Kafka clusters, topics, partitions, replication policies, and retention settings.

• Establish environment standards, naming conventions, and deployment procedures.

• Implement multi-region and disaster recovery strategies where required.

• Integrate applications, databases, cloud services, and enterprise systems with Kafka.

• Configure and manage Confluent Cloud connectors.

• Implement event-driven architecture and streaming integration patterns.

• Monitor platform health, throughput, consumer lag, and broker utilization.

• Troubleshoot producer, consumer, and connectivity issues.

• Configure alerts and operational dashboards.

• Support platform upgrades, performance tuning, and capacity planning.

• Automate Kafka infrastructure deployment using Infrastructure as Code (Terraform preferred).

• Integrate Kafka deployments into CI/CD pipelines.

• Collaborate with enterprise architects, integration teams, cloud engineers, and business stakeholders.

• Conduct technical design reviews and architecture discussions.

Kafka & Confluent - Apache Kafka architecture and administration, Kafka Producers and Consumers, Kafka Connect, Schema Registry, Stream Governance, Kafka topic design and partitioning strategies.

Cloud Platforms - Experience with Microsoft Azure Integration Technologies - REST APIs, Event-driven architecture, Microservices integration, Data streaming platforms Security - SASL/SSL, Oauth, RBAC, API Key management DevOps – Terraform, GitHub/GitLab/Azure DevOps, CI/CD pipelines, Infrastructure as Code