Kafka Engineer in Tempe, AZ

Urgent Position with Out Client-

Position- Kafka Engineer

Location - Tempe, AZ

Position Type- Contract

Responsibilities -

Kafka Messaging Troubleshooting

Analyze broker, producer, and consumer logs. Debug consumer lag, broker failures, and message delivery issues. Tune performance (throughput, latency, etc.)

System Monitoring & Metrics

Monitor Kafka using tools like Prometheus, Grafana, Confluent Control Center, etc. Track consumer lag, broker health, and other system-level metrics.

Kafka Architecture & Configuration

Set up and maintain Kafka clusters (brokers, topics, partitions, replication). Design and configure Kafka topics and consumer groups for reliability and performance.

Distributed System Expertise

Handle issues involving fault tolerance, leader elections, and data replication. Optimize systems for high availability and scalability.

Programming & Debugging

Use Java or Scala to write or debug producers/consumers. Possibly support or extend Kafka Streams or Kafka Connect pipelines.

Security and Network Troubleshooting

Configure and troubleshoot SSL, SASL, ACLs, and other Kafka security layers. Investigate network issues between Kafka clients and brokers.

Required Skills

A Kafka Developer or Engineer who:

Has production-level experience with Kafka, especially Confluent Kafka.

Can design and implement streaming data pipelines.

Understands distributed system principles.

Can diagnose and resolve complex issues (e.g., consumer lag, broker downtime, message loss).

Has coding expertise in Java/Scala to work with Kafka clients or stream processing apps.

Knows how to monitor, secure, and scale Kafka infrastructure.