Kafka Architect

Title: Kafka Architect

Experience: 8+ Yrs.

Location: SIDGS Technology Center, Hyderabad

Work Mode: 5 Days (WFO)

Type: Permanent Full-time

About SIDGS:

SIDGS is a premium global systems integrator and global implementation partner of Google corporation, providing Digital Solutions & Services to Fortune 500 companies. Our Digital solutions go across following domains: User Experience, CMS, API Management, Microservices, DevOps, Cloud, Service Mesh, Artificial Intelligence, RPA domains.

We create innovative solutions in Digital, API Management, Cloud and DevOps space in partnership with Google. We understand that every business has a unique set of challenges and opportunities, and we leverage our unique industry insights, honed through decades of combined experience in the technology sector, to deliver the products, solutions and services necessary to achieve best customer satisfaction and delivering positive impact to the communities.

Job Title: Kafka Architect

Job Summary: As a Kafka Architect with expertise in Spring Boot and microservices, you will play a critical role in designing and implementing Kafka-based solutions to support our organization's distributed systems architecture. You will collaborate with software engineers, data engineers, and other stakeholders to design, develop, and deploy scalable and resilient microservices that leverage Apache Kafka for event-driven communication. This role requires deep expertise in Kafka, along with proficiency in Spring Boot, Java 8, NoSQL databases, and API development.

Responsibilities:

Architect Event-Driven Microservices: Design and implement microservices architecture using Spring Boot and Kafka for event sourcing, event streaming, and message-driven communication.

Kafka Integration: Integrate Kafka into microservices architecture for asynchronous communication, event-driven processing, and real-time data streaming.

API Development: Design and develop RESTful APIs using Spring Boot for exposing microservices functionality to internal and external consumers.

Data Modeling: Design data models for microservices using NoSQL databases such as MongoDB, Cassandra, or Couchbase, ensuring scalability, performance, and data consistency.

Performance Optimization: Optimize Kafka configurations, Spring Boot applications, and NoSQL databases for performance, scalability, and reliability.

Security: Implement security best practices for Kafka, Spring Boot, and microservices, including authentication, authorization, encryption, and API security.

Monitoring and Logging: Implement monitoring and logging solutions for Kafka, microservices, and NoSQL databases to ensure visibility into system health and performance.

Deployment Automation: Implement CI/CD pipelines for automated deployment of Kafka-based microservices using tools like Jenkins, GitLab CI, or CircleCI.

Documentation and Training: Create documentation for architecture, design, and deployment of Kafka-based microservices. Provide training and support to development teams on best practices for Kafka, Spring Boot, and microservices.

Qualifications:

Bachelor's degree in computer science, Engineering, or a related field. Master's degree preferred.

Proven experience architecting and implementing Kafka-based microservices solutions in a production environment.

Deep understanding of Kafka architecture, including topics, partitions, brokers, and consumer groups.

Proficiency in developing microservices using Spring Boot, Java 8, and related technologies.

Experience with NoSQL databases such as MongoDB, Cassandra, or Couchbase.

Strong understanding of RESTful API design principles and best practices.

Experience with containerization and orchestration technologies such as Docker and Kubernetes.

Familiarity with message queueing and streaming technologies other than Kafka (e.g., RabbitMQ, Apache Pulsar) is a plus.

Excellent problem-solving and troubleshooting skills.

Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.