Kafka Streams & Microservices DevOps Engineer
Resume:
Ramu Dokku
************@*****.***
Good professional software experience in the IT industry (Banking/Telecom/Insurance) including Administration, Design, Development, Maintenance, Enhancement, Application Support, and Production Support of Business Applications using Middleware ( IBM MQ/ IIB/ ACE/ Kafka/Data Power/IBM API Connect), Micro Services, Java, Spring Boot, Python, DevOps, Terraform, Ansible, AWS, Docker, Kubernetes, Open Shift and JAVA/J2EE technologies.
Experience with MVC Architecture Design Patterns and Development methodologies like Agile (Scrum), Iterative, Waterfall models, and Software Patterns.
Provided 24/7 production support, resolving incidents related to API failures, performance degradation, and integration issues, ensuring minimal downtime and optimal API performance.
Installed, configured, and managed multi-node Kafka clusters on Linux and cloud environments (AWS MSK, Azure, GCP).
Developed stateful stream processing applications using Kafka Streams API.
Provisioned, configured, and managed AWS MSK clusters for production, staging, and development environments.
Designed and developed real-time streaming applications using Apache Flink (DataStream API) for high-volume event processing.
Implemented event-time processing, watermarks, windowing (tumbling, sliding, session), and complex event pattern detection.
Designed and implemented scalable data warehouse solutions using Snowflake architecture.
Integrated Snowflake with ETL tools like Informatica / Talend / dbt.
Implemented windowed aggregations, joins (stream-stream, stream-table), and suppression.
Designed event-driven microservices using Kafka as the backbone for asynchronous communication.
Kafka Cluster Management: Administered and managed Kafka clusters, ensuring high availability, fault tolerance, and performance optimization across multiple environments (dev, staging, production).
Kafka Configuration & Tuning: Configured Kafka brokers, topics, and partitions. Tuned Kafka for optimal performance by adjusting producer/consumer configurations and JVM settings.
Cluster Upgrade & Patching: Managed Kafka cluster upgrades, patching, and migrations with minimal downtime and impact to services. Ensured smooth and efficient rolling upgrades with zero service interruption.
Kafka Topics and Partitioning: Created and configured Kafka topics with appropriate partitioning strategies, ensuring optimal data distribution and parallelism for producers and consumers in high-volume systems.
Secured Kafka broker communication by enforcing SSL encryption, setting up proper client authentication, and restricting broker access to trusted IP addresses and authenticated clients.
Conducted major Kafka version upgrades across clusters, ensuring compatibility, performing rolling upgrades, and testing all components (producers, consumers, streams) to validate migration success.
Extensive knowledge and hands-on experience with IBM MQ, IBM Integration Bus, IBM Data Power Gateway, and IBM API Connect.
Designed, implemented, and maintained Infrastructure as Code (IaC) solutions using Terraform to automate provisioning of cloud resources across multiple platforms (AWS, Azure, GCP).
Implemented AWS IAM roles, VPC networks, subnets, and security groups using Terraform, ensuring security best practices were followed.
Integrated Terraform into CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions) to automate infrastructure provisioning and updates, ensuring consistency across environments.
Design, administration, and Development of Data Power & IBM API Connect: Installing Data Power, API connect in VM platforms, SMTP Configuration, Clustering, adding Gateway services, configuring LDAP, Creating Organizations, Publishing APIs, creating TLS profiles, Installing Developer Portals, adding developer portals to CMC, Dev portal clustering, patch maintenance, Site Creation, debugging.. Etc.
Experience in Installation, Configuration, Troubleshooting, and performance tuning of IBM WebSphere Application Server, WebLogic, Apache tomcat, JBoss, and IIS Web Server.
Design, administration, and Development of DevOps Tools: Setting up the CI/CD pipelines using Jenkins, Maven, Nexus, GitHub, SonarQube, Terraform, and Ansible.
Design, administration, and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating process attaching process to trigger monitor, creating trigger monitor, WMQ Cluster setup, HACMP, Diagnosis of problem on channels and trigger monitor.
Experience on enterprise web service security- X509 certs, encryption, and digital signature, OAuth2.0, SAML and Kerberos.
Implementing designed AWS architecture for the applications on AWS infrastructure so that the critical applications are highly available, elastic, and scalable using various AWS services - EC2, S3, Route53, ELBs, Subnets, VPCs, RDS, IAM, and Auto Scaling.
Worked in container-based technologies like Docker, Kubernetes, and Open Shift.
Setting up, configuring Kafka Environment in Linux from scratch, and monitoring it.
Experienced in Configure and Supporting monitor tools like Splunk, Nagios, and ELK.
Extensively worked with Version Control Systems GitHub, Bit bucket, and GIT.
Hands on experience in Oracle, IBM DB2, NoSQL Databases – MongoDB and Neo4J.
Provided defect and Q&A support to worldwide customers experiencing Infrastructure and Application issues on TEST, INT, STAGE, DEV, Pre-Production, and PRODUCTION Environments.
Worked with Off-Shift teams in Australia, Dubai, and India to assist with internal processes and customer escalations.
Education
Master of Computer Sciences (M.Sc.) from Babasaheb Maratwada University 2003.
Bachelor of Science (B.Sc.) from Osmania University 2001.
Professional Experience
CITI Bank LTD, Platform Support Lead, Dallas, TX June 2024 - Till Date
Responsibilities and Work History:
Installed, configured, and managed multi-node Kafka clusters on Linux and cloud environments.
IBM MQ/ Kafka/ Data Power/IBM API Connect Installation / Fix pack/configuration apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Designed and implemented multi-AZ Kafka clusters for high availability, fault tolerance, and disaster recovery.
Implemented event sourcing and CQRS patterns using Kafka topics.
Configured stateful stream processing using RocksDB state backend with checkpointing and savepoints.
Connected BI tools such as Tableau / Power BI to Snowflake for reporting.
Designed dimensional models (Star & Snowflake schema) for analytics use cases.
Integrated Flink with Hive/S3/Elasticsearch sinks for analytics and reporting use cases.
Automated job deployments using CI/CD pipelines and containerized applications with Docker.
Implemented schema validation and handled schema evolution using Avro/Schema Registry.
Integrated Kafka with Spring Boot microservices using @KafkaListener and reactive consumers.
Provided 24/7 production support, resolving incidents related to API failures, performance degradation, and integration issues, ensuring minimal downtime and optimal API performance.
Deployed and managed Confluent Kafka clusters in both on-premises and cloud environments (AWS, Azure) using Confluent Platform components (Kafka Broker, Schema Registry, Kafka Connect, KSQL, Control Center).
Installed and configured Apache Kafka in a multi-node environment, ensuring high availability and fault tolerance across the cluster. Configured Kafka brokers and Zookeeper for seamless integration with other applications and services.
Secured Kafka broker communication by enforcing SSL encryption, setting up proper client authentication, and restricting broker access to trusted IP addresses and authenticated clients.
Configured SSL/TLS encryption, SASL authentication, and Kafka ACLs (Access Control Lists) for securing communication between Kafka brokers and clients, ensuring end-to-end security for data in transit.
Installed, configured, and deployed Zookeeper on Linux/Unix systems across multiple data centers to ensure seamless service orchestration.
Conducted major Kafka version upgrades across clusters, ensuring compatibility, performing rolling upgrades, and testing all components (producers, consumers, streams) to validate migration success.
Integrated and maintained Kafka clusters with Zookeeper for distributed coordination, managing brokers, and ensuring fault tolerance across Kafka's distributed messaging system.
Managed Zookeeper as a centralized service for storing Kafka broker metadata and configuration, ensuring smooth leader election and topic-partition distribution within the Kafka cluster.
Configured Kafka-Zookeeper failover strategies to ensure high availability and disaster recovery, minimizing data loss and downtime during Zookeeper or broker failures.
Ensured the security of APIs by implementing authentication mechanisms such as OAuth, JWT, and API key-based security policies in IBM API Connect.
Actively involved and Responsible for the Design, administration, and Development of Data Power & IBM API Connect: Installing Data Power, API connect in VM platforms, SMTP Configuration, Clustering, adding Gateway services, Configuring LDAP, Creating Organizations, Publishing API’s, creating TLS profiles, Installing Developer Portals, adding developer portals to CMC, dev portal clustering, patch maintenance, Site Creation, debugging.. Etc.
Worked on the API management console, created REST APIs, added APIs to the Product, created rate limits with multiple Plans, and staged/published the product to a Catalog.
Experienced in configuring objects like WS-proxy, MPGW, and XML Firewall using WebSphere DataPower XI50/52, XS40.
Worked extensively on API management console, creating REST APIs.
Involved in securing the APIs using OAuth 2.0 and SSL.
Added APIs to the product, created rate limits with multiple Plans and published the product to a catalog.
Design, administration, and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating process attaching process to trigger monitor, creating trigger monitor, WMQ Cluster setup, HACMP, Diagnosis of problem on channels and trigger monitor.
Designed and implemented IBM MQ clusters to provide high availability, scalability, and load balancing across multiple queue managers.
Actively involved and Responsible for Designing, administration and Development of Integration Bus/IBM App Connect: product installation, Fix apply, new Integration node creation, EG creation, Designing Message flow as per the requirement, writing ESQL code, creating/deploying of bar file, configured JDBC/ODBC/Policy Set/Policy Bindings, SSL Configuration, writing style sheet to use in XML transformation node, IIB trouble shooting, uploading logs to IBM PMR site etc
Actively involved and Responsible for Design, administration and Development of Data Power & IBM API Connect: Installing Data Power, API connect in VM platforms, SMTP Configuration, Clustering, adding Gateway services, Configuring LDAP, Creating Organizations, Publishing API’s, creating TLS profiles, Installing Developer Portals, adding developer portals to CMC, dev portal clustering,patch maintenance, Site Creation,debugging.. Etc.
Experience in Installation, Configuration, Troubleshooting and performance tuning of IBM WebSphere Application Server 8.0/7.0/6.0, WebLogic, Apache tomcat, JBoss and IIS Web Server.
Logging and Monitoring with ELK, Kibana, Prometheus and Grafana.
Created Jenkins CI/CD pipelines for continuous build & deployment and integrated with GitHub, GIT, Maven, Bit Bucket, Junit, and SonarQube plugins in Jenkins for automated testing and Code quality check.
Utilized Kubernetes for the runtime environment of the CI/CD system to build, test, and deploy.
Involved working with a PaaS solution such as Red Hat Open shift.
Worked with the Open Shift platform in managing Docker containers and Kubernetes Clusters.
Boston Scientific INC, Middleware Administrator, Dallas, TX March 2022 – May 2024
Responsibilities and Work History:
IBM MQ/ Kafka/ ACE/Data Power/IBM API Connect Installation / Fix pack/configuration apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Design, administration, and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating process attaching process to trigger monitor, creating trigger monitor, WMQ Cluster setup, HACMP, Diagnosis of problem on channels and trigger monitor.
Designed and implemented real-time event streaming pipelines using Apache Kafka.
Developed Kafka producers and consumers using Java and Spring Boot.
Created and managed topics, partitions, replication factors, and retention policies.
Implemented consumer groups for parallel and fault-tolerant processing.
Designed event-driven microservices using Kafka as the backbone for asynchronous communication.
Kafka Cluster Management: Administered and managed Kafka clusters, ensuring high availability, fault tolerance, and performance optimization across multiple environments (dev, staging, production).
Kafka Configuration & Tuning: Configured Kafka brokers, topics, and partitions. Tuned Kafka for optimal performance by adjusting producer/consumer configurations and JVM settings.
Cluster Upgrade & Patching: Managed Kafka cluster upgrades, patching, and migrations with minimal downtime and impact to services. Ensured smooth and efficient rolling upgrades with zero service interruption.
Kafka Topics and Partitioning: Created and configured Kafka topics with appropriate partitioning strategies, ensuring optimal data distribution and parallelism for producers and consumers in high-volume systems.
Secured Kafka broker communication by enforcing SSL encryption, setting up proper client authentication, and restricting broker access to trusted IP addresses and authenticated clients.
Built ELT pipelines using Snowflake with cloud storage (S3/Azure Blob/GCS).
Integrated Kafka with Schema Registry for schema evolution and compatibility.
Actively involved and Responsible for the Design, administration, and Development of Data Power & IBM API Connect: Installing Data Power, API connect in VM platforms, SMTP Configuration, Clustering, adding Gateway services, Configuring LDAP, Creating Organizations, Publishing API’s, creating TLS profiles, Installing Developer Portals, adding developer portals to CMC, dev portal clustering, patch maintenance, Site Creation, debugging.. Etc.
Logging and Monitoring with ELK, Kibana, Prometheus, and Grafana.
Created Jenkins CI/CD pipelines for continuous build & deployment and integrated with GitHub, GIT, Maven, Bit Bucket, Junit, and SonarQube plugins in Jenkins for automated testing and Code quality check.
Utilized Kubernetes for the runtime environment of the CI/CD system to build, test deploy.
Involved working with a PaaS solution such as Red Hat Open shift.
Worked with the Open Shift platform in managing Docker containers and Kubernetes Clusters.
CVS Pharmacy INC, Middleware Administrator, Dallas, TX July 2020 – Feb 2022
Responsibilities and Work History:
Installed, configured, and maintained multiple instances of WebSphere Portal Server and WebSphere Application Server across development, testing, and production environments clusters and secured them with WebSEAL, Tivoli Access Manager (TAM) and Tivoli Directory server (TDS).
IBM MQ/IIB/ACE/Data Power/IBM API Connect Installation / Fix pack/configuration apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Kafka Cluster Management: Administered and managed Kafka clusters, ensuring high availability, fault tolerance, and performance optimization across multiple environments (dev, staging, production).
Kafka Configuration & Tuning: Configured Kafka brokers, topics, and partitions. Tuned Kafka for optimal performance by adjusting producer/consumer configurations and JVM settings.
Cluster Upgrade & Patching: Managed Kafka cluster upgrades, patching, and migrations with minimal downtime and impact to services. Ensured smooth and efficient rolling upgrades with zero service interruption.
Kafka Connect & Kafka Streams: Managed and configured Kafka Connect for seamless integration with external systems like databases, file systems, and other messaging platforms. Also implemented Kafka Streams for real-time stream processing.
Ensured the security of APIs by implementing authentication mechanisms such as OAuth, JWT, and API key-based security policies in IBM API Connect.
Deployed and managed Confluent Kafka clusters in both on-premises and cloud environments (AWS, Azure) using Confluent Platform components (Kafka Broker, Schema Registry, Kafka Connect, KSQL, Control Center).
Administered and configured IBM API Connect environments, including API Gateway, API Manager, and Developer Portal, to manage the lifecycle of APIs across multiple environments (Development, Staging, and Production).
Actively involved and Responsible for the Design, administration, and Development of Data Power & IBM API Connect: Installing Data Power, API connect in VM platforms, SMTP Configuration, Clustering, adding Gateway
services, configuring LDAP, Creating Organizations, Publishing API’s, creating TLS profiles, Installing Developer Portals, adding developer portals to CMC, dev portal clustering, patch maintenance, Site Creation, debugging.. Etc.
Configured Multi-Protocol Gateway (MPGW).
Worked with CWF, TDS, and XML, XMLNSC message formats.
Design, administration, and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating process attaching process to trigger monitor, creating trigger monitor, WMQ Cluster setup, HACMP, Diagnosis of problem on channels and trigger monitor.
Designed and implemented IBM MQ clusters to provide high availability, scalability, and load balancing across multiple queue managers.
Configured cluster sender (CLUSSDR) and receiver (CLUSRCVR) channels to ensure secure and efficient communication between cluster members.
Implemented security measures for MQ clusters, including SSL/TLS encryption for cluster channels and Object Authority Manager (OAM) for access control.
Configured SSL certificates for secure communication between cluster queue managers, ensuring data integrity and confidentiality.
Conducted periodic security audits of MQ cluster configurations to identify and remediate potential vulnerabilities.
Developed Web services in IIB/Message Broker using SOAP and HTTP nodes. Created XSDs, and WSDLs and implemented Restful web services utilizing XML and JSON message formats.
Created common ESQL functions and reusable subflows in IIB. Created sub-flows for error logs and audit logs by using Log4j.
LDAP was used for Authentication and Authorization which was integrated with the Data power.
WMQ/IIB/Data power/IBM API Connect installation / Fix pack apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
WMQ HACMP configuration on UNIX and AIX OS.
WMQ Troubleshooting, Queue Manager creation, MQ objects creation, MQ cluster setup & support, enabling MQ to distribute communication. MQ HACMP setup and support.
Worked with the OpenShift platform in managing Docker containers and Kubernetes Clusters.
Created Jenkins CICD pipelines for continuous build & deployment and integrated Junit and SonarQube plugins in Jenkins for automated testing and Code quality checks.
Wipro-Dubai WebSphere Consultant Feb 2019 – Jan 2020
RAK Technology - Dubai Technical Analyst Dec 2010 – Feb 2019
Project: RAKBANK (National Bank of Ras Al-Khaimah)
Responsibilities and Work History:
IBM MQ/IIB/Data Power/IBM API Connect Installation / Fix pack/configuration apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Actively involved and Responsible for Designing, administration and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating trigger monitor, WMQ Cluster setup, Setup & Configuration of High Availability with HACMP & Multi Instance queue manager, MQ logs monitor.
Experience with MQSC commands and IBM MQ Explorer for managing and monitoring cluster configurations.
Proficient in scripting languages (e.g., Shell scripting, Python) for automating routine cluster management tasks.
Kafka Cluster Management: Administered and managed Kafka clusters, ensuring high availability, fault tolerance, and performance optimization across multiple environments (dev, staging, production).
Kafka Configuration & Tuning: Configured Kafka brokers, topics, and partitions. Tuned Kafka for optimal performance by adjusting producer/consumer configurations and JVM settings.
Cluster Upgrade & Patching: Managed Kafka cluster upgrades, patching, and migrations with minimal downtime and impact to services. Ensured smooth and efficient rolling upgrades with zero service interruption.
Kafka Connect & Kafka Streams: Managed and configured Kafka Connect for seamless integration with external systems like databases, file systems, and other messaging platforms. Also implemented Kafka Streams for real-time stream processing.
Actively involved and Responsible for Designing, administration and Development of Integration Bus/IBM App Connect: product installation, Fix apply, new Integration node creation, EG creation, Designing Message flow as per the requirement, writing ESQL code, creating/deploying of bar file, configured JDBC/ODBC/Policy Set/Policy Bindings, SSL Configuration, writing style sheet to use in XML transformation node, IIB trouble shooting, uploading logs to IBM PMR site etc
Developed Web services in IIB/Message Broker by using SOAP and HTTP nodes. Created XSDs, WSDLs and implemented Restful web services utilizing XML and JSON message formats.
Created common ESQL functions, Reusable sub flows in WMB. Created sub flows for error logs and audit logs by using Log4j.
Worked with IBM PMR team on problem determination, troubleshooting, and resolution.
Experience on enterprise web service security- X509 certs, encryption, and digital signature, OAuth2.0, SAML and Kerberos.
Created various front side handlers (HTTP, HTTPS, and FTP) to implement Multi- Protocol Gateway service in XI50/52 for protocol transformation.
Created security framework/Policies for the Data Power services using SSL, PKI (X.509), AAA, and WS-Security for secure communication.
Actively involved and Responsible for Design, administration and Development of Data Power & IBM API Connect : Installing Data Power, API connect in VM platforms, SMTP Configuration, Clustering, adding Gateway services,
configuring LDAP, Creating Organizations, Publishing API’s, creating TLS profiles, Installing Developer Portals, adding developer portals to CMC, devportal clustering,patch maintenance, Site Creation,debugging.. Etc.
Experience in Installation, Configuration, Trouble-Shooting and performance tuning of IBM WebSphere Application Server 8.0/7.0/6.0, WebLogic, Apache tomcat, JBoss and IIS Web Server.
Logging and Monitoring with ELK, Kibana, Prometheus and Grafana.
Created Jenkins CI/CD pipelines for continuous build & deployment and integrated with GitHub, GIT, Maven, Bit Bucket, Junit and SonarQube plugins in Jenkins for automated testing and for Code quality check.
Utilized Kubernetes for the runtime environment of the CI/CD system to build, test deploy.
Involved working with a PaaS solution such as Red Hat Open shift.
Worked with Open Shift platform in managing Docker containers and Kubernetes Clusters.
Tata Consultancy Services I.T Analyst Apr 2010 – Nov 2010
Project: SUNCORP BANK
Responsibilities and Work History:
WMQ Troubleshooting, Queue Manger creation, MQ objects creation, MQ cluster setup & support, enabling MQ distribute communication. MQ HACMP setup and support.
Web sphere Message broker Installation / Fix pack apply in different environments such as DEV, UAT, STAGE, DR, and PROD. Responsible for new broker creation, EG creation, bar file deployments, IIB configuration parameter changes. IIB trouble shooting, uploading logs to IBM PMR site.
Design, administration, and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating process attaching process to trigger monitor, creating trigger monitor, WMQ Cluster setup, HACMP, Diagnosis of problem on channels and trigger monitor.
Designed and implemented IBM MQ clusters to provide high availability, scalability, and load balancing across multiple queue managers.
Designing Message flow as per the requirement, writing ESQL code,creating message set,message set definition file, creating bar file deploying bar file, writing stylesheet to use in XML transformation node, etc.
IBM INDIA PVT LTD System Engineer Feb 2007 – Apr 2010
Project 1 : Vodafone
Responsibilities and Work History:
WMQ Troubleshooting, Queue Manger creation, MQ objects creation, MQ cluster setup & support, enabling MQ distribute communication. MQ HACMP setup and support.
Design, administration, and Development of WebSphere WMQ: such as Creating Queue Managers, Queues, Channels, Listeners ports, back up of queue managers, creating process attaching process to trigger monitor, creating trigger monitor, WMQ Cluster setup, HACMP, Diagnosis of problem on channels and trigger monitor.
Designed and implemented IBM MQ clusters to provide high availability, scalability, and load balancing across multiple queue managers.
Web sphere Message broker Installation / Fix pack apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Responsible for new broker creation, EG creation, bar file deployments, IIB configuration parameter changes.
IIB trouble shooting, uploading logs to IBM PMR site.
Designing Message flow as per the requirement, writing ESQL code,creating message set,message set definition file, creating bar file deploying bar file, writing stylesheet to use in XML transformation node, etc…
New requirement development and documentation.
Effort estimation for new Requirements.
Defect Fixing.
Second level support
Project 1: WEBSHOP
Responsibilities and Work History:
WMQ Troubleshooting, Queue Manger creation, MQ objects creation, MQ cluster setup & support, enabling MQ distribute communication. MQ HACMP setup and support.
WMQ Installation / Fix pack apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Web sphere Message broker Installation / Fix pack apply in different environments such as DEV, UAT, STAGE, DR, and PROD.
Responsible for new broker creation, EG creation, bar file deployments, IIB configuration parameter changes.
IIB trouble shooting, uploading logs to IBM PMR site.
Designing Message flow as per the requirement, writing ESQL code,creating message set,message set definition file, creating bar file deploying bar file, writing stylesheet to use in XML transformation node, etc…
New requirement development and documentation.
Used Struts and Hibernate frame Works.
Implemented MVC Model II architecture using Struts Framework.
Developed and deployed the application using WAS/JBoss application server
Contact this candidate