Machine Learning Project Management
Resume:
RAJNEESH CHATURVEDI, B-tech CSE
E: *******@*****.***
in: Linkedin.com/in/rajneesh-chaturvedi-bba946185/
SENIOR S/W ENGINEER
Sr engineer with 17 years hands-on experience in architecting, automating, design and Analytics
EXECUTIVE SUMMARY
Automating build experience Docker swarm and Kubernetes Experience in Cloud svc.
Infrastructure as a code exp QA methodology unit testing API design and development
Machine Learning Algorithms Agile project management exp. Microservices architecture
Generative AI Scripting and Programming Software dev. life cycle
SKILLS
Miscellaneous – Query book, selenium, Junit, Cypress, Pytest, Databricks, Apache spark 3.5.3, TensorFlow, Airflow, Apache solr, Charmed K8s, Docker, Kafka, Artifactory, Golang, WebLogic, Helm v2.14, NGNIX, HA-proxy, Sage Maker AWS (EC2 - S3 - Route53 - RDS - dynamo DB- Glacier - ELB - EKS), Azure DevOps, GCP (GKE) Packer, Scala, Consul, Vault, Prometheus (Kibana, Grafana), Nagios 4.3.2/XI, MongoDB, Sage Maker Clarify, Sage Maker Model Monitor, GKE standard edition
Worldlink LLC – Sr DevOps & generative AI May 2023 – Dec 2023
Fully managed cloud-based general purpose task Orchestration service
Built streamline ci/cd process for the client, helped build strategies for Java, Spring boot, NodeJS applications.
Provided support to the developers in the release for the application support and code issues.
Scripted the process to make more automated pipelines using the ci/cd, built Golang and node applications.
Setup Sage maker container image and spark jobs in the containers to read from database tables in the delta lake schema formats.
Managed Juju K8s charms, Configured the charm as a sidecar and set up the secrets in charms to read the applications inprod and non-prod.
Prepare ML-Artifacts and configure hyperparameters to it. Identified issues in the training model using Sage Maker debugger.
Integrated selenium test scripts in Python in ci/cd for unit and integration testing and ran parallel execution.
Use of Inference endpoint in the Sage Maker to validate the production model’s performance.
Monitored Scala and python spark jobs in put parameters, trigger functions to optimize the jobs.
Built Airflow, AWS clusters, and architected IAM roles between different domains, buckets access to teams.
Helped in surfacing information using by giving step by step what tables to use and how certain pieces of data work using Tableau, Query book and Starburst, Airflow.
Written and executed data processing data bricks jobs in Scala, tested and ran concurrent jobs.
Databricks unity catalogs and Delta Lake tables setup, star schemas for Bi queries, spark Scala hyperparameters.
Used Python Spark, Panda libraries for the jobs running spark., configured spark for ganglia for monitoring for cluster configuration.
Python pyspark to sort column, add new columns, access secrets using the pyspark.
Build and packaged the Golang based application and made production ready.
Monitoring and error tracking in real time for the Golang applications using sentry.
Leveraged the data storage in the Data Lake house, services such as Delta Lake for identifying tables. maintained unity catalog.
Scala jobs finetuning, resource optimization, error handling scenarios in the jobs.
Deployed the batch and streaming workload jobs using the python spark scheduler.
Cognizant Inc – DevOps Manager Jan 2022 – May 2023
DevOps Kubernetes support for the client VISA
Designed and architected infrastructure, and managed project deliveries and support.
Using DevOps practice, built applications in Go, java, spring boot.
Provided software skills on Kubernetes, Docker swarm and Ansible and apps built on JAVA, Spring boot, JWS applications.
Build Ci/CD pipelines through Jenkins, other homebuilt tools and designed branches and branching strategy.
Pseudonymization of data so that only authorized users can modify the datasets
Used generative-ai techniques to secret detection to avoid leaking keys.
Monitored and finetuned Splunk dashboards setup new indexes forwarders, channeled proper logging and analysis tools for vendor traffic.
Build microservices with Golang and connected to PostgreSQL for crud operations in the WebLogic.
configured the gRPC service for the Golang microservice monitored the request flow between microservices.
Golang test suite to perform unit tests on the functions in the microservices using ‘go test’.
Administered Kubernetes, built EKS clusters, developed Kubernetes manifests automated using Ansible playbooks.
Maintained the dependencies config files such as Package. JSON, pom.xml for NodeJS application and java using maven 3.8.
Troubleshooting space, pod, container issues, virtual services issues in Kubernetes.
Scripted using Ansible plays with bash, Python to automate the process.
Built GCP VPC’s cloud security designs, reading secrets in prod environment for apps, VPN gateways, security controls etc.
Setup cloud networking VPN’s, SD-WAN, direct cloud interconnect for seamless integration.
Splunk forwarder configurations to onboard new data and networking between cluster server.
API testing using Cypress and validated the response when the application is being developed Also tested GraphQl.
Provisioned GCP ci/cd workloads and k8 resources through terraform v.10.
Wipro- AUSTIN – Principal software engineer, DevOps Jan 2020 – Jan 2022
DevOps engineer in Apple’s notification team and Payments team
Google Cloud setup and services - Hybrid cloud, public cloud, Built GKE infrastructure and installed applications.
Applied security controls into the Google cloud environments, Secrets management in prod.
Deployed application written in Angular 6/8 using Gradle, Used JavaScript to automate the node modules during the build script.
Build Ci/CD pipelines for java applications using maven 3.x version using docker file.
Monitored and finetuned Splunk dashboards, channeled proper logging and analysis tools for vendor traffic.
Scheduled Scala spark nomad jobs and tasks for multiple schemas in prod, worked on the parsing and parameterized the apps configs, using statsd Python to collect the metrics and send them to the backend services. Cashed the spark jobs.
Effectively used large datasets using Python Pandas, importing large data and reading csv files, read GKE cloud SQL.
Deployed spark ML jobs into GKE and ran concurrent sessions monitored performance in Prod.
Configured the Python Pytest framework to test the rest services for the backend applications.
Deutsche Bank, Jk Fl > DevOps & Cloud Engineer Feb 2012 - Jan 2020
Managed DevOps and release operations for the bank, made the bank more secure and efficient thus costing them 30% less money for running IT operations
Managed bank’s s/w build and development through CI/CD pipeline, integration tools like Jenkins- Maven and Chef.
Created ansible playbooks to automate the pipelines into EKS clusters.
Integrated Kubernetes with network, storage, security to provide comprehensive infrastructure and orchestrated containers across multiple hosts, built docker container and ran bank critical applications on them using kubectl.
Python multiprocessing and child error handling using python, catch exception.
NIIT Tech, India > Infrastructure Engineer Jan 2008 - Dec 2011
Worked as infrastructure structure support team in maintenance of Linux and windows servers.
JPMC, India > Infrastructure Engineer Jun 2004 - Feb 2008
Support 200+ windows servers, Permissions and security. Indulged in AD and NTFS permissions and allocations to NFS shares. managed subnets and whitelisting of IP’s, Switch instalment and port migrations and allocations.
Education – BTECH JNTU 2004 CSE
Certification – Advanced Data engineering with Databricks 2023
Software engineering/Implementing methodologies design & continuous deployment
-
Cloud
Kubernetes
Aws
GitHub
Jenkins
Databricks
Ansible
Terraform
Splunk
EMPLOYMENT HISTORY
Contact this candidate