Big Data Engineer

MRUTUNJAYA CHAVADI

#B*, Subiksha Habitat, Next to ayyappa swamy temple, Near kaggadasapura Railway Cross, Bengaluru. ******@*****.*** +919*********,+919*********.

Professional summary

●High-performing, self-motivated and passionate professional with 13+ years of experience in SDLC with key emphasis on the Big Data Technologies - Spark,Kafka,Hadoop,Hbase,Hive,Druid.

●Architect, Design and develop Big Data Solutions using Hadoop and its ecosystem.

●Designed and developed robust data pipelines using Spark, Kafka and druid for digital marketing analytics.

●Excellent understanding of Hadoop architecture and underlying framework including storage management.

●Good working experience with RDBMS(PostgreSQL,Oracle SQL) and NOSQL databases such as Hbase and Druid.

●Designed and developed Rest API's using Java and Spring Restful webservices for real-time and reporting analytics.

●Evaluate new technologies, develop proof-of-concepts to validate the proposed architecture.

●Apply best practices for software development and documentation, assure designs meet requirements, and deliver high-quality work in timely manner.

●Proactively look for improvements/optimizations in existing/new solutions for enhanced data ingestion and improved reporting capabilities.

●Worked in different stages of Data Analytics solution – from Data Collection, Data storage, Data transformation, Data Analysis with more focus on Data Engineering.

●Work collaboratively in a team with peers, sharing ideas to solve complex and challenging business problems

●Good understanding of the big data design patterns.

●Manage technical documentation of different components, use cases and architecture changes.

●Good exposure to Agile and scaled agile software development process.

●Good team player with problem solving and trouble-shooting capabilities and will prove a valuable asset to any project.

●Exhibits honest work ethics with the ability to excel in fast paced, time sensitive environment

●Keen to learn new technologies, Team player, Competent and Analytical.

Technical Competencies

Programming Languages

Java, Python, Scala

Operating Systems

Windows 95/98/NT, Linux

Databases

Oracle, Postgres, NoSQL(HBase,Druid), Redis

Application Servers

WebSphere, Tomcat, Wildfly

Frameworks

Spring, Django Rest

IDE

Eclipse, PyCharm, Intellij

Big Data Technologies

Hadoop, MapReduce, Hive, Spark, PySpark

Web services

REST

Methodology

Agile and Waterfall

Hadoop Distribution

MapR, Hortonworks

Messaging Queue

Kafka

RECOGNITION

●Recognition@ Target for Architecting, Designing and developing the robust data pipelines in timely manner.

●Recognition@ Philips for code refactoring and Software excellence to improve code quality metrics.

Professional EXPERIENCE

Visa : Data platform - Bengaluru Dec 2021 – present

●Design and develop common reusable utilities for Data Ingestion and Validation.

●Lead the application migration from hortonworks to visa’s own Hadoop platform for our team.

●Application migration from Hive based to Spark application.

●Developed robust data pipelines using spark, scala hive and kafka

Target Corporation : TTS Marketing Maas – Bengaluru Sep 2019 – Dec 2021

●Designed the Maas architecture for digital marketing analytics.

●Designed and developed robust data pipelines using Spark, Kafka and druid.

●Optimized druid for enhanced data ingestion and improved query performance.

●Designed and developed Java Rest API’s for real-time and reporting analytics.

●POC for forward cache and drafted lambda architecture for serving real-time and batch ingestion.

●Architected, designed and developed async file delivery solution using Spark, kafka, oozie and spring boot.

Philips India : Radiology Solutions – Bengaluru Apr 2016 – Aug 2019

●Consumed data from kafka and perform analytics on data using spark core and streaming.

●Transform and load data into Hbase Tables using Java API.

●Developed python application(backend) using Django framework.

●Running queries, reviewing analytics, and assisted in strategic decision making

●Designed and developed REST APIs in Java with spring MVC framework.

Fidelity Investment : Portfolio perform KI - Bangalore Dec 2013 –Mar 2016

●Designed and Developed data transformations using Mapreduce(java) and hive.

●Prototyping and developing POC using Hadoop ecosystem(mapreduce and hive).

●Schema design for hive using partitions and buckets to optimize query performance.

●Designed and developed Reporting application using quartz scheduler

CGI : ADVANTAGE ERP - Bangalore July 2010 – Dec 2013

Involved in several developments, deployments and client upgrade activities for various clients.

Development, Defect fixing, client patches for various modules of ERP finance.

Responsible for unit testing and supporting System Test, QA, UAT of product releases and Go live support for Clients.

Education

Master of Technology - Data Science and Engineering - BITS Pilani, India – Oct 2020 – Sep 2022

DECLARATION

I hereby declare that the above written particulars are true to the best of my knowledge and belief.

Contact this candidate