Sign in

Engineer Software

San Jose, California, United States
February 20, 2018

Contact this candidate




Professional Summary

*Experience building data pipelines for batch and real time use cases using Spark, Kafka, Druid, Impala, Hive.

*Experience with Elastisearch, MongoDB, OpenDJ LDAP System and building REST based services

*Designed and developed databases and Java based web applications in education and financial domain

*Extensive experience in java programming using spring framework and building web services using SOAP and REST technologies. Experienced in designing and developing server side and client side applications

*Profound experience in database query tuning, performance tuning of Reports and designing schema


*Technologies : Spark 1.6, Kafka, HDFS, Impala, Hive, Elasticsearch, Oracle11g, OpenDJ,

MongoDB, Druid, MemSQL, Tableau 10.1, SQL, HQL

*WebServices : SOAP, REST

*Languages : Java 1.7, Scala 2.11, Python 2.7

*Platforms : Windows (2000/XP), Unix, Linux

*Tools : Eclipse, IntelliJ, PL/SQL developer, Splunk, Rally, VersionOne, SOAP UI

Work Experience

Big Data Engineer, Verizon Labs Palo Alto, CA, USA May 2016 – July 2017

Project: Design and develop data pipeline for Video Analytics

Technologies Used: Spark 1.6, Druid, Kafka, Scala, HDFS, Impala, Hive, Splunk, Cloudera


*Designed and developed ETL pipeline to read events from Kafka and process using Spark streaming. Processed json messages using Spark API storing results as parquet

*Performed data analysis using Spark SQL and Hive QL

*Performed POC on Druid as datastore for analytics use cases. Developed ingestion jobs and benchmarking for Druid. Developed druid queries and built ad-hoc tableau reports.

*Co-ordinated with product, front end and end users to develop dashboards analyzing user experience, quality of service and user engagement on the content. Led a team towards a successful launch of Video Analytics

Big Data Engineer, American Express Phoenix, AZ, USA April 2015 – May 2016

Project: User Behavior Analytics for Data Security, Custom Authorization Module on Microstrategy Reports

Technologies Used: Java 1.7, HDFS, Pig, Hive, Splunk


*Analyzed login data and identified solutions to counter credential stuffing activities on American express sites.

*Created Hive tables, loaded data and developed queries to identify user login behavior.

*Performed ElasticSearch upgrade on Plenti application, tested end to end data flow.

*Maintained a User Authorization application built in Java used to provision and maintain access to MicroStrategy reports.

*Performed POC on Kyvos, an online analytical processing product, to migrate ETL workflows to Hadoop environment, analyzed tool for functionality, scalability and performance

Software Engineer II, Apollo Education Group Inc Phoenix, AZ, USA May 2011 – March 2015

Project: Access Management System for Web applications, Task/Notification System

Technologies Used: Java, OpenDJ, REST Web services, MongoDB, MapReduce, Hive, Splunk, PL/SQL


*Developed MapReduce jobs to load user attribute data from multiple data sources after executing rules

*Created Hive tables to store parsed curriculum quiz data as part of Adaptive Learning Engine

*Designed and developed Access Management database using OpenDJ, scheduled backup jobs, created alerts for various events, created monitoring tasks and performance tuning, data partitioning. Build webservices meeting SLA required by Classroom, Curriculum and Learning Engine applications

*Developed services to manage Tasks and Notifications for students and faculty with MongoDB as backend

*Developed course clearance module for financial counselors to automate the process of reviewing students

course schedule using Drools and multi-threading implementation in stand-alone client-server environment

Project: University of Phoenix Mobile App

Technologies Used: Java, agile methodologies, Oracle 10g, REST Web services, PL/SQL


*Designed and developed mobile database and integrated application with various web services to raise events upon different stages of student life cycle

*Set up development, demo, system, integration testing, performance testing environments.

*Responsible for development and integration of course scheduling web services with logic in PL/SQL

Software Engineer, Apollo Education Group, Inc Jan 2008 – April 2011

Project: Email Marketing

Technologies Used: Oracle 10g, Embarcadero, SQL Server 2005, PL/SQL


*Developed Email Marketing web-application, database and batch processes. Analyzed and prepared integration requirements after discussions with partnering teams

*Developed PL/SQL module to migrate and reconcile data from third parties into database

*Fine-tuned PLSQL programs and SQL Queries for the maximum efficiency in various schemas across databases using oracle Hints, Explain Plans, and Trace sessions for Cost Based Optimization (CBO)

Project: Lead Management System

Technologies Used: Oracle 9i, Embarcadero, SQL Server 2005, PL/SQL, TOAD


*Managed all phases of Lead and Qtask database development, including mapping, designing, configuring, implementing, testing, and post-launch support

*Liaise with marketing, and business contacts to define enhancements and improve customer support

*Created Learning Engine database using Hadoop and transferred data in flat files using python scripts

Release Engineer, Apollo Education Group, Inc Phoenix, AZ, USA Aug 2006 – Dec 2007

Technologies Used: Shell script, Jira, SVN, Oracle 9i, Tomcat, PL/SQL


*Responsible for the on time delivery of all Release Process outputs as defined in the release policy, process and procedure. Investigate, troubleshoot and track issues raised during build and deploy process


Bachelor of Technology (B.Tech.), EEE Osmania University, India

Master of Science (M.S.), EE West Virginia University (WVU)

Masters in Business Administration (MBA) University of Phoenix, Phoenix, AZ

Contact this candidate