Data Developer

Naveen Nannapaneni

Sr. Hadoop/Talend Developer

Contact :209-***-****/******@*****.***

SUMMARY

7+ years of IT experience in complete life cycle of software development using Object Oriented analysis and design using Big data Technologies / Hadoop ecosystem, SQL, Java, J2EE technologies.

Working on Big Data and Data Science building Advanced Customer Insight and Product Analytic Platforms using Big Data and Open Source Technologies.

Wide experience on Data Mining, Real time Analytics, Business Intelligence and Web Development.

Extensively worked on Talend for data integration for bringing the data from different sources including Teradata,Oracle and data warehouse systems.

Leveraged Talend to ingest data into the datalake of datafabric.

Experienced in deployment of bigdata applications using Talend in environments including development,test and production.

Experienced in design, development deployment and maintenance of ETL applications using Talend.

Leveraged strong Skills in developing applications involving Big Data technologies like Hadoop, ElasticSearch, MapReduce, Yarn, Flume, Hive, Pig, Sqoop, HBase, Hortonworks, Cloudera, Avro.

Skilled programming in Map-Reduce framework and Hadoop ecosystems.

Very good experience in apache Hadoop administration.

Very good experience in designing and implementing MapReduce jobs to support distributed data processing and process large data sets utilizing the Hadoop cluster.

Extensive experience in creating Hive tables, loading them with data and writing hive queries which will run internally in MapReduce way.

Hands on experience on NoSQL databases like HBase and Impala.

Worked on different versions of hadoop1.x including Yarn.

Experience in setting up standards and processes for Hadoop based application design and implementation.

Good Exposure on Apache Hadoop MapReduce programming, PIG scripting.

Worked on developing ETL processes to load data from multiple data sources to HDFS using FLUME and SQOOP, perform structural modifications using Map-Reduce, HIVE and analyze data using visualization/reporting tools.

Experience in writing Pig UDF’s (Eval, Filter, Load and Store) and macros.

Experience in developing customized UDF’s in java to extend Hive and Pig Latin functionality.

Experienced in using Talend for multiple data formats including Json.

Hands on experience in setting up Apache Hadoop, MapR and Hortonworks Clusters.

Good knowledge on Apache Hadoop Cluster planning which includes choosing the Hardware and operating systems to host an Apache Hadoop cluster.

Experience using integrated development environment like Eclipse, Net beans, JDeveloper, MyEclipse.

Excellent understanding of relational databases as pertains to application development using several RDBMS including in IBM DB2, Oracle 10g, MS SQL Server 2005/2008, and MySQL and strong database skills including SQL, Stored Procedure and PL/SQL.

Working knowledge on J2EE development with Spring, Struts, Hibernate Frameworks in various projects and expertise in Web Services (JAXB, SOAP, WSDL, Restful) development

Experience in writing tests using Selenium, JUnit and PowerMock.

Ability to work on diverse Application Servers like JBOSS, APACHE TOMCAT, WEBSPHERE and WEBLOGIC.

Worked on different OS like UNIX/Linux, Windows XP, and Windows.

Responsible for build deliverables (detailed design, coding and unit testing) Quality and peer reviews for all development.

Worked on provisioning data to down streams in various formats as per their reporting requirements.

Excellent working knowledge of Agile framework .Implemented multiple projects from scratch to go live using agile framework.

.

SKILLS

Hadoop/Big Data

HDFS, MapReduce, HBase, Pig, Hive, Sqoop, Flume, Avro, Talend Bigdata,Oozie, Solr

Java & J2EE Technologies

Core Java, Servlets, JSP, JDBC, JNDI, Java Beans

IDE’s

Eclipse, Net beans, WSAD, Oracle SQL Developer, IBM Rapid Application Developer (RAD)

Frameworks

MVC, Struts,JPA and MRUnit

Languages

C,C++, Java, Linux shell scripts, SQL

Databases

HBase, Oracle, MySQL, DB2

Web Servers

JBoss, Web Logic, Web Sphere, Apache Tomcat

Web Technologies

HTML, XML, JavaScript, JSON, Servlets,JSP

Reporting Tools

OBIEE

ETL Tools

Talend ETL

NOSQL Databases

HBase

PROJECTS

United Health Group Sep 2012- Jan 2016

Sr.Hadoop/Talend Developer

UnitedHealth Group is a health insurance management company with headquarters in MN. The company is committed to providing quality health care services that respond to members' needs and that promote healthy life styles. It is a leading provider of health care data analysis and targeted member and physician messaging services. It Uses technology to better coordinate care, to make health care easier to navigate and to make service more customized and personalized for the members.

Project Name: OnePayment Integrity Dec’ 2014 toJan’2016

Responsibilities:

Developed Map Reduce jobs in Java for data cleansing, preprocessing and implemented complex data analytical algorithms.

Developed Map Reduce programs to join data from different data sources using optimized joins by implementing bucketed joins or map joins depending on the requirement.

Imported data from structured data source into HDFS using Sqoop incremental imports.

Created Hive tables, partitions and implemented incremental imports to perform ad-hoc queries on structured data.

Responsible for extracting,loading and transforming data using Talend Data Integration.

Worked extensively on design, development and deployment of talend jobs to extract data,filter the data and load them into datalake.

Created workflows on talend to extract data from various data sources and dump them into hadoop layer.

Unit tested talend workflows for the correctness of the data.

Deployed talend workflows on various environments including dev, test and production environments.

Submitted talend jobs for scheduling using Talend scheduler.

Created Hive Generic UDF's to process business logic with Hive QL.

Optimizing Hive queries, improve performance by configuring Hive Query parameters.

Responsible for running Hadoop streaming jobs to process terabytes of XML Data.

Development of Bedrock workflow for orchestrating and scheduling the ETL process.

Implemented Avro, ORC, and Parquet data formats for Apache Hive computations to handle the custom business requirements.

Worked in retrieving transaction data from RDBMS to HDFS, get total transacted amount per user using MapReduce and save output in Hive table.

Worked on creating the workflow to run multiple Hive and Pig jobs, which run independently with time and data availability.

Used Hadoop bench marks in monitoring, testing Hadoop cluster.

Implemented test cases, testing map reduce programs using MRUnit and other mocking frame works.

Implemented Maven build scripts, to work on maven projects.

Worked closely with various business teams while gathering the requirements and converted them into user stories.

Created technical specification documents, process specific documents.

Reviewed technical and functional documentations and provided feedback.

Environments: Hadoop, Cloudera, Map Reduce, Hive, Avro, Linux, Sqoop, Shell Scripting, XML, Java, Maven, Eclipse, Oracle and Bedrock,Rally.

Project Name: AdvanceCare Feb 2013 to Nov2014

Role :Hadoop Developer

Responsibilities:

Involved in full life-cycle of the project from Design, Analysis, logical and physical architecture modeling, development, Implementation, testing.

Responsible to manage data coming from different sources and involved in HDFS maintenance and loading of structured and unstructured data.

Developed MapReduce programs to parse the raw data and store the refined data in tables.

Developed algorithms for identifying influencers with in specified social network channels.

Involved in loading and transforming large sets of structured, semi structured and unstructured data from relational databases into HDFS using Sqoop imports.

Analyzing data with Hive and Pig.

Responsible for analyzing and cleansing raw data by performing Hive queries and running Pig scripts on data.

Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.

Created Hive tables, loaded data and wrote Hive queries that run within the map.

Used Bedrock Operational Services for batch processing and scheduling workflows dynamically.

Hands on experience in application development using Java, RDBMS, and Linux shell scripting.

Performed data mining investigations to find new insights related to customers.

Involved in forecast based on the present results and insights derived from data analysis.

Manage and review Hadoop log files.

Developed and generated insights on various ways to identify fraudulent claims both in prospective and retrospective scenarios.

Worked on identifying, analyzing defects, questionable function error and inconsistencies in output.

Reviewed technical documentation and provided feedback.

Environment: Java, Hadoop, HDFS, Map Reduce, Hortonworks, Hive, Sqoop, Flume, Bedrock, Zookeeper, MySQL, HBase and eclipse

Role :ETL &Reporting Developer

Project Name: SubroTrack Sep’2012 to Feb 2013

Responsibilities:

Developed high-level design documents, Use case documents, detailed design documents and Unit Test Plan documents and created Use Cases, Class Diagrams and Sequence Diagrams using UML.

Extensive involvement in database design, development, coding of stored Procedures, DDL&DML statements, functions and triggers.

Utilized Hibernate for Object/Relational Mapping purposes for transparent persistence onto the MySQL server.

Designed and Developed ETL jobs using Talend ETL tool to extract load and transfer data from one environment to the other..

Involved in the design of the ETL environment for data retrieval and transformation.

Deployed Talend jobs in various environments including Development, Staging, Base and Production areas.

Administered ETL jobs using Talend Administration Centre (TAS) .

Designed reports using Oracle’s Business Intelligence Enterprise Edition (OBIEE) .

I

Deployed reporting metadata to various environments which includes Development,Test and Production Environments .

Development of SQL queries and PL/SQL functions and procedures depending on the project needs.

Environment: Talend ETL, Oracle OBIEE,SQL and PL/SQL.

Kony Labs: April 2011 to ‘Sep’2012

Kony is the leading enterprise mobility provider which delivers solutions that empower today’s leading organizations to compete in mobile time by rapidly delivering multi-edge mobile apps across the broadest array of devices and systems, today and in the future.

Project Name : Citibank Hong Kong April 2011 – Sep 2011

Role : Mobile Application Developer

Responsibilities:

Worked closely with the business users to gather requirements

Worked on design and development of the Citi’s mobile application.

Written scalable and maintainable code solutions for complex engineering challenges

Understand and follow standards, guidelines, and best practices adopted in the project.

Developed high quality Front End/UI patterns for mobile devices using Kony’s IDE

Written test cases using JUnit to unit test the application and ran the test suite.

Used Kony’s scrapper tool to get the content from the web applications and replicated the same in the mobile application.

Deployed the mobile application in various environments including android,apple and blackberry.

Loaded the mobile executable to various kinds of mobiles and tested the application accordingly.

Analyzed the server logs and identified issues in all the environments including production.

Environment: Windows, Linux, Java, WSDL, JSP, Java Script, Ajax, Kony IDE, Oracle IDE,log4j, ANT, struts, JPA, XML, Python.

Project Name : TestAutoFramework Sep 2011 to Sep’2012

Role :Application Developer

Responsibilities:

Worked closely with Kony’s management to identify the requirements and prepared various kinds of documents.

Written technical specifications of the product using Microsoft Visio.

Created unit test case suite using JUnit.

Developed desktop application using Swings,AWT to read screen coordinates to capture images effectively.

Executed the test suite against the product developed.

Deployed the product on to different environments.

Fixed the issues reported by users across the organization.

Gave presentations of the product and introduced it to a large audience across the organization.

Environment: Windows, Java,AWT,Swings, Sikuli.

Cognizant Technology Solutions Jan 2009 to March 2011

Project Name : Aetna HealthCare

Role: Web Application Developer

Project: Subrotrack is an application used by subrogation analysts which enables them to keep track of end to activities of the subrogation at the click of mouse. Till the time recoveries are collected and the case gets closed the system helps them to interact them with various parties including the payers, providers,attorneys,police and other insurance providers.

Responsibilities:

Worked as a Development Team Member.

Coordinated with Business Analysts to gather the requirement and prepare data flow diagrams and technical documents.

Identified Use Cases and generated Class, Sequence and State diagrams using UML.

Used Websphere Message Queues for the asynchronous exchange of critical business data and events among J2EE components and legacy system.

Designing, coding and maintaining of Entity Beans and Session Beans using EJB 2.1 Specification.

Developed Web Interfaces using MVC Struts Framework.

User Interface was developed using JSP,HTML and Java Script.

Designed and developed DAO and middleware layer using Java.

Designed, developed and deployed batch jobs using Linux shell scripting.

Writing unit test cases using frameworks like JUnit and PowerMock.

Prepared deployment document for various batch jobs and application releases which will be executed by application support teams during the deployment.

Environment: J2EE, Struts1.0, Java Script, HTML, XML, XSLT, DTD, JUnit, PowerMock,Shell Scripting,EJB 2.1, Oracle, Tomcat, Eclipse, Web Sphere 7.0/8.1.

Certifications

Sun certified java developer program (Java 1.6)

Academy for Healthcare Management-250 certified from America's Health Insurance Plans

Education

Masters in Computer Applications from Osmania University in 2008.

Contact this candidate