Data Sql Server
Resume:
Gaddam Kiran
******.********@*****.***
Summary:
About 8+ years of professional IT experience which includes 4 years of experience in Big data ecosystem related technologies like Hadoop HDFS, Map Reduce, Apache Pig, Hive, Sqoop, HBASE, Kafka,Flume, Oozie and Spark.
Experienced in installing, configuring and monitoring Hadoop clusters.
Accomplished Big-Data Hadoop Stack using Cloudera, Hortonworks, MapR Platforms.
Superior background in object oriented development including C++, Java, Scala, Python and shell Scripting.
Acquaintance on NOSQL databases like HBASE, Cassandra, and MONGODB.
Involved in writing Database Queries, creating stored Procedures, Views, Indexes, Triggers, Functions, code optimization and performance.
Trained in manipulating the streaming data to clusters through Flume.
Optimized streaming log files with no time latency using Flume and more importantly operating the data down stream flow to Hadoop ecosystems and it analysis segments.
Worked on Oozie and Zookeeper to automate the flow of jobs and coordination in the cluster respectively.
Successfully integrated Kafka and Spark for Real Time processing.
Experience on Kafka Mirror Maker setup, data replication across data centers, Kafka topics, replication and partitions creations.
Experience on Bash/Shell scripts for automation and testing jobs.
Developed Spark scripts by using Scala Shell commands as per the requirement.
Good knowledge on creating RDD's, Pair RDD's, Transformations and Actions in Spark.
Responsible for creating Data Frames and DStreams for Relational data processing in Spark SQL.
Managed both Waterfall and Agile methodologies.
Facilitate in reviewing and analyzing required documents, understanding business process flow diagrams and use cases.
Familiar in creation of reusable components using multiple technologies.
Knowledge on ORC, RC, Sequence File, AVRO and Parquet file formats.
Highly motivated team player with the ability to work independently and adapt quickly to new and emerging technologies.
Good working skills on cloud platforms like AWS, Azure.
Monitoring AWS infrastructure services Amazon Simple Storage Service (Amazon S3), Amazon Elastic Compute Cloud (Amazon EC2) and Elastic MapReduce (EMR).
Java unit and integration test experience with frameworks such as Junit, Mockito, Testing.
Involved in the development of interfaces for the application using JSP, Servlets, and JavaScript.
Experience in developing Shell scripts and Python Scripts for system management.
Proficient in verbal and written communication and pragmatic team player.
Technical Skills
Hadoop Technologies
MapReduce, HDFS, Hive, Pig, Impala, Sqoop, Spark, Kafka, Flume, Oozie and Zookeeper
NOSQL databases
HBASE, Cassandra, MongoDB
Hadoop Distributions
Cloudera, Hortonworks, MapR
Programming Languages
C, C++, Python, Java, Scala, Shell scripting
Frame Works
Spring, Hibernate, Struts, EJB, JMS, JSF
Databases
Oracle, MySQL, Teradata, DB2, SQL Server
IDE/Tools
Maven, Version One, GIT HUB, Eclipse, Clear Case, Clear Quest
Platforms
Windows XP, 7, 8.1, Unix, Linux Centos, RHEL
Web/Application Servers
Web Sphere, Web logic, Helix, Tomcat
Professional Experience:
Sr.Hadoop Developer
Ameriprise Financial, MN Sep’15 to Present
Responsibilities:
Installed, configuring, and using Hadoop ecosystem components like Hadoop Map Reduce, HDFS, HBase, Oozie, Hive, Sqoop, Pig, Flume, Zookeepe, Kafka and Spark.
Proactively monitored systems and services, architecture design and implementation of Hadoop deployment configuration management, backup, and disaster recovery systems and procedures.
Efficient in writing MapReduce Programs and using Apache Hadoop API for analyzing the structured and unstructured data.
Created Sqoop jobs for both Historical and Incremental data migration from legacy systems.
Experience in transferring Streaming data from different data sources into HDFS and NoSQL databases using Apache Flume.
Used Hive to analyse the partitioned and bucketed data and compute various metrics for reporting on the dashboard.
Automated all the jobs for pulling data from FTP server to load data into Hive tables using Oozie workflows.
Created and maintained Technical documentation for launching HADOOP Clusters and for executing Hive queries and Pig Scripts.
Developed Pig Custom UDF's for custom input formats for performing various levels of optimization.
Experience in optimization of Map reduce algorithm using combiners and partitions to deliver the best results and worked on Application performance optimization for a HDFS cluster.
Developed Kafka producer and consumer components for real time data processing.
Loading Data into Hbase using Bulk Load and Non-bulk load.
Created Spark SQL jobs with various transformations and actions for data processing.
Created Spark jobs with RDD's, Pair RDD's, Transformations and Actions, Data Frames for Data transformation from relational stores.
Responsible for creating Hive tables using Partitions, Buckets, UDF's, HQL Scripts in landing layers for analytics.
Implemented Spark Streaming to read real-time data from Kafka in parallel and processed in parallel and save the result as parquet format in Hive.
Responsible for user stories creations, tracking and delivering as per sprint.
A fast Learner, smart worker and quick in adapting newer technologies.
Environment: Cloudera Manager, Hadoop, HDFS, Spark, MapReduce, Pig, Hive, HBASE, Sqoop, Oozie, Flume, Scala, Python, Java, XML, SQL Server.
Hadoop Developer
TransUnion, Chicago. March’14 to Aug’15
Responsibilities:
•Installed and benchmarked Hadoop HBase clusters for internal use.
•Provided a solution using HIVE, SQOOP (to export/ import data), for faster data load by replacing the traditional ETL process with HDFS for loading data to target tables.
•Hands on experience in implementing MapReduce Custom File Formats, Custom Writable and Custom Practitioners.
•Involved in collecting, aggregating and moving data from servers to HDFS using Apache Flume and Talend.
•Implemented custom interceptors for flume to filter data as per requirement.
•Hands on experience working with Hive data warehouse tool-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the Hive QL queries.
•Experience in writing Pig Latin scripts to sort, group, join and filter the data as part of data transformation as per the business requirements.
•All small files will be merged and loaded into HDFS using java code and tracking history related to merge files are maintained in HBASE.
•Implemented a script to transmit information from Oracle to Hbase using Sqoop.
•Created data ingestion plans for loading the data from external sources using Sqoop.
•Hands on experience in setting up workflow using Apache Oozie workflow engine for managing and scheduling Hadoop jobs using Oozie-Coordinator.
•Worked collaboratively with different teams to smoothly slide the project to production.
Environment: Hortonworks HDP-2.2 YARN cluster, HDFS, Map Reduce, Apache Hive, Apache Pig, HBase, Talend Studio, Apache Spark, Sqoop, Oozie, XML.
Hadoop Developer
First Citizen Bank, NC. Feb’13 to March’14
Responsibilities:
•Load and transform large sets of structured, semi structured and unstructured data.
•Involved in defining job flows, managing and reviewing log files.
•Expert in importing and exporting of data using Sqoop from HDFS to relational database system and vice-versa.
•Hands on experience in configuring and working with Flume to load the data from multiple sources directly into MongoDB.
•Worked on streaming log data into MongoDB from web servers using Flume.
•Responsible to write MapReduce Programs and using Hadoop API for analyzing the structured and unstructured data.
•Good understanding on various daemon processes like Job Tracker, Task Tracker, Name Node and Data Node.
•Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
•Expert in working with Hive data warehouse tool-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the Hive QL queries.
•Developed Pig Latin scripts using operators such as LOAD, STORE, DUMP, FILTER, DISTINCT, FOREACH, GENERATE, GROUP, ORDER, LIMIT, UNION, to extract data from data files to load into HDFS.
•Written HBASE Client program in Java and web services.
•Extending Hive and Pig core functionality by writing custom UDFs.
•Used Pig Latin scripts to extract the data from the output files, process it and load into HDFS.
•Participated in requirement gathering form the Experts and Business Partners and converting the requirements into technical specifications.
Environment: Hadoop, MapReduce, Hive, Pig, Shell Scripting, Eclipse, MongoDB, Sqoop, Kafka, Flume, Ambari, XML.
Java Developer
C2S Technologies, Hyderabad. Jul’12 to Jan’13
Responsibilities:
•Implemented project using Agile, scrum methodology. Involved in daily standup meeting, spring showcase and spring retrospective.
•Implemented Spring MVC framework which includes writing Controller classes for handling requests, processing form submissions and also performed validations.
•Designed and development of User Interface using HTML, JSP, JSP Custom Tag and AJAX .
•Implemented client side validation using JaveScript and Jquery.
•Implemented J2EE design patterns like Data Access Object and Business Delegate to handle the business flow.
•Extensively worked on Spring AOP and integrated the application using Spring dependency injection.
•Coded JUnit test cases to test the application and performed random checks to analysis the portability, reliability and flexibility of the project.
Used Log4J for tracking errors and debugging the code.
•Developed user interface Using JSP, JavaScript, HTML, CSS mapped to Spring Framework controller, to simplify the Application complexity and easy usage to User.
•Designed the code in STS (spring tool Suite), deployed the application VM-Ware server supported and maintained application in the production phase.
•Coded Junit, Pit coverage for the application in Enterprise level. Resolved the defects and made some changes to code to get App worked in the entire environment.
•Working on HPSM (HP service management) tool for incident management and resolving the Bugs in the production phase.
•Developed Java beans to be used by JSP pages for presenting web content.
•Worked with multithreaded custom framework similar to Spring-Batch using OSGI and caching (Dynamic and non Dynamic) to develop end of the day batch loaders.
Environment: Spring MVC, Oracle 10g, Hibernate, Restful Web services, My Eclipse IDE, Websphere Application Server, Java, JSP, HTML, JMS, Java script, JQuery, SQl, UNIX, DB2, JIRA, and Log4j.
Java Developer
ICICI Bank, Banglore. Jul’10 to June’12
Responsibilities:
Performed requirements analysis as per the client requirements.
Used Web Sphere for developing use cases, sequence diagrams and preliminary class diagrams for the system in UML.
Extensively used Web Sphere Studio Application Developer for building, testing, and deploying applications.
Used Spring Framework based on (MVC) Model View Controller, designed GUI screens by using HTML, JSP.
Developed the presentation layer and GUI framework in HTML, JSP and Client-Side validations were done.
Involved in Java code, which generated XML document, which in turn used XSLT to translate the content into HTML to present to GUI.
Implemented XQuery and XPath for querying and node selection based on the client input XML files to create Java Objects.
Used Web Sphere to develop the Entity Beans where transaction persistence is required and JDBC was used to connect to the MySQL database.
Developed the user interface using the JSP pages and DHTML to design the dynamic HTML pages.
Developed Session Beans on Web Sphere for the transactions in the application.
Utilized WSAD to create JSP, Servlets, and EJB that pulled information from a DB2 database and sent to a front end GUI for end users.
In the database end, responsibilities included creation of tables, triggers, stored procedures, sub-queries, joins, integrity constraints and views.
Proven ability to work with senior technical managers and staff to provide expert-level support for the installation, maintenance, upgrading, and administration of full-featured database management systems.
Environment: Java, WebSphere, Versata, Clear Case, Clear Quest, HTML, JAVA,J2EE, EJB, JSP, JavaScript, Servlets, Websphere, WSAD, Oracle, SQL, Web Services, SOAP, SDLC, Ant, Struts, Eclips, XML, RAD.
SQL Developer
NI-MSME, Hyderabad. Oct’09 to June’10
Converted Data Transformation Services (DTS) application to SQL server Integration services (SSIS) as assigned.
Developed DTS packages to extract, transform and load into the Campaign database from OLTP database using of SQL Server Integration Services (SSIS).
Designed dynamic SSIS Packages to transfer data crossing different platforms, validate data during transferring, and archived data files for different DBMS.
Experience in Extracting, Transforming and Loading (ETL) data from Excel, Flat file, Oracle to MS SQL Server by using BCP utility, DTS and SSIS services.
Perform unit testing at various levels of the ETL.
Worked on Migration of packages from DTS using SQL Server IntegrationService (SSRS).
Generating reports using SQL Reporting Services (SSRS) for customized and ad-hoc Queries.
Involved in Report writing according to business requirement using SSRS.
Generated database monitoring and data validation reports in SQL Server Reporting Service (SSRS).
Wrote Triggers and Stored Procedures to capture updated and deleted data from OLTP systems.
Designed and created the table schema and stored procedures that will be used in Data QC.
Daily support of system wide replication tasks including monitoring, alerting, and problem resolution.
Responsible for documentation of system related activities.
Setup replication within the sql databases.
Provides technical documentation of the system
Setup the database with suitable memory and hard disk space allocation, creating different user and security profiles for the team.
Environment: SQLServer2008, MS Access, Query Analyzer, DTS, BCP, MS Access, Load Runner, QTP and Win Runner, SQL Profiler, Import & Export Data, XML, Windows XP.
Contact this candidate