Data Developer
Resume:
Shiv Racharla
***********@*****.*** • linkedin.com/in/shiv-racharla-624087a4 • github.com/Shiv-Racharla
Big Data Architect
Strong track record of success creating big data solutions for key business initiatives
in alignment with analytics architecture and future state vision.
Seasoned information technology professional skilled in business analysis, business intelligence, data modeling, data architecture, and data warehousing. Proven ability to deliver on organization mission, vision, and priorities. Extensive hands-on experience leading multiple data architecture projects, gathering business requirements, analyzing source systems, and designing data strategies for dimensional, analytical, transactional, and operational data systems.
Core Competencies:
Systems/Software Engineering
Requirements Analysis
Database Development
Blockchain Programming
CI/CD implementation
Agile Methodologies
Machine Learning/Deep Learning
Business Development
Leadership/Team Training and Support
Project/Vendor Management
Professional Experience
Xylo Corporation, Neptune, NJ
Architect/Lead, 10/2016 – Present
Clients: Bank of America, CUNA Mutual, Anthem, Inc, Microsoft, Fannie Mae
Performed complex UPSERTS with Kudu, MongoDB, Hudi, DeltaLake for large data volumes derived from various sources; process large-scale electronic medical and financial records, data sets for daily and monthly stored data in Amazon S3, Redshift, HDFS, and Blob Storage. Develop predictive modeling using machine learning algorithms such as linear regression, logistic regression, and decision trees. Develop and design extract, transform, load (ETL) applications using big data technology and automate using Oozie, Control M, Autosys, and shell scripts. Utilize Jenkins, Bamboo, Azure, AWS to continue integration for project and code to build before deployment. Set up and run data ingestion using Streamsets and Nifi for various data formats and sources. Mentor and supervise on-site employees and outsourced/off-site personnel; write and update guidelines and protocols for teams to complete objectives.
Select Accomplishments:
Solely built Lambda and Kappa Architecture and solutions for on-premise (cloudera, hortonworks), hybrid(cazena), on-cloud (AWS, Azure); also designed API which connects to MongoDB as source for both on-premise and on-cloud.
Transformed unstructured data into structured data with Apache Spark, utilizing data frame and querying from other data sources to S3, Redshift, Hive, Impala, Kudu, Hudi and MongoDB.
Built Ethereum blockchain and deployed smart contracts in private network; also built application with hyper ledger fabric using hyper ledger composer in Bluemix.
Conceptualized and created models using machine-learning regression techniques.
Built Build and Release pipelines to automate the deployment process for CI/CD and orchestrated using Docker and Kubernetes.
MatlenSilver, Inc, Charlotte, NC
Hadoop Developer, 7/2015 – 10/2015
Client: Bank of America
Led capacity planning of Hadoop clusters based on application requirement. Guided several Hadoop clusters and other services of Hadoop Ecosystem in development and production environments. Contributed to evolving architecture of company services to meet changing requirements for scaling, reliability, performance, manageability, and pricing. Developed, designed, and automated ETL applications utilizing Oozie workflows and shell scripts.
Select Accomplishments:
Created sentry policy files for business users in development, user acceptance testing, and production environments to provide access to required databases and tables in Impala; also designed and incorporated security processes, policies, guidelines for accessing cluster.
Converted copybook files from EBCDIC ASCHII, binary formats; stored files in HDFS; created Hive tables to decommission mainframes to make Hadoop primary source for export to mainframes.
Elite IT Solutions, Inc., Springfield, IL
Software Engineer, 5/2013 – 6/2015
Clients: Cerner Corp, Premier Inc., First Data Corporation
Pulled data from Relational Database Management System (RDBMS) such as Teradata, Netezza, Oracle, and MySQL utilizing Sqoop; stored data in Hadoop Distributed File System (HDFS). Utilized shell script to developed and deployed internal tool for comparing RDBMS and Hadoop such that all data located in source and target matched. Created external Hive tables to store and run queries on loaded data.
Select Accomplishments:
Architected, implemented, and tested data analytics pipelines with Hortonworks/Cloudera.
Implemented partitioning and bucketing techniques for external tables in Hive, improving space and performance efficiency.
Prior Experience as Java Developer (7/2006 to 12/2010) and as Network Administrator Associate (6/2002 to 5/2006) for Ashvamedh Services, India.
Technical Proficiencies
Big Data Technologies:
HDFS, MapReduce, YARN, Hive, Pig, Sqoop, Impala, Oozie, Flume, Zookeeper, Kafka, Nifi, HBase, MongoDB, Stream sets, Talend, Splunk, Kibana, Logstach, Elastic Search, Kudu
Spark Components:
Spark, Spark SQL, Spark Streaming, and Spark Mlib
Cloud Services:
AWS, S3, EBS, EC2, VPC, Redshift, EMR, Azure, Cloud Front, Glue, Athena, Hudi, API Gateway
Artificial Intelligence:
Machine Learning, Deep Learning, TensorFlow, Scikit, Learn, Sage Maker, Keras, PyTorch
Blockchain:
Ethereum, Cardano, R3, Hyper Ledger, Smart Contract
Programming Languages:
Java, Python, Scala, R, Solidity
Scripting/Query Languages:
Devops:
Unix Shell scripting, SQL and PL/SQL
Jenkins, Bamboo, Azure, AWS, Docker, Kubernetes, Hem, Astronomer
Databases:
Oracle, MySQL, SQL Server, Netezza, Teradata
Web Technologies:
JSP, Servlets, JavaBeans, JDBC, XML, CSS, HTML, JavaScript, AJAX, SPSS
Other:
Devops:
Maven, Eclipse, Pycharm, RStudio, Juypter, Zeppelin, Tableau, GitHub, Bitbucket, Jira, TFS, VSTS, Autosys, Control M, Airflow
Education and Credentials
Master of Science in Technology, Concentration in Computer Technology (2012)
Eastern Illinois University, Charleston, IL
Certifications
Apache Spark Developer (Databricks)
AWS Solutions Architect Associate (Amazon)
HDP Certified Developer (Hortonworks)
Machine learning (Udacity)
Blockchain Essentials (IBM)
Python for Data Science (IBM)
Docker Essentials (IBM)
Deep Learning (IBM)
Contact this candidate