Post Job Free

Resume

Sign in

Data Engineer Processing

Location:
Medway, MA
Posted:
February 15, 2024

Contact this candidate

Resume:

RISHI PRATAP YADAV

Medway, MA • 248-***-**** • ad3noy@r.postjobfree.com • https://www.linkedin.com/in/rishipratapyadav/ SUMMARY

• Experienced lead data engineer with more than 15 years of expertise in SQL, Snowflake, Tableau, DBT, Qlik Sense, Power BI, Python, R, Java, GCP Big Query, RDBMS, JSON, XML, and Message Broker.

• Proficiently developed and automated ETL pipelines to efficiently transfer data from Db2 to Snowflake, utilizing SQL, DBT, Talend, Python, and Java for tasks such as data mapping, validation, and cleansing. Demonstrated skill in Python libraries like NumPy and Pandas for effective data processing.

• Leveraged GCP's Big Query and Dataflow to manage large-scale real-time and batch data processing, catering to diverse enterprise use cases.

• Produced reusable and ad-hoc reports, as well as dashboards employing SQL, Snowflake, Tableau, and Qlik Sense offering valuable data insights for informed decision-making and strategic planning.

• Expertise in crafting optimized SQL queries and creating impactful business intelligence through multiple visualization platforms, specializing in data modeling, analysis, and data mining. Employed normalization and denormalization techniques in data modeling to enhance storage efficiency, maintain data consistency, and minimize redundancy.

• Orchestrated the migration of a money transfer system from a Java-based application to an IBM Message Broker-based platform to enhance speed and performance.

• Designed and developed enterprise software applications to expand insurance products for the senior citizens' market, utilizing Java/J2EE for high-volume, high-performance solutions. Possesses a robust understanding of Object-Oriented Programming, OOAD Design Patterns, Database Design, ER Diagrams, Algorithms, and Data Structures. Proficient in creating UML Design diagrams using Rational Rose for Java enterprise applications.

• Constructed metric-driven interfaces enabling small to mid-size organizations to monitor store performance, integrate business functions, enhance productivity, and elevate customer service.

• Engaged in project management activities such as proposal creation, planning, execution, monitoring, tracking, defect management, traceability, and on-time, budget-compliant project delivery. Managed offshore teams through streamlined communication processes, ensuring alignment of requirements, task priorities, and scope.

• Leverages a background in engineering and business to facilitate collaboration across diverse teams. Core Competencies:

• Data Engineering * SQL

• Data Visualization * Data Analysis

• Data Architecture * Stakeholder Management

• Data Storytelling * ETL Data Pipeline

TECHNOLOGIES

Data Analysis: SQL, Talend, Snowflake, Python, Google Big Query, R, KNIME, Google Analytics Visualization Software: Power BI, Qlik Sense, IBM Cognos, Tableau, Sigma Language: Java, J2EE, Servlets, Struts, Spring, Spring Boot, Hibernate, Web services, IBM Message Broker, Other Software: Eclipse, git, Jira, R-Studio, XML, WebSphere, GCP, Excel, DB2, Oracle, dbt, PostgreSQL Design: OOAD Design Patterns, Database Design, ER Diagram, Algorithms and Data Structures EXPERIENCE

360Insights, Dedham, MA Oct 2023 – Till date

Sr. BI Developer

• Created BI Dashboards in Qlik Sense and Sigma. Build ETL pipeline using SQL, Snowflake, Qlik CLI. Create Qlik Monitoring apps to health check of Qlik servers. Zebra Technologies; Dedham, MA June 2018 – Aug 2023 Sr. Data Analyst

• Created the data warehouse (250+ TB) in Snowflake to consolidate data from 3 data centers. Built 25 ETL data pipelines using SQL, Talend, DBT, Python, and Java resulting in a 30% reduction in data processing time and a 20% improvement in data accuracy. Designed star data model for dimensional tables and denormalized and pivoted a few tables to improve the performance and align with warehouse infrastructure.

• Led the design and implementation of a GCP cloud storage infrastructure, resulting in a 40% reduction in data storage costs and optimized SQL.

• Designed 8 analytical workflows using downstream SQL, DBT, SnowSQL, and data pipeline (ETL) to automate data mart generation and enable self-service analytics. This reduced the manual efforts by 65%. Developed an array of reusable software tools and techniques to apply routinely for the company’s customer service initiatives.

• Conducted performance tuning and optimization of SQL queries analyzing query execution plans, and indexing strategies on Snowflake. Developed and maintained data integration processes and data pipelines using SQL and ETL tools, ensuring smooth and automated data flows between systems and data sources.

• Implemented data security measures, such as data encryption, role-based access controls, and data masking, using SQL techniques and database security features, to protect sensitive data during migrations and integrations.

• Built analytics model to predict store traffic change impacted by weather and vehicle traffic for Sally Beauty and Vera Bradley. It seems counterintuitive, but certain extreme weather situations lead to positive outcomes. Tourism and beach stores benefit from extreme weather events like heavy rainfall. Travelers who are unable to engage in outdoor activities shift their focus to indoor shopping and entertainment options. This helped them to plan their workforce and increased sales by 15%.

• Built a data model to illustrate the correlation between user logins and task completion for the Advance auto part. Also, built a model for day-of-week and hour-of-day analysis for store employees, when to complete tasks at the computer vs. being on the store floor during peak hours. Balancing between working on computers and being on the store floor is crucial for retail store employees, it depends on the analysis of customer foot traffic, sales volumes, and purchasing patterns at different times of day.

• Constructed metric-driven interfaces (KPI) enabling retail stores to monitor store performance. Shrinkage metrics analysis for Hannaford encompasses the loss of inventory due to damage, theft, or error. This helps Hannaford to improve the bottom line, enhance customer satisfaction, and ensure the accuracy of inventory.

• Sales vs. traffic analysis for Macy’s to showcase that the Macy’s mall stores and individual stores behave differently and are in different segments.

• Using unassigned shifts analysis, developed a model to help Kohl’s hiring team hire people with the required skill sets needed to fill the unassigned shifts. This includes data on employee skill sets, schedule shifts, employee availability, skill development strategy, and hiring strategy to ensure optimal employee utilization.

• Led end-to-end development of 20+ visualization products providing insights to 110 customers using Reporting BI tools (Tableau, Power BI, Qlik Sense) and SQL, Talend, aggregate tables, and views.

• Provided 10+ KPIs, analyzed metrics, and generated reports for executive management for 10 Zebra products, their usage by customers, and measured the ROI of Zebra products to make strategic business decisions. This increased the usage of products by 20%.

• Provided training to 50 customers to use the analytics tools, and ETL data pipeline that resulted in an increase of 30% adoption rate and helped to continue the business. This involved the development of product manuals to streamline application usage for the onboarding of customer team members. Accenture; Pune, India Sep 2014 - July 2016

Team Lead

• Standardized operations through designing and developing middleware applications for cable television subscribers to provide video functionality, using Java, SQL, Data Modeling, and Spring/ Hibernate Framework.

• Conducted performance benchmarking and optimization exercises, analyzing SQL execution plans and query performance metrics, and making recommendations to improve SQL code efficiency and database performance.

• Developed the web service to allow modular development, testing framework, and the addition of new services on top of a standard platform of reusable services and an underlying database.

• Augmented performance through developing the testing framework utilizing the Citrus framework for automation of test case executions and to capture the issue at the early stage of development. Opus Software Solutions; Pune, India Sep 2011 - Sep 2014 Lead Development

• Adapted and facilitated CMMI 5 standards within the project and at the organization level.

• Migrated existing money transfer system from Java, SQL platform to message broker platform.

• Supported the routing of messages by developing the channel integration services (such as fee inquiry, sending money, loyalty services, and bill payment) for the money transfer system.

• Streamlined operations by performing requirements analysis and effort estimation, creating a wide array of design documents, and spearheading efforts to optimize the SQL used across all business workflows.

• Received an award for outstanding commitment to quality in the software development process. Wipro Technologies; Pune, India Dec 2010 - Sep 2011 Technical Lead

• Secured a $150,000 contract by expanding insurance projects, focusing on the senior market.

• Managed projects by effectively creating work breakdown structures, project estimation, monitoring and tracking, traceability matrices, and weekly and monthly status reports.

• Received an award for leveraging excellent contributions in managing the advisor portal team. Reflexis Systems; Pune, India July 2006 - Dec 2010

Lead, Product Development

• Saved 4% in labor costs for the store’s overall management processes by building a model to forecast daily customers and plan labor using queuing algorithms and predictive modeling.

• Built a metric-based interface that enables retailers to effectively monitor the performance of their stores and define the product direction and roadmap to drive product excellence.

• Built data load utility using Java, and SQL have the capability to extract, transform, and load (ETL) data from multiple sources(xls, csv, APIs) to Db2 database to be used for metric-based application.

• Optimized communication by collaborating with developers, QA, and product owners to prioritize requirements and produce high-quality software and interviewed candidates for team formation. EDUCATION

Babson College, Boston, MA 2018

Master of Business Administration, Business Analytics Birla Institute of Technology & Science, Pilani, India 2005 Master of Engineering, Software Systems

Institute of Engineering & Technology, Lucknow, India 2002 Bachelor of Technology, Computer Science



Contact this candidate