Data Pipeline Machine Learning

Manoj Ganger

Pleasanton, CA Ph: 408-***-**** LinkedIn/in/manojganger ***********@*****.***

https://medium.com/@manojganger Github.com/Manojganger Professional Summary

15+ years of professional experience in software development and data engineering, consistently delivering comprehensive end-to-end data pipeline solutions for multiple companies.

Adeptly assumed the role of Scrum Master, leading a substantial team of engineers to drive product and feature delivery in timely manner.

Have hands-on proficiency in constructing Data Platforms tailored to diverse business needs spanning multiple teams. I am proficient in constructing modern back-end systems, scalable data infrastructure, event-driven architecture, and other strategies to propose, design and implement data pipelines to meet user requirements. EXPERIENCE

Integration Appliance Inc, Palo Alto, CA

Sr Data Platform Engineer Feb ‘23 – May’23

• Designed schema and created data pipeline for SharePoint data for tableau dashboard to s3 and Redshift tables.

• Created data pipeline to extract Jira tickets (histories, changelog and issuelinks data) into redshift tables. Modeled the incoming json data into relational model as well as dimensional model.

• Created process to preserve versions of all redshift object definitions (stored procedure, View) into s3 for any disaster recovery.

• Created Jira ticket automation with outlook for managing stakeholder issues and effective update to various teams.

• Unified all data quality monitoring alerts in one place and deprecated older legacy and other customized alerts.

• Helped designed various processes to bring data into redshift, build snapshots and configured airflow for scheduling.

• Collaborated with product, engineering, research, and other functional experts to develop a shared, data-driven strategic vision for the company.

• Implemented RESTful architecture for ingesting data from NoSQL data sources using Python.

• Designed data quality alerts and monitoring on data pipeline across the Data platform to swiftly fix bugs and data anomalies.

• Implemented API integration with CRM system and other NoSQL databases like MongoDB for data consistency. USAA San Antonio, Texas

Consultant-Data modeling Mar ‘22 – Feb ’23

• Redesigned the Risk and compliance logical and physical data model to the next level of risks and controls regulatory requirements.

• Created and reviewed Data models along with ddl as per company standards for various teams. Creating logical and physical models along with definitions for entities.

• Helped Enterprise Money Movement team on Snowflake migration and data validation primarily by writing SQL queries.

• Implementing dbt statistics data model which can be incorporated by project teams in dbt based development.

• Designed and migration of ETL (DataStage 11.7 to DBT) and databases from Netezza to Snowflake.

• Implemented data lineage using Python and DataStax. SmartBiz Loans San Francisco, CA

Principal Data Architect Jun ‘21 – Mar ‘22

• Established Marketing Data Platform interfacing Salesforce, and 3rd party Lytics platform using Python and AWS Redshift.

• Modeled the data transformation and optimized way for synchronize data elements across different platforms in Python.

• Designed the star schema for Data warehouse using dimensional modeling for optimized read by Mode Analytics.

• Created DataMart’s for easy accessibility of data for data Analytics and Science team.

• Created data dictionary for loan process which helped all teams to understand data better.

• Designed the streaming data pipeline using AWS SQS for salesforce update as well as MySql and redshift transformation.

• Created a SQL based ETL tool in Python that can read and write to SQS, CSV, RDBMS and S3 for scaling up the data integration across multiple platforms.

• Designed the marketing opt-out preferences database for MailChimp platform, to act as a single source of truth.

• Evaluated different ETL tools like Pentaho, Qlik replicate for the use case of Data Synch and transformations.

• Generated revenue of around a million-dollar by analyzing transactions on credit pulls which company missed billing to Banks when SmartBiz did the credit check on the qualified loan applicants.

• Helped Talent Acquisition and Hiring Team for various Data Engineering and machine learning roles.

• Established Enterprise Architecture Standards on data governance and practices for scalable solutions PulseSecure San Jose, CA

Principal Enterprise Data Architect Aug 2020 – Feb ‘21

• Helped Cybersecurity VPN product company to streamline Booking Foundation Analysis and provided visibility to executives and finance teams.

• Created Data platform to eliminate excel data manipulation on Financial Reporting.

• Created a data archival strategy from hot to warm and cold storage of data automatically on time-based events.

• Enrichment of data extracted from NetSuite and Salesforce for performing KPI for RevOps, Sales, Marketing and FP&A.

• Helped team streamline their business process by leveraging the data pipeline for faster and accurate results.

• Liaison for UC Berkeley Interns for Data Science Project, specifically targeting the deal discount analysis and serverless architecture of data pipeline.

• Implemented machine learning models on the customer churn and also on tiered pricing and optimizing it to maximize the revenue of SaaS VPN products.

Blackhawk Network Pleasanton, CA

Senior Staff Data Engineer May 2012 – May 2020

• Provided never ending development support to Analytics platform for gift card company with many acquisitions.

• Designed schema in Netezza Databases as well as Redshift databases, namely date dimensions, master data hierarchies.

• Led the BI team for weekly or every other week releases using agile process. Conducted daily scrum for tracking and traction.

• Designed transformations tables to aggregate for YoY as well as YTD, MTD and weekly data aggregations.

• Designed views for pivoting tables for ease of reporting on Analytics platform on windows platform.

• Created a plug-in design for loading data on ad-hoc basis into Data warehouse for integration on natural keys.

• Converted DDLs for all the tables on Netezza to the next gen IBM DW appliance Sailfish (DB2).

• Designed the process to calculate SLAs on the shipments to keep track of deliveries at Card level as well as Order level.

• Designed Compliance solution for Financial Services needed for State regulators using Athena and custom Python code.

• Well versed with Python, Pandas, and advance big data concepts to enhance capabilities to the Analytics platform.

• Experience in migrating Netezza to IIAS (IBM Sailfish) for MicroStrategy Analytics Platform.

• Implemented machine learning model for Market Analysis to see the effectiveness of the marketing and seasonal discounting rate on the gift cards.

EDUCATION

Bachelor of Engineering, Computer Science

Netaji Subhas University of Technology (formerly, Delhi Institute of Technology) New Delhi, India TECHNOLOGY & SKILLS

• Python, Pandas, SQL, C#, C, PySpark, React.js, FastAPI, Flask, JavaScript

• AWS Cloud architecture, S3, EC2, lambda, Athena, Microstrategy Netezza, Redshift, Postgresql, data warehousing, Airflow, DBT, Glue, Snowflake, Pentaho, Informatica, Dockers, CI/CD automation, Git, Microservices

• Machine Learning: Market basket, sales threshold variations implementation to gain business insights.

Contact this candidate