Quality Assurance Data Engineer

Mustak Ahmad

************@*****.*** -- 914-***-****

Dedicated IT professional with expertise in Data Engineering and Data Quality Assurance. Strong analytical and conceptual problem-solving abilities as well as high proficiency in Data Architecture and Business Intelligence

WORK EXPERIENCE

Federal Reserve Bank of NY, NYC (client)

K-Force (employer)

Databricks / QA / Sr. Data Engineer May 2024 - Present

● Part of the Fed’s Data Engineering Research, Enable Data Discovery and RSSD Data modeling/design teams

● Working on on-prem migration projects to Databricks (AWS cloud)

● Developed 20 data ingestion pipelines in Databricks, coordinating data quality assurance automation as part of the data migration project

● Support Collibra platform, data refresh, data analysis etc

● Responsible for developing and maintaining enterprise Microsoft SQL Server ER/DW data models using Idera ER Studio, SQL Server Management Studio and others Consumer Reports, Yonkers, NY

Databricks / QA / Data Engineer February 2022 - May 2024

● Part of the Data Engineering Research, Testing and Insight Team (RTI)

● Coordinating data quality assurance as part of the data migration project from Snowflake/AWS to Databricks/Oracle

● Building a completely automated tool that compares and validates Snowflake Data and Databricks Delta Lake tables

● Developed Extract Transform and Load (ETL) in AWS Step functions using related technologies such as Lambda function, Glue Job, Python, CloudWatch & S3

● Developed complex views and procedures to support lab data ingestion (LabView) automation to Snowflake

● Led efforts to improve business applications and business technology processes through rigorous data collection and analysis

● As part of the Consumer Reports category onboarding, designed and developed the LabView data ingestion schema in Snowflake, adhering to category structures including LANDING, STAGE, CURATED, and Data Intelligence (DI) databases/schemas. Enhanced the CURATED normalized schema as well as the DI schema. Additionally, worked on designing and developing Consumer Reports Survey schemas as part of the onboarding processes.

● Currently, as part of Consumer Reports' migration project from Snowflake to Databricks, I worked on designing Unity Catalog Delta Lake tables, live tables (auto-loader), materialized views, and other schema components.

Databricks / QA / Data Engineer April 2021 – February 2022

● Part of the Data Engineering CORE Team

● Designed and developed QA automation scheduled jobs for both CR's Cars and Products Application Programming Interface (API) data service in Python, Dockers and Jenkins pipeline

● Worked closely with senior management to scope and build new features and applications which enabled 100% year over year revenue growth

● Led efforts to improve business applications/technology processes through rigorous data collection and analysis

● Supervised and managed relationships with external vendors and advisers Mustak Ahmad

************@*****.*** -- 914-***-****

Team Leader January 2012 – March 2021

● Part of Data Engineering CORE Team

● Designed and developed

● CR's Data Management Systems and API data services for both Cars and Products in Angular, Java Spring Data, Oracle and MongoDB

● CR's ETL jobs to ingest data from various vendors

● CR's S3 buckets migration (data lake), RTI category maintenance in Databricks using Scala programing language

● CR's legacy Data Management Systems in Oracle APEX and Oracle Database, Oracle Data Modeling Design and Data Migration

● CR's CDH (Consumer Data Hub) systems in AWS Redshift

● CR's legacy Data Management Systems in Oracle Forms, Oracle Reports and Oracle Database

● Implemented a Master Content Repository (MCR) data management system by consolidating multiple denormalized database systems into a single unit, improving data accuracy and governance across the organization.

● Supervised a team of 4 internal IT software engineers, 5 consultants and managed relationships with external vendors and advisers

● Documented and analyzed current state business processes and underlying systems to identify and measure potential areas of improvement

● Worked closely with the product management team to scope customer requested features and determine which features would provide the highest return on investment

● Used Scrum methodologies to ensured that the software development team had the resources to meet deadlines and escalated roadblocks to management when necessary Senior Database Programmer and Business Analyst November 2002 - December 2011

● Designed and developed CR's legacy Data Management Systems in Oracle APEX and Oracle Database, Oracle Data Modeling Design and Data Migration

● Worked closely with the business to understand problems and proactively implement solutions to solve those problems

● Documented and analyzed current state business processes and underlying systems to identify and measure potential areas of improvement Oracle Database Administrator September 1999 - October 2002 Installed, patched, maintained and monitored Oracle databases

● Created and maintained SQL and PL/SQL queries and shell scripts

● Monitored, and verified backups and perform ad-hoc backups

● Provided maintenance support for database systems EDUCATION

Hunter College, City University of NY

Major: Economics

PLATFORM AND PROGRAMMING LANGUAGES

GitLab; GitHub; Starburst, SQL; Snowflake; Python; Databricks; MongoDB; AWS Redshift; Java; Docker; Jenkins; Oracle; PL/SQL; PostgreSQL; AngularJS; Tableau; Git; Unix; Agile Methodologies; Amazon S3; Terraform; Collibra; Idera ER Studio; MS SQL Server Management Studio

Contact this candidate