Data Engineer
Resume:
Priyanka K
Senior Data Engineer
***************.****@*****.***
Houston, TX
Professional Summary
Data Engineer with 11 years of experience ensuring accuracy, completeness, and integrity of enterprise data across cloud and large-scale distributed systems. Experienced building SQL- and Python-driven validation and reconciliation frameworks for ETL/ELT and API workflows in Azure and Databricks environments. Proven collaborator with data engineering, product, and operations teams to embed quality into pipelines, instrument observability, and mentor engineers on test automation and data governance.
Technical Skills
Data Platforms & Cloud: Azure, Azure Data Factory, Azure Synapse, Azure Data Lake, Databricks
Data Engineering & Storage: SQL Server, PostgreSQL, MySQL, Data Lake Storage, ETL/ELT pipelines
Programming & Test Automation: Python (Pandas, NumPy), Core Java, Selenium, Playwright, Postman, Rest Assured, Jenkins, Git
Streaming & Messaging: Apache Kafka, Apache Spark, Hadoop
Data Quality & Validation: Data profiling, reconciliation, data completeness, data lineage validation, data quality scorecards
Monitoring & Observability: Datadog, Dynatrace, Kibana, Quantum Metric
BI & Reporting: Power BI (DAX, Power Query), Tableau, Excel (VBA, PivotTables)
Methodologies & Tools: Agile / Scrum / SAFe, JIRA, Zephyr, Azure Boards
Work Experience
Data Engineer
United Airlines, Houston, TX Apr 2023 - Present
•Built end-to-end ETL pipelines to ingest flight operations, booking, and maintenance data from REST APIs, streaming data sources, and relational databases, processing 5M–10M+ records daily and reducing data latency by 35%
•Designed and implemented a medallion architecture (Bronze/Silver/Gold), transforming raw unstructured data into analytics-ready datasets, improving query performance by 40%
•Optimized SQL queries (joins, window functions, aggregations) across large datasets (10M+ rows), reducing execution time and improving dashboard refresh performance
•Designed dimensional data models (star schema, fact/dimension tables) for flight operations and customer analytics datasets, improving query simplicity and reducing analytical complexity by 30%
•Designed and enforced data quality frameworks (completeness, accuracy, consistency, timeliness) across workforce data pipelines, reducing data defects and downstream reporting errors by proactively catching issues at ingestion stage
•Integrated pipeline monitoring and alerting using tools like Datadog/Kibana to proactively detect data anomalies
•Built automated data validation pipelines using SQL and Python to perform source-to-target reconciliation, anomaly detection, and schema validation, eliminating manual QA effort and improving trust in reporting datasets
•Validated enterprise data pipelines supporting retail, booking, and payment systems, ensuring data accuracy, completeness, and consistency across distributed systems
•Embedded governance controls within ETL pipelines, including data standardization, validation rules, and lineage tracking to improve data traceability
•Defined and implemented data quality rules, thresholds, and scorecards in collaboration with business stakeholders, enabling continuous monitoring of data health and establishing accountability for data integrity across teams
Data Engineer/Analyst
Archetype Solution Group, Hyderabad, India December 2019 - April 2023
•Designed interactive Power BI dashboards to track employee engagement, benefits utilization, and workforce productivity metrics, enabling leadership to identify gaps and improve organizational effectiveness, contributing to a 15% increase in program adoption
•Translated business requirements into scalable SQL-based data transformations and reporting logic
•Implemented data validation and reconciliation processes (null checks, duplicates, referential integrity), improving data accuracy by 25%
•Built and optimized SQL queries to extract, clean, and validate HR and benefits data, improving accuracy of employee records and reporting by 25%
•Enforced data access controls and standardized data handling practices to support governance of sensitive HR datasets
•Designed logical data models for workforce analytics, enabling efficient querying and simplifying reporting structures
•Partnered with HR and consulting teams to analyze employee satisfaction, retention trends, and program effectiveness, uncovering opportunities to enhance benefits offerings and reduce turnover by 12%
•Automated recurring reports on workforce analytics, benefits performance, and employee development metrics using SQL and Excel, saving 8 hours per week and improving decision-making speed
•Developed reusable Python-based data processing and validation modules integrated into ETL pipelines
Quality Engineer
Deloitte Consulting, Hyderabad, India July 2018 - December 2019
•Directed QA efforts for cloud-based SaaS products, ensuring system reliability and regulatory compliance while defining QA KPIs and release criteria
•Led QA analysts responsible for functional testing, API validation, and automation coverage; coached team on test design and automation best practices
•Developed test strategies, regression suites, and quality metrics supporting Agile delivery cycles and cross-team collaboration
•Created and maintained realistic test data sets for effective quality assurance testing and source-to-target validation
•Coordinated multi-system integration testing across third-party platforms and APIs, validating end-to-end flows and data integrity
•Implemented automation frameworks and API test suites using Playwright and Postman, and incorporated contract-style API validations to increase release confidence
•Managed defect lifecycle and QA reporting through JIRA and Zephyr, providing actionable quality insights to stakeholders
Senior QA Representative
Dell, Hyderabad, India October 2016 - July 2018
•Led a team of 18 validating Dell’s Manufacturing Support System responsible for converting returned systems into refurbished units
•Executed automation migration by transitioning legacy OATS scripts to Selenium-based frameworks, increasing automation maintainability and coverage
•Directed QA efforts for cloud-based SaaS products, defining QA KPIs and release criteria to improve product reliability
•Led QA analysts responsible for functional testing, API validation, and automation coverage; coached team on test design and automation best practices
•Developed test strategies, regression suites, and quality metrics supporting Agile delivery cycles and cross-team collaboration
•Created and maintained realistic test data sets for effective quality assurance testing
•Coordinated multi-system integration testing across third-party platforms and APIs, validating end-to-end flows and data integrity
•Implemented automation frameworks using Playwright and Postman, increasing automated coverage and release confidence
•Managed defect lifecycle and QA reporting through JIRA and Zephyr, providing actionable quality insights to stakeholders
Quality Analyst
Global Logic, Hyderabad, India July 2015 - October 2016
•Performed end-to-end functional testing and backend validation using SQL, improving production data accuracy
•Validated data accuracy supporting Google Maps imaging and mapping systems
•Implemented effective data management strategies to support quality assurance testing and analysis using TDH tool
•Applied leadership experience to mentor and develop quality assurance staff, fostering a culture of continuous improvement
•Collaborated with engineering and product teams to ensure quality standards across Agile release cycles and maintained defect triage processes for swift resolution
Education
•B.Tech in Information Technology
Jawaharlal Nehru Technological University, Andhra Pradesh, India - 2015
Contact this candidate