Data Engineer Business Intelligence

SUMMARY

KYANAM DINESH

Overland Park **************@*****.*** +1-913-***-**** LinkedIn

Data Engineer with 4+ years of experience designing and managing large-scale data pipelines, cloud architectures, and real-time streaming solutions across healthcare, retail, and enterprise domains. Skilled in AWS, Azure, Snowflake, Delta Lake, and Hadoop ecosystems with expertise in ETL/ELT, Apache Airflow, PySpark, and Kafka. Strong background in data warehousing, compliance reporting automation, and performance optimization, enabling advanced analytics, predictive modeling, and business intelligence initiatives.

WORK EXPERIENCE

Walgreens

Data Engineer

United States

May 2025 – Present

• Designed and implemented end-to-end data pipelines on AWS and Azure, integrating structured, semi-structured, and unstructured data sources into Snowflake and Delta Lake.

• Deployed real-time streaming architectures using Apache Kafka and Spark Structured Streaming, enabling analytics dashboards with sub-second latency.

• Automated orchestration workflows with Apache Airflow, reducing pipeline failures by 35% through enhanced monitoring and retry mechanisms.

• Partnered with data scientists to productionize machine learning models, embedding them into ETL pipelines to support predictive analytics.

TCS

Data Engineer

Hyderabad

Mar 2022 – Jul 2023

• Developed and deployed scalable data pipelines for a major healthcare client, processing 500GB+ of clinical data daily, ensuring data integrity and availability for critical hospital operations.

• Optimized data storage solutions in SQL Server and Hadoop ecosystems, achieving a 25% reduction in storage costs and a 40% improvement in data retrieval speeds for analytics.

• Configured Docker containers with AWS ECS, conducted analytics using AWS Athena, optimized Snowflake data warehouses for large-scale data management, and created AWS Lambda functions to orchestrate ECS containers.

• Enhanced data warehousing workflows, streamlining data flows and enabling deployment of a real-time analytics dashboard accessed by 3,000+ healthcare professionals.

• Automated compliance reporting for federal healthcare regulations by developing SQL scripts and Python applications, reducing manual effort by 70% and ensuring 100% reporting accuracy. Capgemini Technology Services Limited Hyderabad

Data Engineer Mar 2020 – Mar2022

• Streamlined data processing workflows by implementing PySpark optimizations for data transfer and Hive-based storage, improving integration and scalability in high-volume environments.

• Designed and refined Tableau visualizations for business intelligence, reducing decision-making time by 30% through efficient Hive Query reports on large datasets.

• Developed data models and data dictionaries to improve data quality and integration, leveraging SQL and Python to enforce best practices in data management.

• Re-engineered data transfer protocols using PySpark, enhancing data processing efficiency by 30% and supporting high- volume workloads.

• Collaborated with cross-functional teams to resolve data-related issues, ensuring data consistency and accuracy in reporting to support strategic business initiatives. TECHNICAL SKILLS

Programming & Scripting: Python, SQL, R, Shell Scripting Data Engineering & ETL: Apache Airflow, SSIS, Informatica, DataStage, PySpark Databases & Data Warehousing: SQL Server, MySQL, Snowflake, Teradata, MongoDB, Hive Big Data & Cloud Platforms: Hadoop, AWS (EC2, S3, Lambda, RDS, ECS, Athena), Azure Data Formats & Processing: JSON, XML, Pandas, NumPy, Matplotlib, SQLAlchemy Visualization & BI Tools: Tableau, Power BI, Advanced Excel (Pivot Tables, VLOOKUP) Containerization & CI/CD: Docker, Kubernetes, Jenkins, Maven, Gradle EDUCATION

University of Central Missouri Warrensburg, MO

Master’s in Computer Science Aug 2023 – May 2025

Gandhi Institute of Technology and Management Visakhapatnam, IN Bachelor of Technology in Computer Science Engineering Aug 2017 – May 2021

Contact this candidate