Azure Data Engineer

Indrani Kattamuru

716-***-**** ****************@*****.*** https://www.linkedin.com/in/indranik/

EXPERIENCE

ANDMORE June 2024 - Present

Data Engineer

• Developed and optimized data pipelines handling over 10M records, using Azure Data Lake Gen2, Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Snowflake, Python, and no-code ETL tools (Airbyte, Fivetran) to integrate CRM, App Center, and HubSpot data.

• Designed Fabric pipelines using Fabric Notebooks (PySpark) to ingest data from Microsoft D365 and Couchbase, stored in Delta format, and created Snowflake external tables using stage; integrated alerting and DBT job triggers for model execution and monitoring.

• Performed data modeling and transformations in Snowflake using DBT and SnowSQL, improving query performance by 25% and reducing data load times by 20%.

• Migrated Airflow DAGs from VM-based to Fabric Airflow, improving scalability, and enabling seamless CI/CD integration.

• Implemented real-time analytics by streaming operational and customer interaction data via Kafka into Azure Databricks Delta Live Tables, delivering instant insights through Power BI dashboards. Improved data freshness by 70%, enabling business teams to respond proactively to trends and optimize outcomes during high-volume events.

• Built automated ingestion and processing pipelines for external APIs (Apple App Store, Freshbooks) using Azure Databricks with Spark and Python, handling over 500K daily transactions and resulting in a 40% increase in reporting efficiency. Implemented Type 2 SCDs to track changes from Freshbooks web API, reducing manual data processing time by 30%.

• Monitored and optimized cloud resources, cutting storage costs by 15% through efficient use of Snowflake external tables and batch processing while maintaining 99.9% data availability. Third Estate Ventures August 2023 – May 2024

Data Engineer

• Built robust data pipelines integrating real estate data sources like property databases and GIS, including extraction from Salesforce API for dataset updates, enhancing data accessibility and accuracy for analysis and reporting, using SQL and Python.

• Optimised data synchronization between Snowflake and Salesforce, achieving a 40% improvement in data transfer speed by optimizing data pipelines, ensuring efficient and robust data integration.

• Developed 10+ Tableau and Power BI dashboards, by integrating them with Snowflake, offering data-driven recommendations. Accenture June 2019 – Jan 2022

Data Engineer

• Designed a modular ETL orchestration framework using Azure Data Factory, Databricks (SQL, PySpark), enabling scalable ingestion and transformation across diverse file formats and improving data reliability. Integrated Power BI with Databricks for real-time reporting, boosting data accessibility by 30%.

• Engineered automated deployment scripts with PowerShell and ARM templates, reducing ADF deployment time by 90% and embedding automation into CI/CD pipelines, significantly enhancing delivery speed and consistency.

• Monitored and optimized data pipelines using ADF logging, achieving 25% faster processing, with early detection and resolution of bottlenecks that ensured timely, accurate data delivery and enabled 10% revenue impact through faster decision-making. Associate Software Engineer

• Performed data analysis across Salesforce, social platforms, and third-party APIs using SQL, Python, and Alteryx, uncovering customer segments and behavioral trends that drove targeted marketing strategies and campaign effectiveness.

• Developed 10+ interactive Tableau dashboards, streamlining business operations and improving response time to critical issues by 25%, while enhancing visibility into key performance metrics.

• Executed A/B testing and predictive analytics using Google Analytics, SQL, and Python, leading to 10% customer growth by optimizing multichannel marketing campaigns and informing strategic KPIs. EDUCATION

Master of Science in Data Science, University at Buffalo, State University of New York June 2023 Bachelor of Technology in Electronics and Telematics, Jawaharlal Nehru Technological University May 2019 SKILLS

Programming Languages & Databases - Python, SQL, R, SOQL, Apex, MySQL, SQLite, PostgreSQL, DynamoDB Big Data Technologies and Cloud Services - Hadoop, Spark, PySpark, Snowflake, Azure Data Factory, Azure Databricks, Salesforce Data Visualisation Tools – Tableau, Power BI, Google Data Studio ML Libraries - Numpy, Pandas, Scikit-learn, Matplotlib, Seaborn, Tensorflow, Keras, Pytorch Tools/Technologies - Jupyter Notebook, Apache Airflow, Apache Kafka, Matlab, Github, JIRA, Streamlit, Flask, Selenium, Confluence CERTIFICATIONS

Microsoft Certified: Fabric Analytics Engineer Associate

Contact this candidate