Data Engineer Azure

Guruprasadreddy Desam

Data Engineer

+1-913-***-**** *************@*****.***

PROFESSIONAL SUMMARY

Data Engineer with 3+ years of experience designing and implementing scalable data pipelines and cloud-native solutions. Proficient in Python, SQL, and ETL/ELT development, with expertise in AWS and Azure for data integration, transformation, and optimization. Skilled in automating workflows, improving data quality, and enabling real-time analytics to support business decision-making.

TECHNICAL SKILLS

• Programming And Scripting Languages: Scala, Python, SQL, Java.

• Databases: Oracle, MySQL, PostgreSQL, Snowflake.

• ETL Tools: SSIS, Azure Data Factory, AWS Glue.

• Bigdata Technologies: Spark, Hadoop, Hive

• Reporting Tools: Power BI, Tableau, Excel.

• Azure Services: Azure Blob Storage, Azure Synapse Analytics, AKS, Azure SQL.

• AWS Services: S3, RedShift, EC2, EMR, IAM, Lambda, Kubernetes.

• DevOps And Agile Tools: Git, Jenkins, Jira, Bit Bucket, SonarQube, Confluence. EDUCATION

Masters in Computer Science

University of Central Missouri 08/2022-05/2024

B. Tech in Electronics & Communication

Engineering

KL University 07/2016-05/2020

PROFESSIONAL EXPERIENCE

Client: Link well Solutions.

Role: Data Engineer

Duration: Aug 2024 – April 2025

Location: Texas, USA

Responsibilities:

• Migrated on-premises and cloud data warehouses into a unified Azure Synapse Analytics platform for a leading financial services firm, enabling scalable and secure data management for shipment tracking, delivery optimization, and regulatory compliance.

• Developed ETL/ELT pipelines using Azure Data Factory to ingest transactional data from ERP systems, supply chain platforms, and third-party APIs.

• Designed and optimized Synapse schemas to improve data retrieval for route planning, inventory management, and delivery performance reporting, reducing query execution time.

• Implemented data governance policies using Azure RBAC, dynamic data masking, and row-level security to ensure compliance with industry regulations and data privacy standards.

• Integrated Azure Data Lake with legacy on-premises financial databases, enabling seamless ingestion of structured and semi- structured datasets (JSON, Parquet).

• Developed complex stored procedures, SQL scripts, and UDFs for business-critical transformations, supporting real-time shipment tracking and operational insights.

• Automated CI/CD pipelines for data workflows using Azure DevOps/GitHub Actions, accelerating release cycles and reducing manual intervention.

• Integrated Azure Synapse Analytics with Power BI, delivering real-time dashboards for fleet performance tracking, delivery status, and supply chain analytics.

Client: Tata Consultancy Services.

Role: Data Engineer

Duration: NOV 2020 – Aug 2022

Location: Hyderabad, India

Responsibilities:

• Designed and maintained a scalable credit scoring pipeline on AWS, utilizing Amazon EMR and AWS Glue to handle extensive financial datasets for batch processing.

• Implemented business logic in Scala while adhering to TDD principles through Scala Test for unit testing, thereby ensuring data precision and dependable transformation workflows.

• Configured Jenkins CI/CD pipelines integrated with Bitbucket to automate the build and deployment of Scala JARs for AWS Glue job execution.

• Configured Glue jobs to activate through Jenkins post-deployment, facilitating automated regression testing on datasets stored in Amazon S3.

• Containerized Spark applications with Docker, standardizing development and deployment environments across development, testing, and production phases.

• Integrated SonarQube with Jenkins to enforce static code analysis and uphold high code quality standards during each CI/CD execution.

• Monitored job performance and system health by Amazon CloudWatch, ensuring issue identification and system availability.

• Employed Git for version control, fostering collaborative development and consistent code management within the team.

• Engaged in Agile sprints utilizing JIRA for issue tracking and managed documentation of deployment runbooks and support processes in Confluence.

• Established AWS IAM policies and RBAC to enforce secure access control to sensitive credit data, ensuring regulatory compliance and system integrity.

Client: Datarise Solutions.

Role: Data Engineer

Duration: July 2019 - Sep 2020

Location: Nellore, India

Responsibilities:

• Led data modeling and mapping initiatives to build a centralized healthcare data hub in Oracle and Azure Synapse Analytics, improving data accessibility and reducing retrieval times.

• Managed the migration of on-premises healthcare databases to Azure cloud, leveraging Azure Data Factory, Python, and SQL to ensure data integrity, performance optimization, and seamless integration.

• Developed and optimized ETL pipelines using Azure Data Factory and Python, streamlining ingestion, transformation, and consolidation of clinical and operational datasets.

• Built a scalable data warehousing infrastructure in Oracle and Azure Synapse, supporting analytics on patient records, clinical data, and operational metrics for timely decision-making.

• Created interactive dashboards using Power BI to track key performance indicators and deliver actionable insights to stakeholders.

• Maintained data quality, lineage, and governance by implementing standardized processes and metadata documentation to ensure compliance with healthcare regulations.

CERTIFICATIONS

• AWS Cloud Practitioner

PUBLICATIONS

• Published a research paper at Test Engineering and Management http://testmagzine.biz/index.php/testmagzine/article/view/1594

Contact this candidate