Post Job Free
Sign in

Software Engineer Data Engineering

Location:
Lawrence Township, NJ, 08648
Posted:
February 01, 2025

Contact this candidate

Resume:

Sharanya Sriram

*****************@*****.*** LinkedIn

PROFESSIONAL SUMMARY

Seasoned Software Engineer with dedicated experience in data engineering and analytics. Experienced in designing and implementing robust data pipelines using Azure Data Factory and Databricks. Developed interactive dashboards with Power BI, enhancing business decision-making with accurate metrics and reports. Eager to leverage skills in data integrity and reporting to enhance data engineering platforms and drive strategic decisions. SKILLS

Skills: Database Maintenance, Usability Testing, CI/CD, Windows, Technical Analysis, Data Engineering, ETL Pipelines, Data Modeling, Data Warehousing

Programming Languages & Frameworks: Python, C#, R, SQL, Asp.Net MVC, Dotnet Core, Java Databases: SQL Server, MySQL, Oracle, Snowflake

Version Control and Tools: DevOps, GitHub, Postman Business Intelligence Tools: Power BI, Tableau, Excel, IBM Cognos BI Cloud Technologies: Azure Data Lake Gen 2, Azure Data Factory, Key Vault, Logic Apps, Databricks, Azure Storages, Hive IDE: VS Code, Visual Studio, SSIS, SSMS

Methodologies: Agile/Scrum, Waterfall

Big Data Technologies: Spark

Other : communication skills

PROFESSIONAL EXPERIENCE

ALBERTSONS COMPANIES REMOTE, USA

SOFTWARE ENGINEER Feb 2024 - Present

• Designed and implemented an ETL pipeline using Azure Data Factory and Databricks, integrating data from 10+ sources including POS systems, warehouse management systems, and supplier databases while adopting best practices for data integrity and validation.

• Developed a metadata-centric approach for ESL implementation, integrating data from multiple sources and applying business rules to create enriched datasets, which led to a 25% improvement in data consistency and interpretation across the organization.

• Designed and implemented an enterprise semantic layer that simplified complex data structures, resulting in a 30% increase in data accessibility for business users and reducing query time by 40% across Snowflake data warehouses.

• Developed a real-time data processing solution using Azure Event Hubs and Stream Analytics to ingest and process over 1 million transactions per hour, demonstrating proficiency in data warehousing and Spark.

• Created scalable data models and designed interactive dashboards in Power BI, providing real-time insights for data visualization, compliance, and activity monitoring, reducing report generation time by 75%.

• Leveraged Power Automate connectors to automate the ingestion of transactional data from external vendors, ensuring timely updates in the reporting system.

• Optimized SQL queries and database schemas in SQL Server, enhancing performance by 35% for critical inventory reports.

• Utilized Azure Key Vault for secure storage and management of database connection strings and API keys to support secure access to large datasets.

• Collaborated with cross-functional teams to gather requirements and ensure the system met business needs, resulting in a 98% user satisfaction rate.

UNIVERSITY OF NORTH TEXAS REMOTE, USA

DATA ANALYST Aug 2022 - Dec 2023

• Performed exploratory analysis of complex datasets using Python libraries such as NumPy and Pandas and implemented KNN, decision trees, and clustering techniques, establishing a solid foundation in data analysis and data modeling.

• Created over 15 reports and 5 metrics dashboards using Power BI (DAX & Power Query) for insights into customer satisfaction, claims, and market competitive analysis.

• Implemented regression models, ensemble modeling, and NLP algorithms, enhancing skills in advanced analytics and developing documentation for data integrity checks.

• Resolved data discrepancies in real-time processing pipelines utilizing root cause analysis, ensuring data accuracy and system reliability as part of ongoing data warehousing processes. COGNIZANT TECHNOLOGY SOLUTIONS CHENNAI, INDIA

SOFTWARE ENGINEER Dec 2020 - Mar 2022

• Established and managed a robust data pipeline to ingest and process claims data from diverse sources like healthcare providers, insurance partners, and external vendors, utilizing Azure Service bus.

• Enhanced SQL queries and database structures in a SQL-based data warehouse, leading to a 20% decrease in query execution times for critical business reporting.

• Leveraged Azure Blob Storage and Azure Data Lake Storage for flexible data storage, enabling seamless scalability as data volumes expand, leading to improved data accessibility and cost-effectiveness.

• Orchestrated Extract, Transform, Load operations from Source Systems to Azure Data Storage services using Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics.

• Fine-tuned data pipelines for optimal performance and scalability by implementing partitioning, bucketing, and indexing strategies in both the data lake and data warehouse.

• Developed and maintained automated data quality checks and validation rules. TRIXON TECH SOLUTIONS HYDERABAD, INDIA

JR. SOFTWARE ENGINEER Dec 2019 - Nov 2020

• During my time at Trixon, I took a pivotal role in the development and maintenance of a SQL Server Database. Working closely with vendors, I successfully developed and organized SQL Server Databases that consist of over 40+ tables, 70+ stored procedures and triggers.

• Designed database architecture using SQL Server, ensuring efficient storage, retrieval, and integrity of data along with maintenance of over 40 SQL Server Agent jobs, including scheduling of regular data backups, optimizing database performance through index maintenance, and implementing Email Triggering Service.

• Developed and maintained a web Application based on ASP.Net MVC architecture and C# and contributed my part in development of APIs.

• Created 35+ stored procedures, 100+ functions, and 20+ triggers to automate data processing and ensure data consistency. EDUCATION

University of North Texas

Master of Science Aug 2022 - Dec 2023

• Courses: Data Engineering

Jawaharlal Nehru Technological University

Bachelor of Technology, Computer Science Aug 2016 - May 2020



Contact this candidate