Data Engineer Azure

Manisha

St. louis, MO

314-***-**** ********.************@*****.*** linkedin.com/in/palagiri-venkata-sai-manisha SUMMARY

Data Engineer with 8+ years in designing and implementing scalable ETL and data warehousing solutions. Skilled in Azure Data Factory, Databricks, and SQL optimization, with a proven ability to integrate and validate complex data sets. Adept at streamlining production deployments using CI/CD processes and collaborating across teams to meet business data requirements.

WORK EXPERIENCE

Capgemini Technology Services Mar 2022 - Jan 2024

Senior Consultant Bangalore, India

Utilized Azure Data Factory, Azure Databricks, JIRA, SQL, Azure DevOps, ADLS, Azure SQL DB, and CI/CD practices within a dynamic project environment.

• Clarified requirements by analyzing the Data Catalog and Demand Checklists from Power BI prior to sprint initiation.

• Tracked and managed user stories using the Jira Board; advanced tasks from planning to UAT completion.

• Developed data pipelines in line with project specifications, creating new solutions or adapting existing ones for change requests.

• Engineered intelligent pipelines by designing dynamic datasets, linked services, and parameterizing them for versatile use.

• Conducted comprehensive unit testing in Notebook, followed by SIT testing in QA and UAT validation.

• Coordinated release activities by deploying code to production via Azure DevOps and CI/CD processes.

• Collaborated with the Azure DevOps team post-deployment to monitor pipeline status and ensure operational effectiveness in production.

• Optimized various CI/CD scenarios to streamline and enhance the release process. Stacknous Solutions Jul 2017 - Feb 2022

Senior Consultant Bangalore, India

Utilized Azure Data Factory, ADLS, Azure SQL DB, Key Vault, and Databricks to design and implement comprehensive end-to-end data solutions.

• Architected and executed Azure transformation projects by implementing robust ETL and data movement strategies.

• Constructed new pipelines for full, delta, and upsert loads using Azure Data Factory and Databricks.

• Developed enterprise data models by identifying critical facts and dimensions to bolster data warehousing efforts.

• Created and executed test cases, test data, and testing scenarios within Databricks for rigorous solution validation.

• Analyzed data models and mapping documents to ensure seamless integration and data consistency.

• Monitored ETL jobs and verified target warehouse tables against business rules using advanced SQL queries.

• Troubleshooted and resolved pipeline errors by leveraging subject matter expertise to address complex issues.

• Managed technical escalations and provided advanced support to meet aggressive project deadlines. Cognizant Technology Solutions Jan 2016 - Jun 2017 Programmer Analyst Chennai, India

Environment: Informatica, RoamBI, Power BI, QlikView,QlikSense, ETL, SQL.

• Experienced working on ETL Informatica Power Center multiple versions with knowledge in OLAP, OLTP, STAR/Snowflake Schema and created Informatica mappings to populate the data into fact and dimension tables. Developed SQL to load & transform data as necessary.

• Handled projects working on creating various apps for Qlik sense and Qlik view and resolving data quality issues.

• Experienced working on the entire life cycle of the project from Architectural Design to Deployment to Production.

• Developed setting up the whole process in place for the project which leads to achieve the daily goals.

• Worked closely on RFP-POC and presented it to the clients.

• Taken sole responsibility in developing multiple dashboards of sales and marketing data for Roambi and checked for desirable outcomes. Established and utilised strategic methodologies to efficiently analyse the client's database and developed mapping specifications.

• Drove all phases of enterprise integration and process improvement projects to successful completion.

Contact this candidate