Data Engineer

Rajat Negi

linkedin.com/in/rajat-negi-**a*/ Email: *********.***@*****.***

Noida, Uttar Pradesh Mobile: +917*********

CAREER SUMMARY

Engineer with more than 3.5 years of experience in the Data Engineering and transformation department, rich experience in migrating enterprise DW to cloud on Databricks. Deploying databases and ETL across all types of BAU environments, managing and provisioning VMs and SQL servers, setting up and taking care of end-to-end batch jobs for on-prem to Azure cloud migration of applications.

EXPERIENCE

Nov. 2025 - Present

Data Engineer (Client: E.ON, U.K.)

• Tenant migration and remediation across Azure Data platform components including ADF, ADLS gen2, Matillion jobs, Azure Key Vault, Azure Databricks while keeping Snowflake as sink ensuring zero data loss and minimal downtime.

• Identified and fixed ETL logic failures caused by tenant/resource ID changes by externalizing configs into key vault, pipeline parameters, correcting ADF scheduling, triggers and dependency chains to prevent execution drift after migration.

• Refactored ADF linked services and pipelines to replace tenant specific and hardcoded configurations and restored third-party integrations with Snowflake, Databricks by updating authentication endpoints network configurations post migration. Mar 2022 – Nov.2025

Infrastructure Engineer/Data Engineer- Data & analytics (Client: Nationwide Building Society, U.K.)

• Cross-functional Collaboration: Collaborate with multiple teams for gathering specifications and setting up of new jobs for Lakehouse ingestion in current on-prem. to cloud migration project.

• Job orchestration: Implemented using Databricks, ADF and Control-M for enterprise scheduling in Acquire and Publish layer.

• Data migration & Lineage: Replicated on-prem. data load patterns for Databricks ingestion with optimized job sequencing and lineage tracking, ensuring efficient and reliable data flow from source system to cloud (Tool used: Control-M, ADF)

• Data Quality & reliability: Investigated and resolved data quality issues such as record mismatch, schema drift, missing files or double loading

• Production Support(L2/L3): Leveraged Databricks pipeline monitoring, Spark UI for incident investigation and RCA, minimizing downtime and ensuring SLA adherence.

• On-premise Upgrades: Migrated applications from Windows 2008 servers to 2k19 Windows servers.

• CI/CD Data Pipelines: Implemented using TFS (now Azure DevOps) and GitHub Actions for database and SSIS projects.

• Control-M Job monitoring and Dashboard: Responsible for sharing Job Status, Failure and File Count report with migration project leaders. Troubleshooting incidents if arises. (tool used: Control-M, ServiceNow).

• Automation with PowerShell: Automated file validation using PowerShell scripts at on-prem staging location for cloud before initiating downstream data loads, reducing daily manual efforts (Tools Used: PowerShell).

• Knowledge Transfer and leadership: Knowledge transfer to 7 members & cross-team KTs, led multi-team daily scrum calls. SKILLS

• Cloud Services: Azure Databricks, ADLS Gen. 2, Azure DevOps, ADF, Snowflake

• Databases: Oracle SQL, Microsoft SQL Server

• Languages: SQL, Git, PowerShell, GitHub Actions

• Tools: Matillion, Jira, ServiceNow, Control-M, Tableau, Informatica PowerCenter.

• Soft Skills: Coordination, Collaboration, Adaptability, Leadership, troubleshooting and Analytical skills Awards and Achievements

• Databricks Certified Data Engineer Professional - Link

• Databricks Certified Data Engineer Associate - Link

• Microsoft Certified: Fabric Data Engineer (DP-700)

• dbt (Data Build Tool) Fundamentals Certified.

• PRIDE Award(Client): for debugging Customer-ODS release delivery to prod. before deadline.

• Cleared TCS Digital tech track: Data Engineering using Informatica PowerCenter and Tableau

EDUCATION

Bipin Tripathi Kumaon Institute of Technology Uttarakhand, India Bachelors of Technology - Electrical Engineering 2015 – 2019.

Contact this candidate