Senior Data Platform Engineer

We are #Hiring: #Senior Data Platform Engineer

Job Title : #Senior Data Platform Engineer

Location : PAN India - (Hybrid)

Total Yrs. of Experience : 7+ Years

️ Duration: Contract to Hire (C2H)

Notice Period: Immediate Joiners to 30 Days

Job Description*:

Key Responsibilities:

Apache Airflow Administration & Platform Engineering

· Build, deploy, configure, and maintain Apache Airflow environments across on-premises infrastructure and AWS Cloud.

· Perform Airflow platform administration activities including start/stop operations, upgrades, patching, configuration management, and capacity planning.

· Design, deploy, and manage Apache Airflow and Amazon Managed Workflows for Apache Airflow (MWAA) environments.

· Provision and manage AWS infrastructure required for Airflow using AWS CloudFormation templates and Infrastructure as Code (IaC) practices.

· Automate Airflow installation, configuration, and maintenance using Shell scripting on Linux/UNIX platforms.

· Manage Airflow DAG deployments through Jenkins CI/CD pipelines and release management processes.

· Monitor Airflow schedulers, workers, executors, metadata databases, and DAG performance to ensure platform stability and reliability.

· Troubleshoot and resolve Airflow platform, scheduler, executor, and DAG-related issues across development, UAT, and production environments.

· Manage Airflow metadata databases and perform performance tuning activities.

· Administer Airflow hosted on Linux/UNIX servers, ensuring platform security, performance, and availability.

· Ability to develop, maintain, and troubleshoot Python-based Airflow DAGs and workflow dependencies.

· Support High Availability (HA), Disaster Recovery (DR), backup, restore, and failover testing activities

AWS Cloud & Data Platform Management

· Design and manage MWAA clusters, including environment configuration, scaling, networking, security, and performance optimization.

· Manage AWS services supporting Airflow and data platforms, including EC2, RDS PostgreSQL, ELS, Lambda, Redshift, S3, IAM, CloudWatch, VPC, Load Balancers, and Auto Scaling services.

· Optimize cloud infrastructure utilization while ensuring high availability, security, and operational efficiency.

--

Thanks & Regards

Dinesh.B

Technical Recruiter

Burgeon IT Services

Email Id:

Ph no: +91 9392916010

Website: www.burgeonits.com

Shirisha. Ch Sona P Thota Harika Ramya Sarige k Nitusha Kalyani R Sudha Yadav Veeraboina Syed Nazima Vara lakshmi kota Golagani Saikumar Shiva Kumar Rajkiran G Srikanth Vicky Khaja Mansoor Ahmed Kiran Gomasa Nagarjuna Duggineni Masthanvali SHAIK Nanda Kishore Kumar Lakkakula Laxmi Narayana (Raja) Arraganti palley Mahathi Navya Tumuluri BURGEON IT SERVICES