Data Engineer - ETL & Real-Time Analytics Specialist

DIVYANI TURANKAR

SUMMARY

Results-oriented Data Engineer with an experience in building scalable data pipelines and ETL processes. Strong Team collaborator focused on delivering impactful data solutions and continuously enhancing technical expertise.

WORK EXPERIENCE

EDUCATION

D.Y Patil International University Akurdi Pune

B.TECH Computer Science And Specialization

july 2019 -june 2023

Data Engineer with expertise in designing, automating, validating,and optimizing real time ETL pipelines, as well as implementing KPIs to drive business performance across multiple domains, including telecom, ecommerce.

Handled and maintained the health of distributed database systems across production clusters. Proactively monitored and tuned systems for performance, managing tablet sizes, compactions, and job efficiency.

Skilled in using Pyspark, Spark,Hadoop,Apache Airflow and streaming Kafka to enable real-time analytics, improve efficiency, and support data-driven decision-making. Experienced in migrating data from diverse sources to ADLS(Azure data lake storage) using smart-dial framework and from SAP HANA to inhouse cluster.

Handled and supported the ‘Customer 360’ Airflow DAG for a telecom client, for approx 470-480 million users. Ensuring smooth data processing and timely execution. Architected and maintained end-to-end CI/CD pipelines using an in-house automation platform Improved deployment frequency, cut manual effort by 60%, and increased overall pipeline reliability. Associate Data Engineer Jio Platform Limited (JPL) DEC-2023 - Present SKILLS

Programming language : Python, PySpark, Shell-Scripting (Bash), SQL, HQL Big Data : Spark, Hadoop, Airflow, Hive, Kafka, Kudu, Impala, NIFI, yarn, ETL, CI/CD Web Developement : Html, CSS, JavaScript,API

DataBase Management : MYSQL, Oracle, SAP HANA

Other : Linux / Unix, Azure Databricks,Tableau, powerBI, cloudera, AWS S3, AWS Glue Navi Mumbai, Maharashatra • 797-***-**** • *****************@*****.*** Web Developement Jio Plaforms Limited (JPL)

Developed an application using web desigining skills based on specified requirements focusing on responsive design and user interaction.

7.5 cgpa

PROJECTS

july 2022 -sep 2022

RVC(Retailer Verification Code): Developed end to end data pipelines for telco business enable real- time insights of complete customer journey. Streamlined the JIO SIM lifecycle across RPOS (Reliance point of sale) systems in the Jio telco network, improving retailer verification and speeding up customer onboarding.

Data Provisioning : Simplified and automated manual work by building an scalable data pipelines for DB to DB and Kafka-to-Hive integration, using sqoop for RDBMS-to-Hive migration & implemented real time streaming from kafka.

Customer-360 : Designed and implemented a scalable KPI’s for large-scale data sets for business functions such as stock management, purchasing, pricing, sales and inventory tracking across reliance retail (Ajio,Trends,JioMart,Reliance Digital) for Uncovered customer trends and segments to drive personalized marketing.

Developed real time ETL pipelines for using Kafka, including integration with JioAds Kafka topics. Orchestrated Azure Data Bricks environment, ingested Hive/Kafka/Hana tables to ADLS using smart dial framework.

Contact this candidate