Data Engineer

CHANDU B L

Bangalore, Karnataka / India +91-701******* ******.*.****@*****.*** LinkedIn

SUMMARY

Data Engineer with experience in ETL migration, data platform standardization, and real-time analytics. Skilled in BigQuery, Airflow, Dataflow, Dataproc, dbt, and PySpark, delivering scalable, production-ready data solutions through strong cross-team collaboration.

TECHNICAL SKILLS:

Cloud Platforms and Services: Google Cloud Platform (GCP), BigQuery, Dataproc, Dataflow, Cloud Function, Composer, Cloud Storage, Astronomer

Data Engineering: ETL Pipeline Design, Data Warehousing, Data Transformation, Data Migration, Data Pipeline Optimization

Programming Languages: SQL, Python

ETL Tools: Apache Airflow, Apache Spark, PySpark, dbt Version Control & Project Management: Git, Jira

PROFESSIONAL EXPERIENCE

QUANTIPHI ANALYTICS

Bangalore, India

Senior Data Engineer Sep 2022 – Present

Data Platform Standardization & Data Contracts

● Contributed to a data platform standardization initiative to unify pipeline development and governance practices.

● Designed and built a platform-agnostic, CLI-based data contract management framework.

● Implemented data contract validation rules as dbt tests, embedding data quality checks into transformation workflows.

● Automated dbt project initialization and reusable template generation from contract specifications.

● Built a Git-based workflow to manage the data contract lifecycle across environments.

● Improved cross-team collaboration between data engineering, analytics, and downstream consumers. Teradata to BigQuery Data Migration

● Migrated large-scale DMExpress and DataStage ETL processes, along with Teradata tables, to BigQuery.

● Developed Dataproc jobs for large-scale file ingestion and extraction, accelerating downstream processing.

● Built an audit framework in Airflow to track job statuses, enabling robust monitoring, debugging, and performance analysis.

● Used Dataflow to streamline the ingestion of large datasets from JDBC servers.

● Translated and optimized 100+ Teradata BTEQ scripts using BigQuery Migration Service (BQMS), improving performance and reducing manual effort.

● Automated ETL workflows using Apache Airflow, improving scheduling, monitoring, and pipeline orchestration. AWS Data Pipeline with PySpark

● Developed and deployed AWS Glue jobs using PySpark to efficiently ingest and transform data from AWS S3 into AWS Redshift.

● Optimized PySpark scripts to improve performance and scalability, ensuring reliable processing of large datasets. Real-time Data Sync and Dashboarding

● Developed a solution to seamlessly stream Firestore data into BigQuery, enabling real-time data synchronization.

● Created and maintained dashboards using Looker Studio, providing stakeholders with real-time insights on key performance indicators (KPIs).

● Facilitated timely decision-making and improved transparency by tracking the progress of internal tool launches. Data Pipeline Development

● Designed and implemented scalable data pipelines to synchronize data from client servers with BigQuery using Cloud Functions and Scheduler.

● Improved data transfer efficiency, reduced latency, and enabled seamless integration with existing data infrastructure. Cognizant

Bangalore, India

Intern Mar 2022–Jul 2022

FACTR

Bangalore, India

Intern Aug 2021 – Jan 2022

Django API Development

● Developed high-performance RESTful APIs using Django, enhancing backend capabilities and supporting seamless front-end interactions.

Analytics Report Generation

● Created comprehensive analytics reports to assess and improve student performance, leveraging data analysis techniques to provide actionable insights for educators and administrators. Web Scraping

● Automated the data collection process by executing comprehensive web scraping projects, building rich datasets. Text Summarization & Comparison

● Implemented AI-driven text summarization and comparison tools, streamlining information retrieval and enhancing content management.

Question Generation & AI Collaboration

● Contributed to the development of an automated question generation system, improving educational content delivery through innovative AI solutions.

CERTIFICATIONS

● Databricks Certified Data Engineer Professional

● Databricks Certified Data Engineer Associate

● Google Cloud Certified Associate Cloud Engineer

● Google Cloud Professional Database Engineer

EDUCATION

VISVESVARAYA TECHNOLOGICAL UNIVERSITY,2022

BE Computer Science and Engineering

Contact this candidate