Data Engineer

Md Nurul Absar Siddiky (OPT- EAD No sponsorship required)

Phone: 980-***-**** ************.*******@*****.*** www.linkedin.com/in/nurabsar

Azure Data Engineer ETL Developer Database Administrator

Summary

Data Engineer with 10+ years of experience designing, building, and optimizing data pipelines and infrastructure for scalable data solutions.

Expertise in ETL development (SSIS, Apache Spark, Snowflake), data warehousing, and cloud technologies (Azure, AWS, GCP).

Skills

Cloud Computing: Azure (Data Factory, Databricks, Synapse Analytics), AWS (S3, EC2, Lambda), GCP (BigQuery, Cloud Composer), infrastructure-as-code (Terraform, CloudFormation, etc.).

Azure Expertise: Deep knowledge of Azure data solutions, including Azure Data Factory, Azure SQL Database, Azure Synapse Analytics, and Azure Blob Storage.

AWS Expertise: Demonstrated expertise in AWS data services such as S3, Redshift, Glue, Lambda, EMR, and Kinesis.

Database Management: In-depth expertise in SQL and NoSQL databases, such as Azure Managed Instance and Azure Cosmos DB, covering DBA tasks, performance tuning, and optimization.

Backup & Recovery: Experience with Azure Backup and Azure Site Recovery. write it in paraphrase

Data Warehousing: Snowflake, SQL Server, Redshift, Azure Synapse Analytics, BigQuery.

ETL Tools: SSIS, Apache Spark, Apache Airflow, Azure Data Factory, Apache NiFi, Talend.

Databases: SQL Server, MongoDB, MySQL, PostgreSQL

Programming Languages: Python (Pandas, NumPy), SQL, Bash, T-SQL

Data Visualization: Tableau, Power BI, Grafana, SSRS

Big Data Framework: Apache Spark, Hadoop, Kafka

Data Modeling: Star Schema, Snowflake Schema, Dimensional Modeling, familiarity with data modeling techniques for OLTP and OLAP systems in Azure environments.

DevOps: Docker, Kubernetes, CI/CD Pipelines (Jenkins, GitLab), Azure Kubernetes Service (AKS)

Certifications

Microsoft Certified: Azure Database Administrator Associate (DP-300) - In progress

Microsoft Certified: Azure Data Engineer Associate (DP-203) - In progress

Microsoft Certified: Azure Enterprise Data Analyst Associate (DP-600) - In progress

Microsoft Certified: Power BI Data Analyst Associate (PL-300) - In progress

AWS Certified: Data Engineer Associate – In Progress

Professional Experience

University of North Carolina, Charlotte, NC, USA

Data Engineer Research Assistant (August 2022 – Present)

Developed Python automation scripts for data cleaning and preprocessing, improving data quality for machine learning models.

Researched data aggregation techniques to enhance data warehousing efficiency.

Assisted in developing federated learning frameworks for decentralized AI.

Optimized Federated Learning Frameworks, reducing communication overhead by 40%.

Developed Model Optimization Techniques, automating hyperparameter tuning, leading to 25% faster model convergence.

oProject: Optimized Federated Learning Communication: Implemented adaptive aggregation algorithms, reducing communication costs by 40% while maintaining model accuracy. Technologies: Python, PyTorch, Federated Learning.

LM Ericsson Bangladesh Ltd, Dhaka, Bangladesh

Data Engineer ETL Developer (March 2022 – July 2022)

Automated Python data pipelines to process 10M+ telecom records in real-time.

Developed and optimized BI dashboards using SQL and Tableau, reducing infrastructure churn by 12%.

Integrated DevOps practices by automating CI/CD pipelines for SQL processes.

Designed and optimized complex database objects using T-SQL for automation.

oProject: Real-time Telecom Data Pipeline: Developed a Python pipeline for processing and analyzing over 10 million telecom records in real-time. Technologies: Python, SQL, Tableau.

Cellwize Wireless Technologies Pte. Ltd, Dhaka, Bangladesh

Data Engineer ETL Developer (July 2018 – February 2022)

Designed and optimized ETL pipelines using SSIS to consolidate multi-vendor telecom data.

Utilize AWS services such as S3, Redshift, Glue, Lambda, EMR, and Kinesis to design and oversee cloud-based data infrastructure.

Engage with big data technologies like Spark, Hadoop, and Kafka to facilitate both real-time and batch processing.

Automated RAN data ingestion using Python and SQL.

Maintain data quality, security, and governance throughout the entire data lifecycle.

Supervise and resolve issues related to data pipelines and infrastructure, ensuring consistent availability and reliability.

Developed Grafana dashboards for KPI visualization, improving network insights.

Enhance database performance and create data models that facilitate business intelligence and analytics.

Built and deployed MLOps pipelines for automating model training and inference.

Designed scalable data lake solutions using AWS S3 and Hadoop.

Implemented DevOps pipelines for data model versioning and automated deployments.

oProject: Telecom Data Lake on AWS: Designed and implemented a scalable data lake using AWS S3 and Hadoop. Technologies: AWS S3, Hadoop, Spark, Python.

Grameen Phone Limited, Dhaka, Bangladesh

Data Engineer (September 2011 – July 2017) Changed job title

Design and manage scalable, efficient, and secure data systems on Microsoft Azure, including Azure SQL Database, Synapse Analytics, Blob Storage, and SQL Server.

Improve data storage, processing, and retrieval for high performance and scalability in large Azure environments.

Track data system performance and health with Azure Monitor and Log Analytics, resolving issues as needed.

Ensure data integrity, quality, and consistency by validating and cleansing data in Azure.

Administer and enhance Azure SQL Databases and Synapse Analytics for optimal performance, scalability, and security.

Create and oversee backup and disaster recovery plans with Azure Backup and Site Recovery.

Use Azure SQL Analytics to monitor and improve database performance through query optimization, indexing, and resource management.

Ensure data integrity, quality, and consistency by validating and cleansing data in Azure.

Conduct routine maintenance in Azure, including upgrades, patching, and capacity planning.

Manage data migration from on-premises systems to Azure and integrate third-party services using Azure Database Migration Service.

Address database problems, perform root cause analysis, and apply corrective measures using Azure Support tools.

Migrated and transformed datasets using SSIS and Python.

Created and implemented stored procedures, functions, triggers, and views in SQL Server and Oracle.

Build and manage ETL pipelines with Azure Data Factory to integrate and organize data within our Azure system, ensuring it is clean, structured, and ready for analysis.

Use Azure Data Factory and Azure Functions to automate ETL workflows.

Optimized query performance, improving application responsiveness.

oProject: Scalable Data Pipeline on Azure: Designed and implemented a data pipeline on Azure Platform. Technologies: Azure Synapse Analytics, Cloud Composer, SQL, Python.

Previous Experiences

Mobiserve Holding Bangladesh Ltd: ETL Engineer (March 2011 – August 2011). Developed and deployed SSIS packages for ETL processes.

Metro Global Telecom Services Pvt Limited: ETL Developer (May 2010 - April 2011). Designed and optimized T-SQL queries and ETL workflows using SSIS.

Education

University of North Carolina at Charlotte, USA MS in Electrical Engineering

Khulna University, Bangladesh BS in Electronics and Communication Engineering

WorldQuant University: Applied Data Science I and II (With Honors)

Contact this candidate