Data Engineer Power Bi

Deepen Rana

475-***-**** **********@*****.*** https://www.linkedin.com/in/deep-/

DATA ENGINEER

Data Engineer with 5+ years of experience in data engineering and analysis, specializing in automating ETL processes, enhancing data efficiency, and developing actionable insights from complex datasets. Skilled in SQL, Python, R, and advanced analytics tools (e.g., Tableau, Power BI, SSRS). Demonstrated success in optimizing data pipelines and workflows, with a commitment to continuous technical skill advancement. Proficient in leveraging data to drive decision-making and business problem-solving.

TECHNICAL SKILLS

Python, C++, SQL, T-SQL, R Programming, Scala, MSSQL, MySQL, MongoDB, Microsoft Access, Cloudera, AWS, GCP, Apache Spark, Apache Airflow, Apache Hadoop, ETL/ELT, Data Pipelining, Tableau, Power BI, Advanced Excel, SSRS, SSIS, SQL Profiler, Crystal Report

PROFESSIONAL EXPERIENCE

Cognixia LLC Basking Ridge, NJ

Data Engineer Jan 2024 – Present

Designed and implemented ETL pipeline for seamless migration of on-premises SQL Server data to Google BigQuery.

Incorporated Looker studio for data visualization.

Automated data migration using Apache Airflow for periodic synchronization between on-premises and BigQuery.

Leveraged BigQuery's streaming inserts and batch loading for efficient and scalable data ingestion.

Performed exploratory data analysis (EDA) and feature engineering using Python, Pandas, NumPy, and scikit-learn.

Implemented Python and SQL-based quality checks, leading to 25% decrease in data errors, bolstering data integrity.

Implemented Cloud Functions to automate analysis pipeline with triggers.

Harnessed the power of Apache Spark for data processing, elevating data processing throughput by 35%.

Avionté Bloomington, MN

(Impetus Incorporation Pvt. Ltd serving as an agency for Avionte Kathmandu, Nepal)

Data Scientist Jun 2019 – July 2021

Trained and onboarded 20 new hires on business model and database structure.

Managed 10-15 client requests daily, scoping and addressing business needs.

Developed and presented insights with complex SQL queries and SSRS reporting.

Boosted data fetching efficiency by 30% through optimization and indexing.

Utilized SQL, T-SQL for seamless data manipulation and analysis improvement.

Managed SSIS for efficient data integration across the organization.

Implemented data import to HDFS from RDBMS servers using Sqoop.

Analyzed critical datasets with Cloudera, HDFS, HBase, MapReduce, Hive, Sqoop, Spark.

Automated Python scripts for data conversion and ETL pipeline generation.

Imported and transformed data using Sqoop, Hive, MapReduce into HDFS.

Deployed Amazon Redshift, cutting query times by 40%, enhancing data access.

Used AWS S3 and EC2 for scalable infrastructure, handling 20% larger datasets efficiently.

Developed data lineage tracking for auditing, compliance, and traceability.

Established data quality measures and governance for accuracy and compliance.

Streamlined ETL processes, improving efficiency and reducing processing overhead.

Professional Computer System, Kathmandu, Nepal Senior Technical Officer Aug 2017 – June 2019

Managed and optimized databases, enhancing performance through expert administration and tuning.

Showcased expertise in MS SQL server performance optimization for system responsiveness and user satisfaction.

Automated ETL, reducing data wrangling time by up to 40%.

Led fault-tolerant data pipeline design and implementation for clean data products.

Monitored and improved ETL for seamless data flow and optimized retrieval/loading.

Executed smooth database migrations, minimizing downtime and ensuring data continuity.

Demonstrated proficiency in data modelling, management, and manipulation, with a focus on code version control.

Provided daily SQL server database support, ensuring quick issue resolution and minimal downtime.

Efficiently deployed and configured new databases and servers.

Maintained database servers/processes, monitoring system health for timely performance interventions.

Improved system efficiency and response time through performance tuning.

Collaborated on MS Access database design, development, and SQL Server conversion, enhancing querying and reporting.

Streamlined data processing and reporting with advanced MS Excel and MS Access.

EDUCATION

University of New Haven, West Haven, CT

MS in Computer Science May 2023

Tribhuvan University, Kathmandu, Nepal

Bachelor of Computer Science and Information Technology Dec 2019

Contact this candidate