KRISHNA PATEL

]]

Data Engineer

443-***-**** MD ad3f4y@r.postjobfree.com

SUMMARY

Detail-focused Data Engineer with 3 years of experience. Skilled in Data Warehousing, Data Engineering, Cloud Platforms, Process validation and Data Analyzing techniques. Proven to understand customer requirements and translate into actionable project plans. Implemented end-to-end Projects using ETL tools to extract data from multiple data sources and analyze data to develop meaningful trends/insights. Experienced in AWS Redshift, Python and other open source technologies to build efficient star schema-based data warehouse processes

EXPERIENCE

HelioCampus MD, USA

Data Engineer May 2021 to Current

Developed robust ELT processes using Python and SQL to load data from several data sources to Redshift.

Developed the architecture and SQL scripts for star schema model for higher education sector.

Dealt with integrating multiple data APIs from various learning management platforms including Canvas, Marketo and EDx into a single cohesive ETL process using AWS CLI commands Enjoy building highly efficient self-healing process over time consuming manual processes Promoted best practices amongst team member for credentials maintenance, performance tuning and coding standards.

Optimized data pipelines to ensure maximum efficiency, scalability, and reliability, resulting in a 30% reduction in processing time.

Collaborated with data scientists and analysts to facilitate data exploration and analysis, supporting data-driven decision- making across the organization.

Managed and monitored data workflows to ensure data quality, integrity, and adherence to data governance and security standards.

Designing and developing ETL processes for a new customer data integration project, streamlining data ingestion from multiple sources. Conducted data profiling and data cleansing activities to improve data quality and accuracy in the data warehouse.

Used Jira (business project and client service desk) for project management and Apache SVN and Gitlab for code reposition.

Automated census processes based on client’s requirements.

Built single code repository with customized structure for client specific custom requirements.

Automated the process of QAT and Production codebase with use of Python libraries.

Built and managing the SPRINTS QAT development and production deployment cycles.

Building CI/CD automation in Gitlab.

Automated and maximized the ETL performance by 30% by reconstructing the SQL code-based scripts and with use of Python libraries used in the daily scheduling processes.

Collaborated with product team enhancing existing product features and new prod development cycle. SKILLS

Tools: Tableau, Power BI, Snowflake, GitHub, Azure data Methodologies: Detailed Data Analysis, Data Engineering, Data factory, Apache Spark, Azure, AWS, Apache Kafka, RDS, EC2, Pipelining, Data visualization, ETL, SSIS, Database S3, Hadoop, Hive, Hbase, Google Cloud, Google BigQuery, Autosys, PyTorch, Tensorflow, Visio Automation

Languages: Oracle SQL, Python, Pandas, Keras, R language, Matplotlib Code, Numpy, MySQL, Bash, PostgreSQL, ADF, Shell Scripting, Unix, Git, MS SQL Server

Management, Database Design, System Design, Data

Preprocessing, Data warehouse, Data surveillance, Data quality validation and monitoring, Business Intelligence, Cloud Computing, Cloud Platform Management, Machine learning, Agile, Data Sets, Redshift

EDUCATION

Master of Science in Information System

University of Maryland, Baltimore County, Baltimore, MD Bachelor of Engineering in Computer Engineering

Gujarat Technological University, Ahmedabad, Gujarat