Post Job Free
Sign in

Data Engineer Software

Location:
Odenton, MD
Posted:
October 24, 2024

Contact this candidate

Resume:

DATA ENGINEER

Email: *******************@*****.***

Mobile: 703 – 906 – 4620 / 508 – 524 – 6590

GEORGE KWAKYE ADDO

Professional Summary

Versatile full-stack Data and Software Engineer with over 7 years of experience, combining advanced software engineering and data engineering expertise. Proven track record in building, optimizing, and automating complex data pipelines using Python, PySpark, and cloud platforms like AWS and Azure. Adept in full-stack development and system integration, blending technical skills to transform large datasets into actionable insights that drive strategic decisions. Recognized for delivering high-impact, innovative solutions in dynamic environments through strong cross-functional collaboration and technical adaptability.

Technical Skills

Programming Languages: Python, JavaScript(Node.js), TypeScript, HTML, CSS

Data Engineering: Spark(PySpark, Spark Core), ETL/ELT,

Databases: SQL Server, PostgreSQL, MongoDB (NoSQL), Azure SQL Databases

Tools & Platforms: Git Action, Jenkins, Docker, Terraform

Frameworks: Django, FastAPI, React, ExpressJs

Cloud Technologies: AWS (S3, Lambda, Glue, Redshift), Azure(Synapse, ADF, App), Databricks, Snowflake

Version Control: Git, GitLab, GitHub

Other: Agile Methodology, CLI, Linux, MacOS, Windows

Professional Experience

Aspirion Health Resources – Columbus, GA (Remote)

August 2022 – Present

Data Engineer

Architected and maintained data pipelines for healthcare and public sector clients using Azure Databricks and Azure Synapse Pipelines, streamlining data ingestion and processing of raw data.

Designed and implemented scalable data lake architectures using Azure Data Lake Storage and Synapse Analytics, optimizing storage layers for raw, curated, and aggregated data, and facilitating efficient data processing and access.

Enhanced data quality by designing and implementing a data validation framework in Azure Data Factory and Synapse Pipelines, improving accuracy and reducing errors by 30%.

Maintained and enhanced real-time data streaming pipelines leveraging Azure Event Hubs, Azure Stream Analytics, and Synapse Pipelines, enabling up-to-the-minute reporting and analytics for stakeholders.

Automated and optimized ETL workflows using Azure Data Factory and Synapse Pipelines, reducing pipeline execution times and minimizing manual interventions.

Collaborated with data scientists and business analysts to define data models and transformations within Azure Synapse Analytics, facilitating better decision-making and machine learning predictions.

Orchestrated cloud-based data architecture using Azure services such as Azure Blob Storage, Azure Functions, and Azure Synapse Analytics, cutting storage and compute costs by 25%.

Integrated data sources from REST APIs, SQL databases, and external systems into Azure Data Lake and Azure Synapse, creating a centralized data hub that improved access and visibility for cross-functional teams.

Collaborated in developing interactive data visualization dashboards using Power BI and custom visuals with Python and JavaScript, empowering business users to explore data insights independently.

Helped Implemented CI/CD pipelines for data engineering solutions using Azure DevOps, ensuring efficient, automated deployment and reducing downtime during releases.

Participated in daily Agile sprints, refining tasks and prioritizing critical projects to ensure timely delivery of key business solutions.

Regularly conducted performance tuning of Azure Databricks jobs, Synapse Pipelines, and cloud infrastructure, reducing compute resource usage and improving data processing times.

Prudent Technologies – McLean, VA

August 2019 – July 2022

Data Engineer

Collaborated with business analysts to gather and define comprehensive project requirements, ensuring alignment with AWS, Databricks, and Snowflake data pipeline solutions for optimal outcomes.

Deployed business logic frameworks across AWS, Databricks, and Snowflake, streamlining data pipeline automation and model implementation, significantly boosting project efficiency and effectiveness.

Led a team of developers in creating optimized data mappings and building scalable data pipelines, ensuring architecture was fully aligned with AWS, Databricks, and Snowflake standards.

Defined the technical integration strategy across AWS, Databricks, and Snowflake, crafting detailed plans to ensure seamless data flow and efficient data pipelines across cloud platforms.

Successfully orchestrated the migration of data pipelines from on-premises to AWS, Databricks, and Snowflake, leveraging cloud migration tools to enhance data accessibility, scalability, and performance.

Conducted rigorous code assessments during testing phases in AWS, Databricks, and Snowflake environments, proactively identifying and resolving pipeline glitches and bugs.

Developed and implemented PySpark code for automated data pipelines, adhering to coding standards across AWS, Databricks, and Snowflake, ensuring full compatibility and performance.

Proactively recommended and implemented workflow improvements for data pipeline automation in Databricks, Snowflake, and AWS, enhancing team collaboration and increasing project efficiency.

Reviewed and meticulously aligned project requirements with customer expectations, ensuring successful execution of data pipeline initiatives within AWS, Databricks, and Snowflake environments.

New Balance – Brighton, MA

July 2017 – July 2019

Full Stack Software Engineer

Collaborated in development and maintenance of robust applications, delivering high quality user experiences that catered to both internal business users and external customers.

Collaborated in architecting and optimized REST APIs, driving seamless integration with third-party services and improving internal system workflows

Collaborated with cross functional teams to design and implement scalable features, contributing to a 25% increase in application performance and reliability.

Proactively supported senior developers in diagnosing, debugging, and resolving complex software issues, ensuring the on-time delivery of critical application updates.

Led unit testing initiatives and performed thorough peer code reviews, consistently ensuring code quality and adherence to industry best practices.

Worked closely with senior engineers to define and refine technical specifications, influencing the strategic direction of new feature development and product enhancements.

Played a key role in the Agile development process, actively participating in daily standups, sprint planning, and retrospectives, fostering a collaborative and efficient team environment.

Successfully optimized front-end performance, achieving a reduction in page load times, significantly enhancing the overall user experience and engagement.

Mentored junior developers, providing guidance on best practices and helping to cultivate a culture of continuous learning and improvement within the team.

CVS Health – Wellesley, MA

July 2016 – July 2017

Full Stack Software Engineer

Supported the modernization of legacy systems by contributing to the transition to a microservices architecture which improved scalability and maintainability for CVS Health’s applications.

Assisted in the development and deployment of containerized applications with Docker and Kubernetes, enhancing the reliability and scalability of key healthcare services.

Helped implement GraphQL APIs to optimize data retrieval and reduce network load, resulting in improved application performance and user experience.

Played a role in integrating Elasticsearch to enhance search functionality, enabling faster and more accurate data retrieval from extensive healthcare datasets.

Participated in designing and deploying serverless architectures using AWS Lambda, which lowered infrastructure costs and simplified backend service deployment.

Assisted in building and optimizing CI/CD pipelines with Jenkins and GitLab CI/CD, automating testing and deployment workflows for more efficient releases.

Worked with UX/UI designers to refine and enhance user interfaces, contributing to a more intuitive and accessible experience for CVS Health’s diverse user base.

Worked on real-time features using WebSockets, which enabled immediate updates and communication for time-sensitive healthcare applications.

Contributed to strengthening application security by integrating OAuth 2.0 and adhering to secure coding practices, ensuring robust protection for sensitive data.

Education

MSc. Software Development (In-View)

Boston University – Massachusetts

BSc. Agriculture Science

Kwame Nkrumah University of Science and Technology (KNUST) – Kumasi, Ghana



Contact this candidate