Data Engineer Azure

Mohamed O. Hassan

********@*****.***

Tel: 678-***-****

SUMMARY

●Sr. Data Engineer with a passion for focusing on data management to enable customers to gain a competitive advantage leveraging data both inside and outside the company.

●Have experience understanding and solving real business problems and presenting business cases and strategy.

●Bring industry domain knowledge for custom data and analytics strategies.

●Experience in designing and building high performance collaborative business and technology teams that deliver high value data solutions, data products and data analytics.

●In summary, a senior data engineer specializing in Azure data stack and modern data technologies plays a pivotal role in designing, implementing, and managing data solutions that meet business needs, while also leading teams and engaging with stakeholders to ensure successful project delivery.

SKILLS

Languages: Python, Java, C#

●Database and DW: SQL Server, Postgres, Mysql, Oracle

●Web Development: REST API, Graphql, postman

●Tools: PySpark, Hive, Sqoop, HBase, Presto, Git, Data Explorer, Azure Purview, Atlas, Databricks, ARM templates, dbt, Azure DevOps (CI/CD), Snowflake, RabbitMQ, Kafka, NoSQL

●ETL tools: Snowflake, Synapse, Data Factory, Airflow, Matillion, Data Lake, S3, Azure Data Explorer,

●Operating Systems: Windows, Linux, bash scripting

●Languages: English, French

CERTIFICATIONS

●Azure Data Engineer Associate

●AWS Solution Practitioner

●Data Science Certificate from Johns Hopkins/Coursera 2015

PROFESSIONAL EXPERIENCE

Booz Allen Hamilton, Remote May 2023 - present

Sr. Data Engineer

●Designing and implementing scalable data architectures on Azure, utilizing services like Azure SQL Database, Azure Synapse Analytics, Azure Data Lake, and Azure Databricks.

●Building efficient ETL (Extract, Transform, Load) processes and data pipelines using Azure Data Factory.

●Developing solutions for data processing and analysis using technologies such as Spark for big data processing and Azure Analysis Services for business intelligence.

●Collaborating with customers to understand their data needs and deliver solutions that meet their requirements.

●Providing technical guidance and support to customers throughout the project lifecycle.

Microsoft, Redmond WA February 2021 - March 2023

Sr. Data Engineer, MCS

●Lead and Manage client’s data platform transformation to Azure Data Lake using Synapse and Data Factory and Azure Databricks stack.

●Ingested data into Data Lake and exposed them as polybase external tables for downstream apps.

●Responsible for leading the design and building of scalable data pipelines using Azure DevOps.

●Performed initial requirements gathering to understand customers’ business problems.

●Interact with customers and stakeholders to deliver data products.

●Delivered data modernization platforms end to end from ingestion to dashboards.

●Create Power BI Analytical solution for financials, manufacturing and healthcare customers

●Implemented a data Viz project leveraging Graphql endpoints with Power M query that enabled different customers to access dashboards with different needs.

●Implementing data governance policies and ensuring compliance with regulations (e.g., GDPR) and security best practices.

●Leading and mentoring a team of data engineers, providing technical direction and support.

●Overseeing project timelines, resource allocation, and task assignments.

Accenture (Facebook Project)

Senior Data Engineer, Product Analytics. August 2020 – Feb 2021

●Supported and maintained data warehouse solution that detects payments issues such fraud, chargeback, accounting anomalies and creates reports for downstream users (Data Scientists, Product managers...)

●Enable stakeholders and data scientists to access large scale data sets to get better insights and build AI based products.

●Build and deployed features for new datasets into FB payments data warehouse using python, SQL and Apache Airflow

●On-Call Support for monitoring and troubleshooting ETL pipelines

●Performed backfill when needed for missing/stopped pipelines

●Maintained code (SQL, python) as Airflow DAGS in central repos, pull request and core review

Accenture (Cisco project) June 2020 – August 2020

Senior Data Engineer, Finance Team

●Led a BI project across marketing and sales organizations to upgrade current ETL processes and workflows to SaaS based solution (Matillion).

●Converted Talend ETL packages written in Python to equivalent ones in Matillion.

●Created test cases to verify migration.

●Documented architecture and best practices for ETL job schedules, and monitoring

Accenture (Coinbase project) January 2020 – June 2020

Senior Data Engineer, Finance Team

●Delivered data governance and lineage framework to track financial data in Atlas (A tool for data lineage).

●Use a python jinja2 framework to inject and enhance SQL queries with metadata and expose table metadata to Atlas to query and create data lineage.

●Architected data platform to support a variety of query workloads to derive insights to provide to analysts and data consumers.

●Interacted with stakeholders such as data scientists and finance team to assess the needs and requirements for building products based on data

Accenture (T-Mobile project) April 2019 – January 2020

Senior Software engineer, Product Development

●Responsible for managing and building data ingestion workloads for devices farm testing.

●Automate data pipelines to capture, process and visualize data.

●Build docker containers and deployed code.

●Lead a small team on building and delivering software in Agile.

●Responsible for communicating with stakeholders on project status.

WebMD Health Services, Portland, OR March 2018 – April 2019

Data Engineer, Product Development

●Responsible for developing a new data platform to support streaming and batch uses cases for data ingestion, processing, and analytics.

●Migrated HIPAA-compliant patient and benefit data from Teradata to Horton work platform ensuring confidentiality, integrity and availability

●Build backend services that produce and consume data from Hortonworks platform.

●Building REST microservices in .NET to interact with RabbitMQ.

●Managed and supported production env.

●Work in an Agile team with daily standup and sprints planning

Intel, Hillsboro, OR February 2014 – March 2018

Software Engineer, Data Center Group

●Created data ingestion framework for gathering data from a variety of sources using Spark framework, Kafka, and NoSQL db.

●Used Hive for Data warehousing and Impala for fast querying, for indexing data used Hbase / Cassandra as NoSQL data store for high inserts and read for downstream app.

●Worked with customers to understand use cases and provided guidelines on analytics tools to use.

●Enabled customers to use Big Data platforms to streamline data processing and gain real time analytics.

●Build REST API to enable access to our data platform hosted on Hadoop cluster.

●Participated in all phases of Data product development from a business problem definition to building a scalable data platform.

●Worked in small team member to deliver products in Sprints, participated in code review, CI/CD deployment, cluster management (Cloudera)

●Managed and interacted with large datasets ~ 0.5 Petabytes from different domains (autonomous cars, employee data, logs data, tickets data)

Intel, Hillsboro, OR

Analytics Engineer, IT February 2011 – April 2014

●Engaged customers to gather data analysis and modeling requirements.

●Created ETL jobs using Ab Initio tool and SSIS.

●Lead Developer in moving stored procedures from TD into ETL tool Ab Initio.

●Created databases and data models for business problems from conceptual to implementation.

●Developed multidimensional analysis services and tabular database geared toward self -service reports and dashboards.

●Created self-service interaction dashboards and reports using SSRS, Power BI

●Participated in a project to move the existing Teradata environment to Hadoop/Hive Data Warehouse.

The Boeing Company April 2008 – February 2011

Software Engineer

●Performed and supported data warehouse modeling and ETL processing with Oracle and SQL Server. Responsible for project status reporting and defect tracking metrics.

●Performed change requests and interfaced with internal customers during requirements and support.

●Developed a Middleware program in Java/JDBC to transfer data between two applications.

EDUCATION

●Masters in information technology, Southern Polytechnic State University (Kennesaw State), Marietta, Ga

●B.S in Computer Engineering, Southern Polytechnic State University (Kennesaw State), Marietta, Ga

Contact this candidate