ETL/Big Data Developer

Sayed Sadat

Phone:

**********@*****.***

PROFESSIONAL SUMMARY

Having 6 Years of experience in designing, developing and maintaining large business applications such as data migration, integration, conversion, and Testing.

Domain experience includes Health, Insurance, Retail, and Financial.

Exposure in design and development of solutions for Big Data using the Hadoop eco system technologies (HDFS, Hive, Sqoop, Apache Spark, Python, Cassandra, AWS, Azure Databricks)

Worked extensively on Hadoop migration project and POCs.

Capable of processing large sets of Structured, Semi-structured

Brought in simplification process and Optimization initiatives to bring efficiency into applications.

Manned versatile roles across diverse applications as Data Engineer, Developer, QA engineer and automation projects.

Able to assess business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review.

Worked in Agile Methodologies.

Deep knowledge in incremental imports, partitioning and bucketing concepts in Hive and Spark SQL needed for optimization.

Create and maintain ETL specifications and process documentation to produce the required data deliverables (data profiling, source to target, ETL flows)

Have good problem solving and analytical skills and love to innovate in order to perform better.

Have strong Interpersonal skills, communication skills and people skills to manage a team.

PROFESSIONAL EXPERIENCE

Project Name: Metric5 contracting with USCIS (DBIS) April 2023 –Present

Project Role: Pyspark Developer/Big data developer

Metric5 is a customer-focused, employee-driven small business delivering digital transformation and modernization solutions for the Federal Government. Headquartered in Atlanta, Georgia. Metric5 combines mature technical expertise with the agility of a growing firm, specializing in mission-critical implementation, operations, and management solutions using Agile DevSecOps, cloud-centric architectures, and quality-first delivery practices.

Responsibilities

Designed, developed, and maintained ETL and data engineering pipelines using Databricks, Apache Spark (Scala, Python), and Informatica (PowerCenter, IICS).

Built and optimized batch and incremental data loads integrating Oracle and PostgreSQL with cloud platforms.

Implemented data ingestion and replication workflows using AWS DMS.

Automated ETL workflows, deployments, and monitoring using Jenkins and GitHub.

Collaborated with cross-functional teams to translate business requirements into scalable data solutions.

Monitored production pipelines and resolved performance and data quality issues.

Key Accomplishments

Improved ETL performance by optimizing Spark transformations and SQL queries.

Delivered cost savings by migrating legacy workloads to Databricks.

Increased pipeline reliability through automation and standardized frameworks.

Technologies: Databricks, Spark, Informatica, Oracle, PostgreSQL, AWS DMS, AWS S3, Jenkins, GitHub

Languages: SQL, Python, Scala

Project Name: Fiserv LLC Solution, Stafford TX June 2020 – March 2023

Project Role: Hive, Hadoop, Pyspark Developer

Fiserv is an American multinational company headquartered in Brookfield, Wisconsin that provides financial technology services to clients across the financial services sector, including: banks, thrifts, credit unions, securities broker dealers, mortgage, insurance, leasing and finance companies, and retailers.

Responsibilities

Performed Import and Export of remote data to AWS s3

Performed Import and Export of data into HDFS and Hive using Sqoop and managed data within the environment.

Involved in creating Hive tables, data loading and writing hive queries.

Performed necessary analytics in AWS Athena.

Processing XML, JSON, AVRO, Parque files

Work with client/customer to create technical strategies and frameworks

Working with other Delivery Leads to perform impact analysis on key initiatives

Understand and execute Change and Incident management

Data extraction and transformation load [Databricks & Hadoop].

Manage cluster Databricks.

Developing Spark applications using Spark – SQL.

Technologies: AWS S3, EMR, EC2, EMR, Hive, Sqoop, Hadoop, Spark, Databricks

Project Name: Adhere Health, Nashville TN April 2019– May 2020

Project Role: SQL BI Developer (SSIS, SSRS, SSAS)

Adhere Health is a Technology company located in Franklin, TN. By using tele pharmacy services or Software-as-a-Service (SaaS), the Adhere Platform™ touches nearly 30 million patients across dozens of health plans, self-insured employers, and other risk-bearing entities. As a comprehensive platform, it delivers tele pharmacy intelligent clinical workflow that integrates advanced analytics into a proprietary patient relationship management (PRM) tool, supporting better clinical outcomes, patient experience, and medical cost avoidance

Responsibilities

Gathering, analyzing and documenting the business requirements and business rules by directly working with end users/clients.

Created and maintained documents like Documentation Roadmap, DATA Models, ETL Execution Plan, Configuration Management Procedures, and Project Plan.

Designed and developed various SSIS packages (ETL) to extract and transform data and involved in scheduling and deploying SSIS Packages.

Published SSRS reports in Report Manager, SharePoint web pages and in custom made ASP.NET web applications.

Data extraction and transformation load [Databricks & Hadoop].

Manage cluster Databricks.

Created complex Stored Procedures, Triggers, Functions (UDF), Indexes, Tables, Views and other T-SQL codes and SQL joins for SSIS packages and SSRS reports.

Extract, Transform and Load data from databases of systems like CRM, ERP and SharePoint

Extracted and Loaded SharePoint Lists and Surveys Data into SQL Server Database with SSIS

Collaborated on multiple projects using GITHUB.

Created and scheduled Various SQL Jobs, using SQL Server Agent to perform various administrative tasks.

Project Name: Centaman, Chicago, IL March 2018 - March 2019

Project Role: SQL BI SSIS, SSRS Developer

CENTAMAN is recognized as a market leader in supplying software systems to the Attractions, Leisure, Tourism, Local Government and Education markets in North America, Australia and Asia. The CENTAMAN system covers a wide range of applications that include attractions venue management, ticketing, booking management, point of sale, and access control. Its clients are diverse and include Museums, Zoos, Parks, Aquatic Centers, Universities and Government agencies. CENTAMAN is based in Chicago with offices in Sydney and Melbourne, and is a subsidiary of Jonas Software, the leading provider of enterprise management software for more than 50,000 customers across 15 countries.

Responsibilities:

Involved in writing heavy T-SQL stored procedures, complex joins, new T-SQL features like Merge, Except commands

Dealing with automating SSIS Packages using SQL Server Agent Jobs, Windows Scheduler, and third-party tools.

Worked with re-directing outputs into different formats including XML Files and various other data sources.

Improved data standards, data exchange, XML data standard or data sharing model.

Developed SSIS packages using Lookup Transformations, Merge Joins, Fuzzy Lookups, and Derived Columns with Multiple Data Flow tasks.

Involved in several transformations in Data Flow including Derived-Column, Script, Slowly Changing Dimension, Lookup, Data Conversion, Conditional-Split and many more.

Worked on XML Web Services Control Flow task to read from XML Source.

Designed and developed various SSIS packages (ETL) to extract and transform data and involved in Scheduling SSIS Packages.

Developed ETL solutions for integrating data from multiple sources like Flat Files (delimited, fixed width), Excel, SQL Server, Raw File and DB2 into the data warehouse.

Interpreted data, analyzed results using statistical techniques and provided ongoing SSRS and PowerBI reports.

Created, maintained and updated ETL packages loading from/to both OLTP and OLAP database tables.

Developed and implemented data collection systems and other strategies which optimize statistical efficiency and data quality.

Created Complex ETL Packages using SSIS to extract data from staging tables to partitioned tables with incremental load.

EDUCATION

•Houston Community College

•Kardan University

Contact this candidate