Post Job Free
Sign in

Aws Data

Location:
Dallas, TX
Posted:
September 07, 2020

Contact this candidate

Resume:

Chang Sun

adfv8a@r.postjobfree.com

248-***-****

Dallas, TX 75244

Summary

Over 20 years of data centric Information Technology experience in Finance/Banking, Healthcare & telecommunication as a Senior Data Engineer/Architect with several years of recent experience in multiple AWS Cloud services

Snowflake/RedShift Warehouse, DataBricks - Delta lake, AWS data lake – (Hadoop, Spark & Hive)

Experience in Amazon AWS – design, development, migration support – S3, EC2, AWS SnowFlake/Redshift, MongoDB, PostgreSQL, Aurora-MySQL, etc.

Passion for Oracle Technology has resulted in an in-depth knowledge of database internals and data structures with 15 years of database experience includes Oracle/SQL & NoSQL databases

Run job schedule programming using Crontab/Perl

Extensive hands on experience with UNIX shell script/Perl development for automation and job schedule programming using Crontab/Perl

Strong critical thinking, problem solving & analysis skill

Related Skills:

Hands on experience in Migrating IaaS/PaaS/DBaaS from on premises to AWS Cloud

Strong experience in migration/upgrade to RDS/Redshift/SnowFlake/EC2/S3 in AWS

Experienced in Redshift/snowflake/SQL Server/MySQL/PostgreSQL, Microservices Docker/Kubernetes

Technical Summary

Operating Systems: Linux, Unix/VMware & Cloud

Languages: Sql, Pl/Sql, shell/Perl scripting, Node.js/Java/Scala

Databases: MySQL/PostgreSQL/Redshift/snowflake/MongoDB & Oracle/SQL server

Tools: CloudWatch/Trail, Terraform/Ansible, Docker/Kubernetes/Terraform, DataBricks

Education

•Master of Business MBA – Info Systems - Wayne State University, Detroit, Michigan (2004)

•Bachelor of Science – Computer Science - Franklin University, Columbus, Ohio (1994)

Professional Experience

Mroad - Dallas, TX

07/2018 - Present

Cloud DBA

Design & maintain AWS IAAS by Terraform/Ansible to deploy AWS services

Hands on migration Oracle/SQL servers’ databases to AWS RDS/Snowflake

• Design and develop snowflake pipe from kinesis stream=>firehose => S3 to load Snowflake data warehouse

• Provisioning snowflake databases, data sharing, create virtue warehouses to load from external source

• Configure and perform python interface to connect Snowflake database using Snowflake connector

• Write queries to join structured(csv) & semi-structured (Json, xml etc) data in snowflake data warehouse

• Run Databricks Delta Lake to pushdown query to snowflake for BI or Tableau Analytics

• Design and develop queries for Tableau BI infrastructure team to consume data from Snowflake

• Migrate oracle databases to snowflake, leverage snowflake capability using ELT vs ETL

•Hands-on experience with Snowsql implementation (JSON, XML etc) data from S3 to Snowflake

Configure yaml files to access the AWS console from AWS CLI and involved in migrating databases to AWS

MicroStrategy performance to connect Redshift with drivers, building infrastructure data pipeline workflow on premises to AWS data lake - Hadoop, Spark, Hive.

Install & configure Oracle/SQL Server databases migration tool such MDS, SCT & run assessment reports, implement initial load, partition and CDC on Apache Spark using Scala and configure and implement IntelliJ and SBT to implement initial load and CDC data.

SkillStorm - Dallas, TX

03/2015 –06/2018

Cloud DBA/Architect

Involved in implementation of infrastructure as code in AWS database & services and hands on migration from Oracle/SqL Server PostgreSQL to AWS aurora & Redshift

Strategy migration to AWS cloud including EC2, VPC, RDS, and Redshift, worked on Migrating Oracle/Sql Servers to AWS Aurora, Redshift using SCT, MDS and Glue

Hands-on Aurora PostgreSQL & MySQL for performance & troubleshooting, utilizing Big Data technologies like Hadoop, Apache, Spark & Pig/Hive

Performance service such as CloudFormation, EC2, ELB, SNS, SQS, S3, utilizing programming skills with Scala, SQL/PL SQL, PIG Latin, HiveQL

Install & configure Oracle/SQL Server databases on Premise and AWS Cloud, Diagnostic evaluation (ADDM, AWR, ASH), tuning (SQL tuning, indexing, partitions)

Maintain Oracle RAC for Disaster Recovery & Failover/Switchover, using expert DBA level and involved in shell scripting

Responsibilities include Backup and Recovery (RMAN, Cloning, Data Guard, Export/Import), Install & configure Oracle Data Vault, Exadata & encryptions on databases

Involved in Oracle patch provisioning, performance tuning of AWR/ASH Reports, Golden Gate Replications 11gR2/12c: Active/Passive & Active/Active

Using Hadoop & Spark ecosystem in Yarn for Pig/Hive/HBase to process data

Configured SQL server for log shipping/cluster/replications/mirroring & Always ON and SQL Server 2016 administration backups/restore, failover/cluster & Azure SQL

Create & configure MongoDB in Premise and extended to AWS Cloud, and architecting data pipeline flow from premise to Cloud data lakes

Tek-System - Southfield, MI Nov 2014 – Feb 2015

Cloud/Data Architect

Lead data Center migration from premise to Exadata machine & Cloud, architecting data-flow strategies from end to end migration

Migrate data Centre to Cloud initiatives as AWS & Azure, Hands on migration from Oracle/SQL servers to MySQL/PostGreSQL

Modeling the logical designs to meet physical databases implementations.

Supervise & hands on configure Golden Gate replications migration for Oracle & SQL server, performed batch cycle verifications from source DB to UAT & stress tests on UAT environments

Handled the migration/clone DB and applications, using data pump in Aix/Linux environments and responsible for Oracle scripts automation for passwords change notification and recertification

Handled the migration/clone DB and applications using data pump in AIX/Linux environments, successfully implementing migration tasks on time within budget & achieved ROI objectives

Achieved ROI for business owners & shareholders objectives

Geisinger Health System- Danville, PA April 2014 - Oct 2014

Oracle Database Engineer

Install & test upgrade/patches 11gR2 DBs and VMware, Oracle database PSU patching in 11gR2 for PSU 2014

Service level UNIX shell script development for automating, Utilizing strong experience with Oracle Database in RAC & Non-RAC environment,

Perform Rman backup, DEV/QA databases replications & DB Administration, Backups, Testing, Test case scenarios,

Managing user migration including Citrix users/PC users/No-company users

Prod Parallel setup including Tidal CR/inbound/outbound interfaces implement, SQL Tuning using AWR/ADDM/ASH/EXPLAIN PLAN/TKPROF and Oracle scripts automation for passwords change notification & recertification

Dias - Ann Arbor, Michigan April 2011 – Mar 2014

Solution Architect

Led a team of 5 engineers for company`s Global initiative, Solution architect for sales team promotes migrating applications and services

Educate customers of all sizes on the value proposition, and participate in deep architectural discussions to ensure solutions are designed for successful deployment

Conduct one-to-few and one-to-many training sessions to transfer knowledge to customers, capture and share best-practice knowledge amongst the solutions architect community

Author or otherwise contribute to customer-facing publications such as whitepapers, build deep relationships with senior technical individuals within customers to enable them

Act as a technical liaison between customers, service engineering teams and support

Sutherland Global Service Inc - Windsor, Canada May 2004 – April 2011

Oracle Consultant/Data Architect

Architect Solution and technical support for company sales team, design data flow from QA, Test database into production environment.

Replicate by stream to transport source databases data to target databases, using shell script programming on Unix & Linux platforms.

Run job schedule programming using Crontab, proactively monitors PL/SQL performance and make CBO adjustments as necessary.

Serve customers inquiry on database for account receivable and payable, inquiry & testing development, test database before moving to production environments and run Oracle 9i/10g database with OEM in Linux/window environments.

Cummins Engine Inc - Columbus, Indiana Sept 2003 – Apr 2004

Oracle Dba Consultant

Apply multiple components in Oracle8i, 9i, 10g to consolidate distribution databases, response for specification, design and programming, documentation, and support of software

Analyze business requirements, specify and develop new programs, maintain current program, support end users; apply new technologies which could be used to meet current and future needs.

Franklin County Government Center - Columbus, Ohio Sept 1994 – Aug 2003

IT Developer/Dba/Unix Admin

Implemented the county real estate tax infrastructure with IT technology, performed unit testing with documentation.

Design, Model, Re-Engineer databases and develop prototypes to reflect initial requirements and fine-tuned performance of Oracle Adapter applications through stored procedures



Contact this candidate