Sql Server Software Engineering

Tao Zhao

* ******** ***.

Burlington, MA *****

Tel: Mobile 978-***-****

Email: *******@*******.***

Summary:

** ***** ** ******** ***********

** ***** ***** ********** **** AWS/Azure

** ****s with Python

20 years of software engineering development.

6 years of architect experience.

Education:

Tufts University, Medford, MA 1992-1994

Ph.D. candidate in Mathematics

China Academy of Sciences, Beijing, China 1989

M.S. degree in Computer Science

Skills:

●Cloud Platform: Amazon Web Service, Microsoft Azure

●Languages:

C#, Python, Java, C++,T-SQL, PL/SQL, PL/pgSQL, VC++, Powershell, Node.js

●Databases:

MS SQL server, Oracle 11g/12c, PostgreSQL, AWS Redshift, Azure SQL DB, Hasura GraphQL.

MongoDB, CosmosDB

●ETL tools:

AWS GLUE, Azure Data Factory, Apache Airflow, Kafka

●Frameworks:

.NET Framework, ASP.NET Core, Entity Framework, LINQ, WCF, WCF Data Service(OData), ASP.NET MVC, WPF,Web service, MS SQL server, SSIS Integration Service, SSRS.

Spring Boot, Spring Data ecosystem.

●IDEs:

MS Visual Studio, Microsoft Visual Code, Eclipse, JetBrians PyCharm, IDEA

●VM OS:

VirtualBox and Hyper-V, Docker, Kubernetes

●CI/CD Tools

Microsoft DevOps, Jfrog/TeamCity/Octopus, Jenkins. Github Action

●Web Frontend:

Angular, React, jQuery

Experience:

FMGlobal Inc. in Providence, RI 05/2024--now

Contractor/ Principal Engineer

1.Wrote Hasura queries for REST API and mento the API developers and Frontend developers.

2.Wrote Postgres functions for Hasura queries.

3.Wrote Powershell script and yaml files for meta data for Azuer DevOps CI/CD deployment to K8s.

4.Used Generative AI to validate the Hasura yaml meta data files. Before that the deployment took about 20 minutes only fond one error, with the domain knowledge, the Generative AI can help identified errors at compile time.

5.Wrote Code for the API developers with C# ASP.NET and Angular/React code

6.Wrote Web APIs with Python FASTAPI,

7.Wrote micro-service Java APIs with Spring Boot/MVC/Data eco- system.

8.Mentor the Rest API C# developers to integrate the Hasara Server.

9.20% of time to trouble-shooting and maintain the Kubernetes cluster for Dev and QA.

10.Wrote Postman collection test scripts for REST API tests.

Woodmackenzie inc in Boston, MA 02/2022- 05/2024

Principal Engineer/Architect

1.ETL data from S3 buckets to Redshift via GLUE in AWS.

2.ETL data from blob storage/SQL server/Postgres to SQL server/Postgres and Snowflake data warehouse via Azure Data Factory in Azure.

3.Wrote Databricks(Spark) Notebooks for analytics and visualization.

4.Wrote Grafana SQL queries to collect Kubernetes cluster metrics info and queries against Azure SQL database to show in dashboards.

5.Wrote Databricks pipeline to process steam natural gas trading data in Python with Delta Live Table,

6.Use Airflow to load and transform data in Databricks cluster.

7.Use Airflow to ETL3rd party customer data into Postgres database with Kubernetes Helm chart in airflow.

8.Use Powershell to load Excel files into Azure SQL database. Resolved ETL performance issues when importing multi-million row data from Excel file to SQL Servers.

9.Use Airflow to ETL3rd party customer data into Postgres database.

10.Migrate hundred of SSIS packages to Apache Airflow using docker and Kenernetes in Python.

11.Wrote PL/PG SQL Postgres script for views, functions, and Stored Procedures, and yaml file for Hasura meta data and Hasura queries for Graphql database, deploy to cloud with CI/CD Octopus/JFrog tools, It used Microsoft DevOps as CI/CD tools for 1 year and changed to Jfrog/Octopus tools eventually.

12.Wrote in house reporting system for generate daily reporting and informed subscribed customers.

Accenture in Boston, MA 11/2020-01/2022

Principal Engineer/Security delivery Manager

Join Accenture’s MDR(Managed Detection and Response) team to maintain and developed a Cloud security system.

3.Develop and maintain stored procedures and SSIS packages then deploy them to hundreds of SQL servers on AWS cloud.

4.Develop and maintain Ansible & Terraform scripts then deploy to AWS cloud via Jenkins Server.

5.Maintain and create new Grafana dashboards to visualize the latency charts on Servers and send alerts to Slack.

6.Coded and maintained ASP.NET core RESTful API as micro service on Azure and AWS hybrid environments.

OSRAM Sylvania Inc. in Wilmington MA

Lead Software Develop Architect 06/2018-11/2020

As the chief software leader, leading a 28 engineers global groups, I architected the next-generation cloud computing system based on Amazon Web Service migrating from on-promise and lead a global team to implemented it on AWS in 2.5 years and maintain it. The software needs offer global wide customers to manage their data and meanwhile the software also collects the operation sensor data to save on the cloud.

1.Architected web application for customer to manage their data with Python and Django, backend using Postgres and RDBMS and MongoDB No-Sql servers.

2.Architect the machine learning system to find useful information on the data lake, architected the deep learning System in Python. Used Convolutional Neural Network to find some patterns buried inside the data. Used time series forecasting the Sales and Inventory tendency.

3.Integrated the poly Computer language web sites with RESTful API that integrated Java, Python and .NET core and Node.js web sites. Java micro service used Sping/Spring boot framework.

4.Code review for the team’s check-ins of Angular, React, jQuery.

5.Used Docker to deploy our software to container for easy deployment. I developed the Dockerfile, docker-compose.yml, Microsoft DevOps for CI/CD pipeline and Kubernetes yaml files for our Kubernetes clusters.

AIR worldwide. in Boston, MA 02/2014-06/2018

Senior Software Engineer

1.Use Glue to ETL the Perabyte data from the S3 bucket to Redshift as cloud data warehouse

2.Wrote large query and optimized on Redshift to get aggregate result for machine learning.

3.Wrote Athena federated queries across various data source from Data Lake. Data source include HBase, Hive and MongoDBs and Blob Storage.

4.Joined a pioneer cloud and big data team to leverage the new technology in the company existed application. I wrote Machine Learning code in Python in predictive analysis for Reinsurance models. This project uses Hadoop platform initially and switch to Spark platform since 2016, It support both AWS and Azure public platform. It uses CosmosDB on Azuer and MongoDB on AWS. I wrote the CosmosDB stored procedures in javascript and data manipulation code in C# and Wrote MongoDB data manipulation code on AWS with Python. I also did the performance tuning on both No-SQL databases.

5.Designed Tableau reports of the query from Redshift and Athena.

6.Designed and implemented the mega load of multi TB size data into Data warehouse with partitioned tables and SSIS packages.

7.Designed and coded Web-based deployment application with ASP.NET MVC 5.

8.Designed and porting data and schema from on- premise SQL server databases to Azure SQL server databases . Wrote Powershell script to deploy database to Cloud

9.Wrote Powershell script using DSC to configure Windows servers and SQL server on-premise.

10.Design AWS Redshift data warehouse database schema, write UDFs, performance tuning, and loading large volume data into and export from Redshift .

11.Design and coding distributed databases cross multi SQL SERVER with multi Tera byte Data.

The deletion cross databases and servers used to take hours. I re-designed a framework for such deletion with acceptable performance using stage of deletion.

12.Coded SQL Server asynchronous triggers to off load some CPU extensive jobs off the peak time.

13.SQL server 2012/2014/2016/2017 Performance tuning ;

14.Write Linux scripts for deploy daily build database to Linux Box and generate Docker images

15.Wrote C# assemblies for installing in SQL CLR;

16.Using Power Designer for model design to generate schemas (table, index, trigger, foreign key) .

17.Wrote Entity framework classes as DAL layer for multi-tier WPF big data application.

18.Change the Database from Oracle to MongoDB when the data is too big for Oracle to handle.

19.Wrote Java and PL/SQL package to parse and load txt file into Oracle database running on Linux box.

Bit9 Inc. in Waltham, MA 06/2010 - 12/2013

Database Architect

Bit9 is a network security company, I joined a team operate the private cloud running in Medford, MA. Trouble shooting hardware and software problem such as DNS configuration, SAN configure, Nagios configure, replace disks and RAMs.

Lead a DBA team to manage all online databases with size up to 3TB(Very Large OLTP DB).

1. Design the High Availability Databases solution for the whole company using always-on, clustering, log shipping and replication for all the huge size databases with size of multi TB on SQL server. The web sites and web services reached over 99.99% availability satisfied customer’s 7x24 requirements. Managed all online databases in data centers.

2. Designed the quickly disaster recovery strategy, Backup and restore and DBCC integrity check.

3. Wrote over 500 SSIS packages for the ETL jobs running on premise Windows server and Amazon Linux servers..

4. Wrote stored procedures for the SQL server scheduled jobs. Performance tuning those stored procedures

5. Created indices, triggers and partitions for the databases.

6. Coded functionalities using new feature such as CDC, asynchronous trigger.

7. Designed and wrote the core data service layer with Microsoft Entity Framework 4.x and LINQ to Entity, which is the interface for all applications communicate with databases. I also did the Performance tuning the Entity Framework and LINQ to Entity.

AIR worldwide. in Boston, MA 01/2010 - 06/2010

SQL server Database consultant

1. Performance tuning the SQL server 2005 and 2008 databases, improved the SQL server performance and web database access process for the company's flagship application.

2. Solved the database access bottleneck problem by create more indices and rewrote the stored procedures.

3. Designed and coded a concurrency problem when multi users race the same resources.

Thomson Reuters/Financial. in Boston, MA 03/2008 - 12/2009

Principal Software Engineer(PORTIA)

Worked as a key member in Portia team.

1. Work on the Portia Perform project that used C#,C++, XML and ASP.NET2.0.

2. Worked on Portia Perform which evaluation the portfolio management performance against benchmarks. calculated each aspect's attributions to the total gain/loss.

3. Extended the Portia Services to support Portia10.0 new features and meanwhile backward support old Portia version from 8.0 to 9.21. This is a Windows service that can inter-operate with Portia COM interfaces and new Portia’s .NET interfaces.

4. Worked on Portia 10.0 to add the Fund accounting features wit C# and C++.

5. Wrote WCF services that exposed the existed COM+ objects as web services with strictly security access control;

ArrowStreet Capital Inc. in Boston, MA 03/2006 - 03/2008

Associate, Application Development

1. Worked as team leader of Active Currency Trading project, architected and design the components, created new database tables and stored procedures; modified the existed in-house VB applications that integrated with the optimizer to support currency trading optimization.

2. Wrote Win Form application in C# as database tools for the use by IT team and non-IT users. This tool also has CLI interface so that daily scripts can call the application to backup/restore the SQL server databases.

3. Trading floor technical support ( hot fix the ad-hoc problems during the trading session and trouble -shooting the system identify the system problems in a very quick time; draft system change technical advises to Portfolio managers)

4. SQL Server trouble-shooting in very quick time frame.

Boston Communication Group Inc. in Bedford, MA 08/2003-03/2006

Senior Software Engineer

Developed wireless software based on Oracle database with .NET C#/C++.

Developed a web service with Java.

EVARE LLC in Burlington, MA 05/1997-05/2003

Senior Software/Database Engineer

Developed a fixed income portfolio management software with C#, C++ and SQL server.

Contact this candidate