Mark Nielsen
Warwick, Rhode Island
**********@***********.***
Highly skilled IT professional with a successful track record in creating stable, innovative, and productive database environments. Experienced in working with MySQL, MongoDB, and Snowflake databases, utilizing Python and BASH in Linux environments. Proficient in documentation, failover, High Availability, and efficient database setup. Certified in MySQL, MongoDB, and Linux.
Prefer MySQL, MongoDB, Snowflake, Redis or other Clouds positions. Ever since evaluating Snowflake, it has become a major focus.
Highlights
Education
oThe Ohio State University
4 years in Math but did not graduate. Jobs were too good.
oCurrently : The University of the People
degree: Bachelor's degree in Computer Science
Enrolled 2022-08 to present
Certifications
oAWS
Certified Cloud Practitioner, July 2023
oMongo
Mongo DBA, May 2023 (recertified)
MongoDB Certified Developer and DBA (2017)
oMySQL
5.1 Cluster Certification June, 2009
5.0 Certification June, 2009
Professional Certification, 2004
Core Certification, 2004
oLinux
LPI Level I and II, 2004
LPI Level 1 and II, 2001
Novell Certified Linux, 2011
SAIR Linux Certified (2011, 2005, 2001, 2000)
Pipeline
oConvert data into MySQL, PostgreSQL, Mongodb, AWS, from various formats.
oLoad data efficiently into databases.
Complex Queries, Tuning, Performance
oWindow Functions, subroutines, derived tables, joins,
oExplain (or equivalent), Linux and database tuning
Document installation, configuration, upgrade, failovers, etc, and how-to-fix, how-to.
oTest, QA, and Performance
Cloud
oAWS : RDS MYSQL, Auroa, EC2 (MongoDB. Mysql and others), S3, Cost Explorer, Storage Gateway, Direct Connect, Lambda, DMS, DocumentDB
oAzure: MySQL, Cosmos MongoDB
oGCP : Compute Engine (MySQL, and MongoDB)
oSnowflake evaluation at ActiveVideo
MySQL : All all jobs, installation, configuration, scripts (bash or Python), HA, DR, Failover, performance tuning, upgrades, backups, schema changes, and with a few companies data migration. Percona Cluster a few times. NDB once. ClusterSets at T-Mobile.
MongoDB : 5 years
oT-Mobile : Installation mostly with some debugging
oActiveVideo : Maintenance and fixing problems, query optimization
oGameTime : Debugging nagios alarm, upgrading, performance tuning, and query optimization
oReputation : Managed several shards and many replica sets, performance tuning, configuration, upgrading, fixing issues, backup and restore, scripts including monitoring scripts
PostgreSQL : 4 years : Nuasis, SigFig
Redis : 4 years : MachineZone, Reputation.com, ActiveVideo
Articles:
ohttps://linkedin.com/in/markandset
ohttps://github.com/vikingdata/articles
ohttp://odendata.com
oOlder articles at http://www.menprojects.com.
ETL:
oDPT : PostgreSQL, Snowflake
oMySQL to MySQL Datamart and summarized tables
oMySQL to Pentaho
Programming : Good at Bash and Python. These were used at all jobs.
Linux : Used Linux at all companies. Debug issues and analyze if something is wrong. Use to be a Linux Admin.
SQL : Used at all companies. Derived tables, CTE, multiple joins, window functions, virtual columns, and more
Career History:
Senior MySQL DBA, five9.com (through Select Group) January 2024 - present
On contract
Major responsibilities
-MySQL (5.6, 8.0) : Installing, running DBA tasks, some oncall, debugging, optimizing
Other responsibilities/skills
-Anisble, rundeck, Openstack
-Python Bash
-CockroachDB, MongoDB
-Linux : Centos, Ubuntu
Senior MySQL/MongoDB DBA, Contractor T-Mobile (through TCS) March 2022 - April 2023
Prioritized MySQL installation on virtual environment, including ClusterSet setup and upgrades
Assisted with MongoDB 5.0 installs.
Documented ClusterSet installation, configuration, and management procedures
Troubleshoot and resolved ClusterSet issues
Developed Bash and Python scripts for installation, verification, cronjobs, and other tasks
Worked with MongoDB, AWS Aurora, ServiceNow, Virtual Systems, Confluence, Jira, Prometheus, and RedHat Linux
Half the department laid off in April. Somebody didn’t fund the department.
DBA SRE and Data Engineer, ActiveVideo (full time, then moved into contracting Part Time), April 2020 – December 2022
Assisted in transitioning to new project and decommissioning old systems
Oversaw and stabilized CloudTV environment, rewriting critical parts from C into Python for improved performance
Migrated MySQL to AWS and Azure
oFor AWS used DMS on EC2
oFor Azure, setup servers and migrated (was abandoned in favor of AWS)
Assisted in converting MySQL databases to the cloud using Kafka/Spark
Created and implemented data integrity and quality processes, ensuring proactive monitoring and identifying bottlenecks
Created MySQL dashboard and explored Snowflake and PMM
Proficient in RedHat Linux, Jira, Confluence, Nagios, and Docker
Moved to part-time in February 2022, due to full time position being cut (5 hours a week) and fulltime job at T-Mobile.
MongoDB ( a few servers) and DocumentDB
Company went out of business.
Senior MySQL DBA, ADP, Los Angeles, CA, July 2019 – January 2020
6 month contract
Developed automated backup script using BASH, Jenkins, and Jira
Ensured data integrity through backup management
Created installation with Docker to setup dev environments on a Mac.
Developed a database dashboard using Python
Proficient in RedHat, Jenkins, and MySQL DBA tasks
Senior MySQL Data Engineer, SigFig, San Francisco, CA, December 2018 - May 2019
6-month contract working on MySQL conversion to Percona from MariaDB, and help with schema changes, backup, and failovers
Analyzed DBA setup, looked into Puppet, VMWare and Foreman.
Upgraded MariaDB 5.5 to Percona 8, including multi source replication
Used Percona tools, pt checksum, pt-osc, pt-online-schema-change etc.
Managed PostgreSQL 9.X and 10.X servers and performed Python and Bash scripting
Developed database dashboard and implemented PMM
Proficient in Git, RedHat, Confluence, and Jira
Also managed PostgreSQL servers
Senior AWS Database Consultant, HP, Palo Alto, CA, June 2018 - December 2018
6 month contract focused on AWS systems, MySQL RDS, and Aurora
Designed schemas, optimized queries, data verification, Aurora configurations for storage and architecture
Migrated initial data load, both into MySQL and Aurora
Managed data pipeline using Lambda, Glue, and S3
Senior MySQL Consultant, Nexant, San Francisco, CA, May 2018 to June 2018
Two month contract to validate the MySQL environment as they didn’t have a DBA.
Verified configuration, created Dashboard for analyzing MySQL, identified errors, suggested slow log reports, and suggested future options. DBA administration and DevOps
Created a simple database dashboard using Python
Created plan to move to EC2, then optionally to Aurora. There were security reasons not to move right away.
Other Skills : Ubuntu
Suggested how to migrate to AWS if they want to in the future.
MySQL DBA and Data Enigneer, Sears, IL, June 2017 to December 2017
6 - month contract for MySQL 5.5 to 5.6 migration, serving as a DBA, SQL programmer, and stored procedure developer.
Conducted upgrades and performed Python programming on Linux and Windows platforms.
Implemented the conversion from Windows to Linux, ensuring scalability, backups, restore, failover, and HA procedures.
Explored MongoDB usage but migrated the project to AWS RDS.
Assisted with HAProxy load balancer configuration.
Utilized Lambda and Glue for triggering real-time reports.
Mongo DBA, Gametime, San Francisco, CA, April 2017 – June 2017
Contracted to optimize, upgrade, analyze, and provide recommendations for MongoDB servers hosted on AWS. Developed a Python script to archive unused data. Responsible for database administration and DevOps tasks.
Created a Python-based mini dashboard to monitor the MongoDB servers.
Implemented a data pipeline using MongoDB and an ETL process with AWS Glue to generate reports on a MongoDB server.
Concluded the contract after successfully diagnosing existing issues and implementing an upgrade plan.
Additional Skills: Red Hat
Systems Administrator, OOMA for Mindsource, Sunnyvale, CA, April 2016 to November 2016
Managed 2600 systems using Python and Bash scripts during a 5-month contract. Facilitated automation of system installations and upgrades, primarily through Python scripting. Worked with BigCouch databases, a derivative of CouchBase. Also handled a small Cassandra setup.
Senior MySQL Database Administrator/SRE, MachineZone.com, Palo Alto, CA, 2013 to March 2015
Performed direct hire responsibilities, including Percona MySQL 5.5/5.6, Ubuntu, Python, Nagios, Graphite, Grafana, Redis, and database administration and architecture.
Developed a database dashboard and various tools using Python to automate MySQL installation and configuration. The dashboard encompassed predictive analysis, server comparisons, historical and live information, and involved some work with Puppet.
Explored the use of HAProxy but ultimately decided against its implementation.
Led a team of two other MySQL DBAs.
Automated, monitored, installed, managed, optimized, and conducted query analysis. Guided other DBAs and participated in the design of new databases.
Collaborated on an ETL process from MySQL and MongoDB to Hadoop.
Managed a small MongoDB cluster, including upgrades.
Managed a small PostgreSQL cluster.
Additional Skills: Red Hat
Senior MySQL/MongoDB Database Administrator/SRE, Reputation.com, Redwood City, CA October 2011 to May 2013
Engaged in direct hire responsibilities, such as MariaDB 5.2 and MongoDB 2 (including Replica Sets and Sharding), Nagios, Ubuntu, Python, Bash, Percona, Percona InnoDB Cluster, MMS, ETL, database administration and architecture, DevOps, Redis, and AWS.
Installed, automated, monitored, managed, optimized, and conducted query analysis for databases. Also participated in architecting new databases.
Assisted in migrating data to AWS EC2 systems running MongoDB.
Developed a simple database dashboard using MongoDB and Python, which was presented at a Mongo Conference.
Supported the ETL process to Pentaho.
Created MySQL and MongoDB dashboards to monitor health and performance.
Assisted with upgrades, administration, query optimization, and performance improvement.
Assisted in investigating the migration to AWS, ultimately shifting to MongoDB entirely, rendering the need for a MySQL DBA unnecessary.
Additional Skills: Red Hat, Nagios, Grafana
Senior Database Administrator/DevOps, ActiveVideo in San Jose, CA, March 2010 to October 2011
Responsible for Percona MySQL 5.1 and MariaDB 5.2, Nagios, Linux, Python, and Bash. Handled DBA administration, database architecture, DevOps, ETL, and data warehousing.
Developed a highly efficient ETL Python program for processing input data into a datamart. Implemented features like MultiProcessing, zip, and object-oriented programming. The primary goal was to utilize Python for data ingestion and ETL across multiple cores, which the previous program was unable to achieve.
Established a data pipeline with the following steps:
-Obtained data via FTP or HTTP protocols
-Utilized Python (original script) to insert the data into MySQL
-Performed ETL operations to transfer data to a MySQL report server using Python
-Enabled online access to reports via HTTP, later transitioning to Google Studio
Senior DBA/DevOps, Ribbit, Mountain View, CA, January 2009 to March 2010
Responsible for Percona MySQL 5.0, Percona MySQL 5.1, MySQL Cluster development, Nagios, Linux, Python, and Bash. Handled DBA administration and DevOps.
Developed a simple ETL process to generate concise reports, enhancing data analysis capabilities.
Managed one PostgreSQL server, ensuring its optimal performance and availability.
Senior DBA-MySQL, Yahoo!, Sunnyvale, CA, November 2006 to December 2008
Actively involved in MySQL, ETL, MySQL NDB, Python, Linux, DBA administration, database architecture, DevOps, and data warehousing.
Created a comprehensive Database Administration Dashboard that remained in use for five years even after being laid off. Demonstrated expertise in designing efficient dashboards throughout subsequent roles.
Installed, managed, optimized, and performed query analysis for MySQL databases. Provided guidance to other DBAs and contributed to the architectural design of new databases.
Led the management of the ETL process, primarily focused on transferring data from MySQL to summarized MySQL tables.
Established a data pipeline encompassing the following stages:
-Applications wrote data to files.
-Data was aggregated by the hour and stored in MySQL databases.
-Reports were generated based on the MySQL databases.
Senior DBA- MySQL, CNET, San Francisco, CA, November 2005 to November 2006
MySQL-focused role involving ETL, Python, Linux, DBA administration, database architecture, and DevOps.
Installed, managed, optimized, and performed query analysis for MySQL databases. Guided and supported fellow DBAs and played a crucial role in designing new databases.
Managed PostgreSQL servers alongside MySQL databases, showcasing proficiency in multiple database systems.
Senior DBA – MySQL, Google, Mountain View, CA, January 2005 to October 2005
Engaged in a MySQL-focused role, handling ETL, Python, Linux, and DBA administration responsibilities.
Worked in a Linux environment, utilizing Python for scripting and automation.
MySQL DBA, CNET, San Francisco, CA, October 2004 to December 2004
Operated as a MySQL DBA, taking charge of ETL, Python, Perl, Linux, Sybase, DBA administration, database architecture, and DevOps tasks.
Leveraged Python and Perl scripting languages for automation and data manipulation.
Systems Administrator, Nuasis in Mountain View, CA, March 2003 to October 2004
Focused on Perl, WhiteBox Linux (RedHat), KickStart, RH Satellite Server, and automation.
Managed PostgreSQL databases
Skills and Other
MongoDB
1.Creating database schemas
2.Performance Tuning
a)Indexes
b)Slow queries
c)Examining and applying aborted queries from a failover.
d)In Python, wrote script to analyze the random time queries take to query collections and how they slow down over time.
e)Changing startup options.
3.Installation by tar, automation, or rpm (or deb)
a)Single server
b)Replica set
c)Sharded environment
4.Monitoring
a)Wrote scripts to add to monitoring systems.
b)Wrote dashboards in Python.
5.HA and Failover
a)Geo spaced servers for Failover
b)Replica sets and sharding
6.Others : Aggregation Pipeline, Atlas, OPS Manager, Encryption Client Side, Encryption on Servers, Functions client or server side, Authentication and Authorization, Security, Atlas, OpsManager
MySQL
1.Baremetal, AWS (EC2 or RDS or Aurora) using MySQL Community, Percona, or MariaDB
2.Cluster
a)ClusterSet starting with 8.0.27
Upgrade from standalone or replication to Cluster.
b)Percona Galera Cluster
c)NDB cluserting (long time ago)
3.Performance tuning
a)Fixing Indexes
b)Running explain
c)Amounts of write and cpu times
d)Turning on debug tools like slow log and general log.
e)Looking at charts
f)Looking at startup options.
4.Data Design
a)Everything should have a primary key and all queries should use an index.
Turn on in the slow log queries without indexes.
b)Work with the software team to design a database.
5.Installation and update of MySQL, through rpm (or deb), ansible, tar file, etc.
6.HA and Failover procedures with Cluster, replication, load balancer.
a)Including Geo setup of different datacenters
7.Restoration or add a node to Cluster, Replication, or Standalone environment.
8.Monitoring
a)Made scripts to monitoring systems like Nagios and CloudWatch.
b)Made Python web monitoring systems with agents over HTTP.
9.Dashboards
a)Made dashboards when monitoring was too complicated.
10.ETL and data warehouse
a)Helped with ETL using queries or Pentahoo or other systems
b)Created Datamart and made Datamart more efficient by breaking up all data from one table to wo tables.
Other Skills
Python, Git, AWS (RDS, Aurora, S3, Cloudwatch, etc), Jira, Confluence, former Linux Admin, scrum, html, javascript, XML, PostgreSQL, Couchbase, Docker, Nagios.
Education & Certifications
1.Certified AWS Cloud Practitioner, July 2023
2.Recertified in MongoDB – May 2023
3.Dual MongoDB Certified Developer and DBA (2017)
4.Twice certified MySQL certification with Cluster (2009, 2004)
5.Twice LPI Linux LEVEL I and II; Novell Certified Linux, SAIR Linux Certified (2011, 2005, 2001, 2000)
6.Many Minor Certifications from Expert Rating, Mongo University, Udemy, and others in Python, Linux, MySQL, Redis, and Mongo.
Publications and Talks
1.Writing lots of docs for Oden Data in 2021 to 2023.
2.Written, not sure which web edition it was in for The Linux Gazette, an article about setting up MySQL Cluster on a single box.
3.In the August, 2003 web edition of The Linux Journal, wrote an article about executing and transferring from one computer to another using Python and Expect.
4.In the Feb, 2000 edition of The Linux Journal, wrote an article about one Multi-Boot system with 6 Linux distributions, FreeBSD, NT, and DOS.
5.In year 2000, wrote an article for SysAdmin about using MILAS to install Linux and Windows onto computers from one SCSI hard drive to 4 IDE hard drives using a normal computer with 4 hard drive removable disk drives. MILAS was written using Perl (with heavy use of Expect), standard unix commands, sfdisk, and rsync.
6.Have written 50+ articles for The Linux Gazette from 1998 to present. Articles involved programming, networking, hardware issues, installing, or configuring Linux systems and services.
7.Have written 5+ articles for Linux Focus from 2000 to present. Articles involved programming, networking, hardware issues, installing, or configuring Linux systems and services.
Community Participation
1.MongoLA 2013 conference speaker about DAD.
2.MongoSV 2012 conference speaker about DAD.
3.Created github repository (mostly empty) to put DAD software on.
4.Using an AWS server to calculate Ramsey numbers for fun. Side purpose is to develop a good Python class architecture to use for DAD.
5.Creating an open-source MySQL Dashboard which I made at all the companies I worked for. Now I am open sourcing it by creating a brand new version.
6.Creating Python scripts at CNET to automate MySQL tasks, among other things. Eventually, it will be open sourced.
7.Managed and organized the Ubuntu non-profit booth at LinuxWorld 06.
8.Presented MySQL Failover Techniques at a MySQL Users Group meeting in Oct 2005.
9.Participated in the MySQL Customer Advisory Board in Oct 2005.
10.Creating the MySQL.py module to install and manage MySQL. It is available at the Vaults of Parnassus or here (broken links now)
11.Creating the CPAN module Class::Inheritance which is available on CPAN.(broken link now)
12.Wrote articles in The Linux Gazette at linuxgazette.net.