Post Job Free

Resume

Sign in

Lead Database Engineer

Location:
Mill Valley, CA
Posted:
October 25, 2018

Contact this candidate

Resume:

AMOL NAIK

Email: ac7hra@r.postjobfree.com Phone: 415-***-****

LinkedIn: www.linkedin.com/pub/amol-naik/7/270/623/

SQL Database Architect/Data Engineer

Experienced, committed and dependable database and IT professional with over 19 years of experience in IT, including 16 years working experience on Microsoft SQL Server. Strong hands-on experience designing, developing, deploying, administering, optimizing and maintaining SQL Server databases and ETL. Functioned in variety of roles such as Sr. Database Architect, Lead Database Engineer, Data Modeler, Development DBA, Production DBA, Database Developer, SSIS/ETL Tech Lead and Data warehouse developer. Currently working as Senior Data Engineer at Glassdoor, Inc responsible for designing, developing high performance and scalable data pipelines. Excellent communication, analytical and problem solving skills and ability to multi task. Passionate for developing database solutions with current interest in exploring and experimenting Big Data world using Hadoop technology.

Technical Skills & Expertise:

Architect, Design, Develop and deploy database solutions using Microsoft SQL Server 2016/2012/2008 R2/2005/2000 in AWS, Azure.

Proficient in Data Modeling and Database Design skills using ERWIN & Embarcadero ER Studio.

Experience in Data Engineering technologies such as Hadoop, Hive, Presto, Python and Airflow.

Skilled with Database development and Query optimization techniques.

Strong experience designing and implementing ETL solutions using Microsoft SQL Server Integration Services (SSIS) and Microsoft Visual Studio/SQL Server Data Tools (SSDT).

Strong Database Administration skills such as Database Maintenance, Backup/Restore, Performance Tuning, Database Monitoring using DMV’s, Index Tuning & Maintenance, Capacity Planning and Transactional Replication.

Experience implementing database security based on user access control.

Hands-on DBA experience working in a 24x7 highly available, reliable, secure and high transaction/up-time Clustered Production OLTP environments involving multi-server.

Well versed with High Availability/Disaster Recovery techniques using Clustering, Log Shipping.

Experience designing multi-tenant database solutions in SaaS and PaaS based environments.

Hands-on experience designing and developing ODS and star schema based Data warehouses.

Experience leading and motivating a technical team comprising of Database and ETL developers.

Other Programming and technical skills include Operating systems such as Windows Server 2012/2003/XP, databases such as Sybase, Oracle, MS Access and programming languages include VBScript, VB.NET, C, C++ and HTML.

Hands-on experience using third party database tools such as Red-Gate, SQL Sentry and App Dynamics.

Deep understanding of SDLC and experience implementing Software Change Management using tools such as Git, TFS, MKS Integrity, VSS. Experience working with JIRA.

Experience working for different industry domains such as Retail, Insurance, Manufacturing, Mortgage Banking, Entertainment, REO and Procurement & Sourcing.

Education:

Goa University, Goa – India

Bachelor of Engineering (Computer Science) – First Class with Honors (1993- 1997)

Professional Experience

Lead Database Engineer/Sr. Data Engineer July 2014 – Present

Glassdoor, Inc. – Mill Valley, CA

As a Senior Data Engineer, I am responsible for following activities:

Write and optimize Hive Queries to load data to dimension and fact tables into Hadoop system.

Design and create Hive Partitioned tables.

Deploy DAGs to Airflow node.

Develop and maintain Airflow DAGs using Python.

Interact with Data Scientists on day to day basis to get data verified.

Develop Sqoop jobs to import data to HDFS from Source SQL Server system.

Developed a API process to connect and bring in Sales force data.

Involve in Production Support and deploying releases to Production and QA.

As a Lead DB Engineer, I was fully involved in Database Engineering and Architecture activities with special emphasis on OLTP & ETL design and development.

My major accomplishments and responsibilities at Glassdoor were:

• Architected and implemented a complete home grown, flexible, lightweight Transactional Replication using T-SQL and

SSIS. This in-house solution has replaced the existing native Transactional Replication which is not only is robust and

scalable but also reduces any kind of maintenance overheads that typically comes with native replication. This is

architected as Publication As-A Service, allowing subscribers to subscribe to the publication service as needed.

• Lead database architecture initiatives.

• Architected Table Partitioning, maintenance and archiving framework for large tables using sliding window technique.

• Designed a solution to efficiently scrub PII in non-Prod systems and an automated discovery process to detect newly

added PII in Production.

• Evaluated AWS RDS vs EC2 migration in terms of cost, performance, maintenance efforts.

• Provisioned and built EC2 instances in AWS for migration efforts and worked with the IT, Network and Security team

• Currently involved in upgrading Database Servers from SQL Server 2008 R2 to SQL Server 2016.

• Designed and implemented a DR strategy that hosts a redundant copy of critical OLTP databases in AWS (EC2) using

SQL Server log shipping technique.

• Created lower environments such as QA and Stage using the EC2 AMI snapshot feature using AWS CLI.

• Made use of AWS Snowball device to transfer full backups every other week.

• Led and managed variety of database projects such as migrating large high volume transaction tables to support big

BIGINT numbers.

• Working with International team members to support new country launches.

• Involved in query tuning and database performance optimization.

• Participate in Production database maintenance activities.

Technology Leader (Sr. Database Architect) June 2013 – June 2014

Global e-Procure Inc. – Clark, NJ

Building the next generation Enterprise procurement & sourcing platform (SMART) on Cloud. A very complex PaaS Enterprise architecture with multiple technology stack built on Windows Azure Platform. The team to pull this off is 110 folks. Hired as one of the Technology Leaders to provide technical leadership on the database.

Lead and mentor a team of SQL DBA’s and SQL Developers.

Design and implement database architecture for OLTP and Data warehouse on SQL Azure.

Define policies, best practices, guidelines for database design and development.

Review OLTP & Data warehouse database code for performance optimization.

Educate Project team members on database best practices.

Collaborate with Chief Architect, Technical Architects, Technical leads and Product analysts on the overall architecture, design and development of the SMART Product.

Collaborate with the ETL/Reporting developers to define the development path for Data warehouse/Reporting.

Sr. Database Architect/Team Lead (SQL and ETL) May 2011 – May 2013

Equator, LLC – Los Angeles, CA

Architect and design database systems including OLTP, Data warehouse, ODS and BI systems.

Define policies, best practices, guidelines for database architecture.

Perform DBA activities, Backup & Restore, indexing, statistics, alerts & notification, performance tuning for database servers, DB performance tuning and Query optimization, apply advanced features such as table partitioning, table compression to optimize DB performance and space.

Implement database security for defining user access to the database schema and objects.

Monitor and manage system performance and capacity, taking proactive actions to increase capacity to meet demand by suggesting hardware upgrade including disk, memory and processor.

Lead, design, implement, maintain, review, optimize and unit test Database and ETL solutions for OLTP, ODS and Data warehouse ensuring adherence to defined corporate standards.

Leverage SQL 2008 features such as CDC (Change Data Capture) and CT (Change Tracking) to implement incremental data load strategy for ODS and Data warehouse system.

Design and implement staging area by leveraging database schemas.

Design, lead ETL efforts to push Data warehouse and ODS data to client data marts by leveraging BCP IN/OUT using Execute SQL Tasks, Parent/Child package configuration and Parent variables.

Schedule, monitor and debug SQL Jobs and ETL (SSIS) Packages.

Manage a team of onshore and offshore ETL/DB developers across US and India, by delegating, reviewing projects and providing technical leadership.

Ownership of a project from requirements gathering to Production rollout using the SDLC.

Collaborate with various teams such as Production DBA’s, business analysts, application developers, Project Managers, IT Infrastructure, QA, release engineers, IT security and client account managers. Participate in technical conference calls with clients.

Hired ETL engineers and trained them.

Sr. Database Administrator Jun 2009 – May 2011

Equator, LLC – Los Angeles, CA

Maintain and administer Development, QA, UAT, Staging and Production OLTP databases.

Database design, development, DBA tasks such as backup/restore, login creation, setting up database maintenance utilities, setting up alerts and notifications, doing Production deployments, performance tuning. Create, maintain, optimize, deploy and monitor ETL Jobs using SSIS.

Implement and support Transactional replication, log shipping and database security.

Provide 24x7 Production OLTP database support as a part of DBA on-call rotation.

Mentor junior staff and provide technical support to clients.

Active SQL Server resources monitoring using SQL Sentry.

Interact with Directors, Managers, application developers, Infrastructure team, release engineers and QA to align goals, expectations and responsibilities.

Sr. Database Developer Mar 2008 – May 2009

Deluxe Digital Studios, Inc. – Burbank, CA

Serve as a single database resource in the entire development group and lead data modeling, database design, development efforts, perform DBA tasks & doing Production database deployments.

Perform DBA duties such as database creation, backup/restore, index maintenance, setting up database and transaction log backups, database integrity checks, DB performance tuning, run server side traces on a periodic basis to gather the database workload to help tune the database.

Author SQL development best practices document and provide database support to the Application development team as well as educate them on efficient query writing techniques.

Design file group layout for the Production database utilizing the different RAID levels.

Monitor and manage system performance and capacity, taking proactive actions to increase capacity to meet demand by suggesting hardware upgrade including disk, memory and processor.

Active database server monitoring for performance, growth using Idera SQL Manager.

Tune the performance of a large table over 100 million records by reducing the query response time from several minutes to less than 5 seconds using Table Partitioning.

Implement ETL processes using SSIS packages to perform data import/export using controls such as File System Task, secure FTP and Data flow transformations such as Look up, Conditional Split to extract, cleanse and load the Reporting database.

Optimized ETL (SSIS) data import job to reduce the execution time from 2 hours to less than 15 minutes for over 1 million records. Schedule and monitor SQL Jobs and ETL (SSIS) Packages.

Interact with Application developers, Project Managers, QA team, Director to align goals, expectations. Interviewing candidates for database developer positions.

COGNIZANT TECHNOLOGY SOLUTIONS US CORP

Sr. SQL DBA/ Lead SSIS Developer Jun 2007 – Mar 2008

SQL 2000 to SQL 2005 Database Upgrade – IndyMac Bank, Pasadena, CA

Impact analysis of Production DB systems and identify DB objects.

Re-architected all DTS to SSIS packages.

Manage and co-ordinate with offshore SQL team on the code remediation efforts.

SQL DBA/SSIS Developer Jan 2007 – May 2007

Database Archiving – IndyMac Bank, Pasadena, CA

Requirement gathering, DB design, ETL design and development using SSIS 2005.

Co-ordinate DB development with offshore SQL team, SQL code review and tuning.

Assisted the Production DBA with the rollout, assisted with Production support.

Data Architect/SQL DBA/ ETL Developer Dec 2005 – Dec 2006

Loan Sales and Settlement Automation – IndyMac Bank, Pasadena, CA

Attended the Business requirement analysis meetings with Business users.

Performed Data Modeling activities as defining logical entities, attributes, relationships, creating physical model, creating ERD, describing the attributes, modify design per requirement changes.

Developed the ERD and the DB design document, implemented database schema using the ERD.

Reviewed database design and solution with Data Architecture lead for database performance.

Database Design, Development, Administration, Performance tuning and monitoring.

Design, implement ETL processes using SQL 2005 SSIS to cleanse and load data to Data Marts.

Schedule and monitor SQL Jobs and ETL (SSIS) Packages.

Track and maintain database code in VSS, participate in Project status meetings with client.

Work with the offshore DBA team, Release team and Production DBA for database rollout.

Data Modeler/SQL Developer Aug 2005 – Nov 2005

iDRAW – IndyMac Bank, Pasadena, CA

Attended the Business Requirement analysis meetings with Business users.

Performed Data Modeling activities as defining logical entities, attributes, relationships, creating physical entities, attributes, creating ERD and describing the attributes.

Database design review with client Data Architecture Lead.

Implement physical schema, development of Stored Procedures, Views, Triggers and Indexes.

Perform SQL Code optimization and modify the design as per the changes in requirements.

Interact with the client on a daily basis and attending status meetings.

Suggest improvements in database design document and tracked the design changes.

Tech Lead/SQL DBA Feb 2005 – Jul 2005

Enterprise Rent-A-Car Billing Application – Cognizant Technology Solutions, Pune, India

Client: Enterprise Rent-A-Car

Perform project startup activities including preparing the project startup documents at offshore.

DB Design, development, SQL Tuning and DBA tasks. Develop and test DTS packages.

Lead and mentor a team of Application/SQL developers, Customer and Onsite coordination.

Ensure adherence to quality standards, project status tracking and reporting.

Software Configuration Management using VSS, lead project deliveries. Track and resolve Project related issues, Participate in the scheduled software quality and software release audit.

Tech Lead/SQL DBA Oct 2003 – Jan 2005

Sumitomo, 3M, Enterprise Order Center – Cognizant Technology Solutions, Pune, India

Client: Sumitomo, 3M - Japan

Requirement Analysis and use case preparation for database modules.

Data Modeling, DB Design, DB development, SQL tuning and regular DBA tasks.

Design and implement ETL process to parse, cleanse and load EDI format input files.

Schedule and monitor SQL Jobs and DTS Packages. Maintain DB objects in VSS.

Mentored and managed SQL developers & authored SQL coding guidelines checklist.

Created Production Database deployment document. Faced Internal Project Audits.

Ensured adherence to Quality standards, attended status meetings, sent status reports.

Acted as Defect Prevention Coordinator and Software Configuration Manager within the team.

Sr. Application and SQL Developer Mar 2003 – Oct 2003

Global GEI Policy system – Patni Computer Systems, Mumbai, India

Client: GE Financial Assurance, Stamford, CT

Requirement analysis, estimation, preparation of unit test plans.

Data Modeling, DB design, ASP, SQL, DTS package development, code review and SQL tuning.

VSS management, Unit & system testing and defect fixing.

ASP and SQL Developer Sep 2002 – Feb 2003

Real Estate Finance (Deal Origination and Tracking) – Patni Computer Systems, Mumbai, India

Client: GE Financial Assurance, Stamford, CT

Requirement analysis, design, estimation and preparation of unit test plans.

Developed ASP, SQL Code, DTS packages and Performance tuning of SQL Code.

VSS management, Unit & system testing and defect fixing.

SQL Developer/Production Support Analyst Oct 2000 – Aug 2002

Fulfillment Response reporting – Patni Computer Systems, Mumbai, India

Client: GE Financial Assurance, San Rafael, CA

Design and implement ETL data load strategy for importing flat files to database using DTS.

Automate Production batch jobs using DTS, VBScript thereby minimizing the user intervention.

Develop, Optimize Stored Procedures, Views, monitor and debug failed SQL Jobs.

Execute and monitor daily, weekly Production processes and deliver the reports to the Business Users.

Estimate, analyze and execute Change Requests, interact with Client users and IT Lead.

Software Developer/Onshore coordinator May 1998 – Oct 2000

Win Transaktor & Transaktor – Data Nova India Pvt. Ltd, Goa, India & Data Nova A/S, Oslo, Norway

Worked in a team to develop & enhance Point-of-Sales (POS) software that served clients in all of Norway.

Requirement analysis, design, estimation and preparation of unit test plans.

Developed Forms, SQL Code and Performance optimization of SQL Code.

Worked as Onshore Project coordinator at the Parent company Data Nova A/S in Oslo, Norway for 6 months between Jun 1999 – Sep 1999 and Jan 2000 – April 2000.



Contact this candidate