Post Job Free
Sign in

Machine Learning Data Engineer

Location:
San Jose, CA
Posted:
October 23, 2024

Contact this candidate

Resume:

Karen Law

408-***-**** • *********@*******.***

Experienced software and data engineer with a strong track record in building Python-based data pipelines, backend microservices, and automation tools. Adept at designing and developing scalable systems to support AI, machine learning, and enterprise-level applications. Proven ability to reduce costs, enhance code quality, and deliver projects ahead of schedule. Expertise in ELT/ETL, distributed systems, cloud technologies, and database management, with a focus on delivering high-quality solutions for data engineering and automation tasks. Consistently exceeded management’s expectations, and finished most projects ahead of schedule.

Key Skills

Data Engineering: ELT (Extract – Transform – Load) and ETL (Extract – Load – Transform), data pipeline design, data management, synthetic data generation, data validation.

Database Management: PostgreSQL, MS SQL Server, MySQL, SQLite, Cassandra, GraphQL

Programming Languages: Python, Java, C/C++, Javascript, SQL, Bash.

Cloud & DevOps: AWS, Openshift, CI/CD, Docker, VMware, GitLab, SonarQube.

Tools & Technologies: RESTful APIs, Hasura, Cypress Testing Framework, FreeCAD, X3D

Software Development: OOD (Object-oriented design), agile methodologies, test-driven development, Pair-programming, full-stack development.

Automation & Virtualization: Test automation, PXE boot systems, VMware, Hypervisior, vSphere.

PROFESSIONAL EXPERIENCE

Airbus Innovation Center, Sunnyvale, CA

Software Engineer (March 2019–March 2024)

Joined as the Airbus Innovation Center’s ADAM project’s first Python engineer, established standards for software development as the group doubled in size, enabled it to quickly build prototypes to bring products to market faster, and earned Employee of the Month Award.

Spearheaded the transition to Python-based development, cutting coding error by 80% and speeding up development cycles through integrated CI/CD pipelines with SonarQube and GitLab.

Led the design and implementation of data pipelines, backend systems, and data processing workflows, supporting AI and machine learning initiatives.

Reengineered MATLAB software into a Python solution, saving costly annual software licensing fees.

Reduced time-to-quote from weeks to days by developing an automated quoting tool.

Designed and developed RESTful microservices and backend applications in Python and Java utilizing PostgreSQL, Docker, Airbus Skywise, GraphQL, and Hasura, completing projects up to 50% ahead of schedule.

SanDisk Corporation/Western Digital, Milpitas, CA

Technologist (July 2013–March 2019)

Developed software for the SSD validation department, and integrated all tests to shorten product release times. Played leading part in making software development more efficient as the group’s headcount grew 100%, and managed a network of virtual servers.

Developed a Python-based data collection and visualization platform for test and validation, contributing to on-time product releases.

Architected and deployed a PXE boot system for SSD test automation, building the core infrastructure for SSD testing.

Designed and implemented NVMe firmware tests in C/C++, ensuring high product quality and industry standard compliance.

Managed virtualized environments (VMware, FreeNAS, Linux, Windows) for the validation department, supporting product testing.

QLogic, Mountain View, CA

Principal Engineer (June 2012–July 2013)

Played a pivotal role in developing software and test frameworks within a small engineering team.

Created a Python automation framework controling VMware ESXi Hypervisors, streamling networked operations using PySphere, vSphere SDK, vSphere Web Services API, and vSphere CLI.

Built test framework utilities for complex, networked systems running Linux, RHEL, VMware ESXi, Windows, Cisco switches, NetApp, and EMC data storage.

Prior experience includes software engineering roles at Western Digital, SanDisk, and Toshiba.

EDUCATION

B.S., Computer Engineering, Santa Clara University, Santa Clara, CA



Contact this candidate