Software Engineer

Kirsten Liu Software Engineer

U.S.A & Taiwan Citizenship Contact **********.******@*****.*** Phone +1-424-***-**** Github https://github.com/KirstenLiu Address 121 N Sierra Bonita Ave, Pasadena, California, USA, 91106 https://github.com/kliu-scpr Skills

Languages: Proficient: Go, Python Experienced: MySQL, YAML, JSON, Bash, Docker, Postgres, Regex, Perl, C, C#, gRPC, Protobuf, Jupyter, Liquibase, XML, TypeScript, ASP.NET, CSS, HTML, Lisp, Scala, JavaScript, AWS CLI, Redis, RabbitMQ, Git, Omny Studio API, GraphQL, gcloud CLI Tool:Jenkins, CircleCI, Bitbucket, AWS, S3, DMS, Redshift, RDS, CloudFormation, Google Cloud Platform (GCP), BigQuery, Google Analytics, Looker Studio, DBT, VSCode, JIRA, AWS load balancer, CloudWatch, Unity3D, Bamboo, Metabase, Flurry, Prometheus, Airflow, Splunk, Tableau Experience

Data Engineer - LAist NPR (Los Angeles, USA)2023/12 - 2025/11

● Develop APIs in Go with third party API like Omny Studio API, county and state election native API, chartbeat API and Grove GraphQL, hosting natively on Google cloud run to provide customized enriched data, ensure data delivery and data integrity

● Provide automation and self served services for leaderships by generating reports in Go, Python, and Bash with sophisticated data pipeline

● Create and maintain dashboards in Google Looker Studio, by generating data sources from BigQuery, Google Analytic and Google APIs to deliver data analytic insight and data visualization for wider audiences like leadership and marketing teams

● Backfill more than 10 years of data from Google Analytic 4 (GA4), build visualization dashboards, implement comprehensive backups by leveraging Google APIs in Python with Flask, making LAist the only one in APMG (American Public Media Group) have backups of legacy GA4 data

● Provide customized ETL for data in specific domains, i.e. audience engagement, website analytics and newsletter reach by leveraging Google APIs on Go, Python with Flask, and service account authorization setup on Google Cloud Platform (GCP)

● Incorporate Selenium, UI Vision and Playwright in Python script to automate manual process of collecting data on 3rd party webpage, wrapped up with Flask as a web service to be self hosted on Docker and GCP with cron trigger, and on Windows10 AWS workstation with batch file and Windows scheduler Data Engineer / Backend Developer - Pickupp (Taipei, Taiwan)2022/05 - 2022/08

● Generate data flow diagram for all services from an architecture point of view, provide health checks for each component in the delivery logistic system

● Monitor and maintain AWS DMS (Data Migration Service), creating APIs in Go to offer automation to delete data during specific periods or passing TTL(time-to-live) on DMS, hosting on Docker while providing custom Yaml in Base64

● Find weak spots in ETL and data pipeline to existing systems which have high volume of traffic and huge amounts of data that grows exponentially

● Create scripts using Metabase API to inventory a mass amount of SQL queries created by sales and marketing teams

● Set mobile data monitoring with Flurry, and maintain established Google Analytics for both data on mobile and website

● Clean up backend data on Postgres, bringing Airflow into the data pipeline, provide insights of deployment with implementation of testing suite Freelance Developer - Taiwan Institute of Economic Research, etc. (Remote) 2020/01 - 2022/04

● Python automation utilizing GCP API for Youtube data analytic extraction and report generation.

● Build mini game on Unity3d in C#, client-server webpage in Go and RabbitMQ, puzzle game in Go and JavaScript Software Developer - Clir Renewables (Vancouver, Canada) 2018/09 - 2019/12

● Develop APIs and features in Go and Python, especially in Pandas and Numpy, for a data analytic pipeline of wind farms in TB scale of data and high volume of traffic

● Build interoperable microservices in Go and Python with a compatibility layer to support the legacy monolithic architecture

● Provide automation solutions in Go and Python to optimize the process of bringing the specific data format including SCADA through different data collection strategies ranging from email to AWS Redshift into the existing platform

● Update database through MySQL script and Liquibase schema to onboard new customers, and import enhanced data

● Test and deploy services on AWS using Docker, automated through CircleCI for unit and integration tests

● Manage issue escalation automation to guarantee data integrity and business intelligence

● Improve upgrade process and automate scheduled backup of Tableau server, upgrade AWS RDS with multiple properties and parameter groups, also by monitoring and maintaining Airflow to ensure data quality in different phases in ETL to provide a healthy data pipeline

● Share duties of Devops and SRE by maintaining all data quality and data pipeline related fields, and be on call once a month

● Give talks and represent Clir on different occasions like SCWIST (Society for Canadian Women in Science and Technology) Software Developer in Test - Splunk (Taipei, Taiwan and then relocated to Vancouver, Canada) 2015/12 - 2018/09

● Facilitate test driven development for on-prem maintenance/patching on distributed environments for fast delivery among multiple release branches

● Drive test plans on backend, CLI, REST, distributed search, Search Head Clustering, resolve bugs, and prevent regressions in large scale deployments

● Ingest large simulated or real customer data into Splunk in clustering setup for scaling robust verification under demanding network traffic situations

● Troubleshoot and reproduce on corner customer escalations in complex scenarios, with Bash and Docker, scripting with REST call, JSON, Perl and Regex

● Review test coverage and gap filling based on customer cases for functional, performance, memory leak and security test on real-time pipeline and search engine for cross-platform reliability

● Analyze and narrow down root cause ensuring efficient delivery and smooth collaboration between international teams in multiple time zones

● Develop test automation with Pytest, triaging on CI/CD system, Jenkins and Bamboo, running on both Linux/Windows environments Project founder, programmer - g0v open source community 2012 - 2014 Develop geographic data visualization tool with Natural Language Processing on address in Python for civil rights movement Academic projects

● Medical direction parser for online pharmacopoeia (MedPop), Academia SINICA 2012 - 2015 Create a tool parsing medication directions in English on online pharmacopeias into specific machine readable format with NLP, N-gram corpus and regular expression to provide automation data pipeline

● Two-level end-to-end scheduling service, Industrial Technology Research Institute (ITRI) 2011 - 2012 Develop a service ensuring the timing constraints of real-time components which supports end-to-end slack distribution strategies at higher level, and fixed priority scheduling at lower level based on Windows .NET Workflow Foundation Internship - Galaxy Software Services Corporation (GSS) 2010

● Development and research of XPS to PDF conversion command line tool suite (.Net & VB) ● Black-box test of Electronic Official Documentation System Education

Master Study of Computer Science, National Tsing Hua University, Taiwan, GPA 3.73/4.3 until September 2015 Embedded System Lab, Professor Jane Win Shih Liu, fields of study: Real-time Scheduling, Embedded System, Natural Language Processing Bachelor of Computer Science, National Tsing Hua University, Taiwan, GPA 3.84/4.3 2007 - 2011 Exchange student in Computer and Information Science, Linköping University, Sweden 2009 - 2010 Language Mandarin (native), English (fluent), Swedish (competent, A1), Japanese (basic), French (conversant)

Contact this candidate