Senior Software Engineer in AI Systems

David James Anderson

Senior Software Engineer - Systems Distributed Platforms AI Infrastructure

*********@*****.*** +1-512-***-**** 450 Jane Stanford Way Stanford, CA 94305 United States github.com/daviddefiworld

Summary

I am a Senior Software Engineer with over 8 years of experience owning core platform infrastructure for large language models and agentic systems. Specialized in building and operating low-latency distributed services, API serving layers, state management, data pipelines, and execution runtimes that power enterprise AI products. Expert in designing high-throughput systems with strong observability, fault tolerance, and consistency tradeoffs while delivering measurable gains in performance, reliability, and developer experience. Deep collaborator with ML and product teams on production-grade LLM serving, context retrieval, and agentic orchestration under strict latency and quality constraints. Professional Experience

Senior Software Engineer, Northbridge Financial Systems 03/2022 – 11/2025 Toronto, Ontario, Canada - Remote

•Owned the core platform infrastructure for agentic AI services, including API serving layer, state management, policy enforcement engine, and execution runtime for LLM serving and agentic workflows, resulting in 40% reduction in average request latency and 99.99% uptime SLO achievement.

•Designed and operated high-throughput, low-latency distributed services backing model API products with request routing, load management, rate limiting, and multi-tenant isolation, supporting peak loads exceeding 150k requests per second.

•Built and maintained downstream ETL/ELT data pipelines using Kafka and Apache Flink for API logs, usage analytics, and billing, ensuring data correctness, freshness, and queryability at scale while improving billing accuracy by 25%.

•Developed production-grade internal SDKs and libraries in Go with clean APIs, strong type safety, and clear contracts adopted by multiple product teams, reducing integration time by 60%.

•Architected context and memory systems for conversational workloads with low-latency retrieval, caching, vector stores, and integration with RAG pipelines and ReAct planner-executor patterns.

•Instrumented end-to-end observability with SLIs/SLOs, structured logging, and distributed tracing on K8s deployments, driving reliability improvements that decreased incident resolution time by 45%.

•Collaborated with ML teams on LLM serving, voice runtime, and agentic orchestration under tight latency constraints, including integration of emerging protocols such as MCP and A2A.

•Led capacity planning, fault tolerance, and consistency tradeoffs across the platform, implementing automated scaling that reduced infrastructure costs by 22% while maintaining performance. Backend Platform Engineer, BlueWave Software Engineering 01/2019 – 02/2022 Nashville, Tennessee - Remote

•Designed and evolved backend services for enterprise AI platforms with strong distributed systems fundamentals, including concurrency, fault tolerance, consistency tradeoffs, and capacity planning in multi-region K8s environments.

•Developed large-scale data processing pipelines with Kafka, Spark, and Airflow for log aggregation and analytics, processing terabytes daily with 99.95% correctness and sub-minute freshness.

•Created reusable frameworks and APIs focused on developer experience and maintainability, adopted company-wide and accelerating feature delivery by 35%.

•Optimized performance-sensitive components using Go and Python for real-time workloads, including low-latency signaling and audio/video streaming elements.

•Implemented containerized deployments on Kubernetes (K8s) with comprehensive CI/CD pipelines, reducing deployment failures by 70%.

•Built observability across services with structured logging, tracing, and custom metrics supporting high-stakes core data and identity-related workloads.

•Contributed to integration of large language models serving infrastructure with backend platforms while managing production on-call responsibilities.

•Conducted architecture reviews emphasizing correctness, auditability, and scalability for platform services. David James Anderson *********@*****.*** 1 / 2

Software Engineer, InnovaTech Systems 07/2017 – 12/2018 Newport Beach, California

•Built and operated backend microservices for high-traffic applications, gaining expertise in distributed systems design, production troubleshooting, and high-stakes platform services.

•Developed data pipelines and integration layers on AWS, enhancing queryability and efficiency for analytics and core data flows.

•Contributed to internal tooling and SDK development that improved developer productivity and service reliability.

•Designed performant API layers with focus on scalability, rate limiting, and security.

•Supported observability initiatives including logging, monitoring, and alerting for improved system reliability.

•Worked on cloud-native deployments and container orchestration using Kubernetes (K8s).

•Optimized services for resource utilization, delivering cost savings and performance improvements.

•Handled production on-call for business-critical components requiring strong consistency guarantees. Skills

Languages & Frameworks

Go, Python, Rust, Java, C++, Kafka, Apache Flink, Airflow, LangChain

Data & AI Pipelines

ETL/ELT Pipelines, Data Streaming, Vector Stores, Caching, Context Retrieval, RAG Pipelines, LLM Serving, ReAct, Planner- Executor

Agentic & Real-Time Systems

Agentic Orchestration, Model Serving, Execution Runtime, State Management, Policy Engines, Low-Latency Systems, Audio/Video Streaming, Low-Latency Signaling

Distributed Systems & Infrastructure

Distributed Systems, API Serving, Microservices, Rate Limiting, Multi-tenancy, Load Balancing, Fault Tolerance, Consistency Tradeoffs, Concurrency

Cloud & DevOps

AWS, GCP, Kubernetes (K8s), Docker, CI/CD, Observability, SLIs/SLOs, Structured Logging, Distributed Tracing Education

Bachelor of Science in Computer Science, Stanford University 2012 – 2016 Stanford, California, USA David James Anderson *********@*****.*** 2 / 2

Contact this candidate