We are seeking an experienced Cloud Data Pipeline Engineer to help design, build, and scale the infrastructure that powers advanced mobility systems. This role focuses on supporting large-scale data operations for AI/ML model development across autonomous and intelligent vehicle platforms.
As part of the Data Engineering team within the autonomy organization, you’ll play a key role in creating end-to-end pipelines that collect, process, and manage data captured from a wide array of vehicle-mounted sensors. You will work with teams focused on machine learning, perception, and system testing to ensure high-performance access to mission-critical datasets.
Key Responsibilities
Design and maintain scalable data processing pipelines on AWS, Kubernetes, and on-prem environments.
Process and manage structured and unstructured data collected from onboard sensors including cameras, LiDAR, RADAR, and GPS.
Build efficient systems for ingestion, parsing, transformation, and storage of multi-terabyte sensor data per day.
Optimize data storage, search, and compute performance using distributed architectures, caching layers, and data frameworks.
Collaborate with cross-functional teams such as ML, QA, testing engineers, and external annotation vendors to build custom data solutions.
Create dashboards and APIs to enable real-time monitoring and integration with ML workflows.
Required Qualifications
Strong ability to design software architecture based on high-level technical and business needs.
Proficient in Python or Golang for backend and data-centric development.
Hands-on experience with PostgreSQL or other relational database systems.
Professional experience deploying solutions on AWS cloud and Kubernetes clusters.
Experience building multi-threaded applications, containerized backends, and RESTful microservices.
Preferred Qualifications
Strong sense of ownership and a proactive, hands-on problem-solving mindset.
Experience developing scalable distributed systems capable of processing terabytes of data daily.
Background in autonomous systems or backend engineering for AI/ML data platforms.
Familiarity with tools and technologies such as: Airflow, Terraform, Docker, REST APIs, Helm, and SQL.
positions at ASICSoft range from $50,000 - $300,000