About the Role
The engineer will design and implement evaluation frameworks to assess the performance of perception and prediction models in real-world driving scenarios, using large-scale data and simulation environments.
Responsibilities
- Build scalable software systems for evaluating machine learning models in perception and prediction tasks
- Develop tools to process and analyze sensor data from autonomous vehicle platforms
- Design metrics and benchmarks to quantify model accuracy and robustness
- Collaborate with machine learning engineers to refine model training based on evaluation results
- Create automated testing pipelines for continuous integration of new models
- Work with large datasets collected from real-world driving and simulation environments
- Identify edge cases and failure modes in perception and prediction systems
- Improve evaluation infrastructure to support rapid iteration
- Integrate feedback loops between evaluation results and model development
- Ensure evaluation systems reflect diverse driving conditions and geographies
- Support the creation of synthetic scenarios to test rare events
- Maintain documentation for evaluation methodologies and software tools
- Troubleshoot discrepancies between expected and observed model behavior
- Optimize data processing workflows for speed and efficiency
- Collaborate with safety and validation teams to align with regulatory standards
Nice to Have
- Master’s degree in computer science, robotics, or related field
- Experience with deep learning frameworks such as PyTorch or TensorFlow
- Background in statistical analysis or data science
- Familiarity with autonomous driving stacks
- Experience with CI/CD pipelines in machine learning systems
Compensation
Competitive salary and equity package
Work Arrangement
Hybrid work model with office and remote flexibility
Team
Part of the evaluation engineering team focused on autonomous driving systems
About the Team
The team focuses on building evaluation systems that ensure the safety and reliability of autonomous driving technologies, working at the intersection of software engineering, machine learning, and vehicle dynamics.
What We Value
We prioritize technical rigor, attention to detail, and a commitment to safety in all aspects of system evaluation and development.
Available for qualified candidates