Responsibilities
- Design and assess strategies for information access and reasoning across retrieval-augmented generation, agent-based systems, and traditional machine learning techniques.
- Develop prototypes for generative AI workflows that interpret and analyze compliance-related data such as controls, risks, and regulatory requirements.
- Investigate machine learning and probabilistic methods when generative AI is less effective, including classification, ranking, graph analysis, uncertainty calibration, and weakly supervised learning.
- Create and manage evaluation systems using curated datasets, automated quality measurements, and regression monitoring.
- Develop and optimize ranking and re-ranking solutions using cross-encoders, large language model-based rerankers, learning-to-rank algorithms, and custom scoring logic.
- Conduct experiments to test hypotheses and measure performance gains prior to deployment.
- Analyze failure patterns and develop taxonomies for errors in retrieval, reasoning, and content generation.
- Work closely with AI and software engineering teams to transition proven methods into production systems.
- Monitor advancements in applied research related to retrieval-augmented generation, agent architectures, LLM evaluation, and relevance modeling, and integrate new techniques into the product.
Benefits
- Equity compensation through stock grants
- Employer covers up to 100% of medical, dental, and vision premiums for employees and dependents, with added wellness support and healthcare concierge services
- Financial protection package including a 401(k) plan, employer-paid life and disability insurance, flexible spending accounts, and optional discounted financial products
- Paid parental leave available after six months of employment, along with fertility and family planning support through Kindbody and dedicated leave guidance
- Annual allowances for professional and personal growth, plus internal learning resources to support skill development and career advancement
- Flexible vacation policy, paid holidays, and additional perks to support work-life balance
Compensation
Competitive base salary with benefits and stock, typically in the form of Restricted Stock Units (RSUs)
Work Arrangement
Hybrid — Bay
Team
Team size: 600+
