Responsibilities
- Design and implement large-scale, distributed crawling systems or AI agents that function efficiently under adversarial conditions with minimal operational burden
- Construct and maintain robust data pipelines to gather information from web content, documents, PDFs using OCR, and third-party APIs
- Assist in standardizing diverse document formats into a unified data model across multiple sources
- Clean and normalize raw input data to prepare it for machine learning, natural language processing, and search indexing tasks
- Develop APIs that deliver structured and categorized data through ElasticSearch or OpenSearch
- Work closely with machine learning and NLP teams to embed classification models into data workflows
- Leverage large language models to extract accurate information from extensive collections of OEM repair documentation
- Automate operational workflows using Apache Airflow and deploy systems on Kubernetes within AWS infrastructure
- Enhance performance and scalability of data processing pipelines using Spark on EMR for handling massive datasets
Benefits
- Fully remote work options available
- Market-competitive base pay aligned with individual expertise and contribution
- Substantial paid time off allowance
- Life-stage support including paid maternity, parental bonding, and medical leave for employees and family members
- Full premium coverage for employee-only health plans; 50% employer contribution toward family plans across medical, dental, vision, and prescription benefits
- Complimentary and confidential mental health counseling via BetterHelp partnership
- 401(k) plan with employer matching up to 6% of contributions at 100%
- Access to Flexible Spending Accounts and Health Savings Accounts
- Life insurance and accidental death and dismemberment (AD&D) coverage
- Monthly $60 wellness stipend applicable to fitness, mental health, or personal well-being activities
- One-time $300 home office reimbursement after one year of employment
- Financial and logistical support for ongoing education and skill development
- Collaborative and engaging work culture with a high-performing team and regular social events
Compensation
Competitive base salaries that reflect your value
Work Arrangement
Hybrid — Houston
Team
Collaborative environment with opportunities to work alongside ML/NLP specialists and contribute to scalable data systems
Other
- Travel is an expected part of every role
- Attendance at team and company-wide offsites several times a year is expected
