What You'll Do
Take full technical ownership of a production-grade data and machine learning platform that processes millions of records to advance social impact goals. You'll design, optimize, and maintain large-scale data workflows built on Databricks and Spark, ensuring high availability and performance. Work closely with data scientists to transition experimental models into reliable, scalable systems and strengthen integration points between data infrastructure and product delivery.
Lead by example through code reviews, technical mentorship, and process improvements that elevate team capabilities. Troubleshoot complex system issues, enhance monitoring and observability, and support on-call operations for critical data pipelines. Collaborate across engineering, data, and product functions to meet evolving infrastructure demands in a fast-paced environment.
Requirements
- Proven experience building and maintaining production data platforms in high-stakes environments
- Strong proficiency in Python and SQL for scalable data systems
- Hands-on experience with Databricks or Apache Spark for large-volume data processing
- Direct experience deploying and managing ML models in production, including batch inference and serving patterns
- Familiarity with cloud platforms such as GCP, AWS, or Azure
- Track record supporting business-critical systems with on-call responsibilities
- Demonstrated enthusiasm for advancing progressive and philanthropic missions through technology
Preferred Qualifications
- Five or more years of professional software engineering experience
- Experience developing data-heavy applications using Databricks
- Integration experience with AWS-based production systems
- Background in ML training or inference pipeline operations
- Success working in agile, cross-functional teams
Benefits
- Platinum-level medical coverage fully paid by the employer
- Employer-covered life insurance and short-term disability
- Subsidized dental and vision plans
- 401(k) with 3% company match
- 17 paid vacation days plus 12 holidays, sick leave, bereavement leave, and a volunteer day
- Paid parental leave at full salary
- Financial support for reproductive and gender-affirming healthcare
- Flexible remote work policies with company-issued Mac equipment
- Reimbursements for cell service, meals, and transportation
