The Linux Foundation, home to the Overture Maps Foundation, is hiring a Senior DevOps Engineer. In this role, you will ensure the reliability, automation, and observability of open, large-scale geospatial data pipelines. You will manage systems across cloud environments and design CI/CD workflows that support a global, collaborative project.
What You'll Do
- Maintain and monitor production data pipelines to ensure consistent, on-time runs.
- Troubleshoot and resolve operational issues across development, staging, and production environments.
- Implement logging, alerting, and metrics for end-to-end observability.
- Manage pipeline configurations, scheduling, and environment consistency.
- Design and manage CI/CD workflows in GitHub for building, testing, and deploying pipeline components.
- Enforce consistent branching, testing, and release practices across repositories.
- Automate build, test, and deployment workflows for both code and data releases.
- Support versioning and reproducibility for datasets and schema changes.
- Ensure pipelines and supporting systems are deployable across both AWS and Azure environments.
- Coordinate with CloudOps to manage cloud infrastructure for pipeline execution.
- Maintain reproducible environments and ensure secure, efficient use of compute and storage resources.
- Work across Engineering Operations to schedule and optimize compute resources.
- Implement infrastructure and operational automation to reduce manual intervention.
- Support Release Operations by integrating QA/QC validation into CI/CD processes.
- Partner with ReleaseOps to validate release candidates and monitor data QA/QC jobs.
- Automate post-release tasks such as metadata updates or data viewer refreshes.
- Maintain operational runbooks and documentation for release reliability and repeatability.
What We're Looking For
- 4+ years of experience in Data Engineering, DevOps, or related engineering operations roles.
- Hands-on experience operating distributed pipelines built with Airflow, Spark, and Python or Scala.
- Strong knowledge of GitHub workflows, CI/CD automation, and multi-environment deployments.
- Familiarity with data platforms that use SparkSQL, Iceberg, Parquet, and object storage (S3 or Azure Blob).
- Solid understanding of monitoring, alerting, and release automation.
Nice to Have
- Experience with LakeFS for feed version management.
- Familiarity with Sedona, Shapely, or other spatial libraries.
- Understanding of data QA/QC processes and release operations workflows.
Technical Stack
- Airflow, Spark, Python, Scala, GitHub
- SparkSQL, Iceberg, Parquet
- AWS S3, Azure Blob, LakeFS, Sedona, Shapely
Team & Environment
This team bridges development and operations, supporting a common, platform-agnostic technology stack while maintaining flexibility for member contributions.
Benefits & Compensation
- Compensation range: $125,000 - $155,000
- Fantastic, exceptional healthcare plans
- Unlimited PTO
- 100% 401k match
- Profit-sharing
- Remote-friendly work environment
- Flexible scheduling
- Management-level autonomy
- Competitive executive compensation package
- Equity/performance incentives
Work Mode
This is a remote position.
The Linux Foundation is an Equal Opportunity Employer.
