People Data Labs is hiring a Senior Software Engineer, Platform to be a key contributor to our Platform Engineering Team. You will be responsible for the foundational infrastructure that enables other engineering teams, accelerating the development of standalone data products and defining tools for big data processing within AWS.
What You'll Do
- Manage and improve our growing AWS and data center infrastructures
- Design, implement, and maintain a CI/CD pipeline to improve developer workflows
- Utilize centralized monitoring and logging to improve visibility across the team
- Assist development teams in solving issues around scaling and bottlenecks
- Work with teammates to develop high-quality software, balancing security, reliability, and operational concerns
What We're Looking For
- 5-7+ years of software development experience with a background in platform or cloud infrastructure engineering
- 3+ years of experience with Python in a production environment
- Strong software development fundamentals and system design experience
- Strong experience with core technologies (AWS, ElasticSearch/OpenSearch, Python, Docker, scaled data processing technologies)
- Experience with AWS, including EC2, Lambda, OpenSearch, API Gateway, ALB
- Experience with data stores, including Postgres/MySQL, Dynamo, Redis, S3
- Experience with Infrastructure-as-code (IaC) frameworks (e.g. Pulumi, Terraform, CloudFormation, or similar)
- Experience with network design, including public/private availability, routing, firewalls/security groups, and VPN
- Experience with Identity and Access Management
- Experience with configuration management tools (e.g. Chef, Puppet, Ansible, etc)
- Experience with observability tools such as Datadog for metrics, logging, etc
- Experience with build and deploy systems, architecting and developing CI/CD infrastructure, repo management, and integrating with tools like Github Actions (or similar)
- Balance high ownership and autonomy with a strong ability to collaborate
- Can work effectively remotely (proactive about managing blockers, reaching out, asking questions, and participating in team activities)
- Strong written communication skills on Slack/Chat and in documents
- Are experienced in writing data design docs (pipeline design, dataflow, schema design)
- Can scope and breakdown projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholders
Nice to Have
- Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering
- Expertise with Apache Spark (Java, Scala, and/or Python-based)
- Experience with SQL Data Pipeline Development
- Experience supporting developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster, or similar)
- Experience with managing, deploying, and ensuring the reliability of streaming platforms (e.g., Kafka)
- Experience evaluating data quality and maintaining consistently high standards across new feature releases (e.g., consistency, accuracy, validity, completeness)
- Experience using Databricks or similar data-development platforms
- Experience managing hybrid environments split between local datacenters and AWS; experience managing bare metal/co-location infrastructure
Technical Stack
- AWS (EC2, Lambda, OpenSearch, API Gateway, ALB, Dynamo, S3)
- ElasticSearch / OpenSearch
- Python
- Docker
- Postgres/MySQL, Dynamo, Redis, S3
- Infrastructure-as-Code: Pulumi, Terraform, CloudFormation
- Configuration Management: Chef, Puppet, Ansible
- Observability: Datadog
- CI/CD & Build: Github Actions
- Data Processing: Apache Spark, Airflow, dbt, dagster, Kafka, Databricks
Team & Environment
You will be part of the Platform Engineering Team, building the shared foundation for all product development.
Benefits & Compensation
- Compensation: $160K - $180K
- Stock
- Competitive Salaries
- Unlimited paid time off
- Medical, dental, & vision insurance
- Health, fitness, and office stipends
- The permanent ability to work wherever and however you want
Work Mode
This is a fully remote position.
People Data Labs does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other reason prohibited by law in provision of employment opportunities and benefits.
