About the Role
The Senior Data Engineer will lead the development and optimization of data pipelines, ensuring data accuracy, scalability, and reliability across platforms. This position requires strong technical expertise in distributed systems and cloud technologies.
Responsibilities
- Design and implement data pipelines for large-scale data processing
- Develop and maintain ETL workflows with high data integrity
- Optimize data storage and retrieval performance
- Collaborate with data scientists and analysts to understand requirements
- Ensure data quality and consistency across systems
- Troubleshoot and resolve data-related issues
- Support data governance and compliance standards
- Work with cloud-based data platforms and services
- Improve data pipeline monitoring and alerting
- Document data architecture and engineering practices
- Integrate data from multiple sources into unified systems
- Evaluate and adopt new data technologies
- Contribute to infrastructure as code practices
- Participate in code reviews and technical design sessions
- Maintain data security and access controls
- Scale data systems to meet growing demands
- Automate repetitive data engineering tasks
- Ensure system reliability and uptime
- Assist in migration of on-premise data solutions to cloud
- Use version control for data pipeline code
- Apply software engineering best practices to data projects
- Monitor system performance and usage patterns
- Support disaster recovery and backup strategies
- Work with streaming and batch data processing
- Collaborate on data modeling and schema design
Compensation
Hourly rate commensurate with experience
Work Arrangement
Remote with flexible hours
Team
Collaborative engineering team focused on data infrastructure
Tech Stack
- Primary languages: Python, SQL
- Cloud platforms: AWS, GCP
- Data processing: Apache Spark, Airflow
- Storage: BigQuery, S3, Redshift
- Containerization: Docker, Kubernetes
Application Process
- Submit resume and cover letter
- Complete a technical screening
- Participate in a coding assessment
- Attend a final interview with the team
Not available
