About the Role
The role involves building and optimizing data infrastructure to enable efficient data processing and reporting across departments.
Responsibilities
- Design and implement robust data pipelines for large-scale datasets
- Develop and maintain ETL workflows and data integration processes
- Ensure data accuracy, consistency, and accessibility across systems
- Collaborate with analytics and product teams to understand data needs
- Optimize data storage solutions for performance and scalability
- Monitor data pipeline health and resolve operational issues
- Support data governance and compliance standards
- Evaluate and integrate new data technologies and tools
- Document data architectures and system changes
- Troubleshoot data quality problems and implement fixes
- Work with cloud-based data platforms and services
- Improve data processing efficiency and reduce latency
- Participate in code reviews and technical design discussions
- Ensure data security and access controls are properly enforced
- Assist in defining data modeling standards
- Contribute to capacity planning for data systems
- Automate routine data operations and monitoring tasks
- Support data warehouse development and maintenance
- Integrate data from multiple heterogeneous sources
- Promote best practices in data engineering across teams
Nice to Have
- Master’s degree in a technical discipline
- Experience with real-time data processing systems
- Background in financial or regulated industries
- Contributions to open-source data projects
- Certifications in cloud or data engineering platforms
Compensation
Competitive salary based on experience
Work Arrangement
Hybrid work model with flexible hours
Team
Collaborative engineering team focused on data systems
Technology Stack
- Primary tools include Apache Spark, Airflow, AWS S3, Redshift, and Kafka
- Engineering practices emphasize automation, monitoring, and infrastructure as code
Professional Growth
- Opportunities for technical leadership and mentorship
- Access to training programs and industry conferences
