A Staff Data Engineer will join the Center for Data and Insights (CDI) to lead the development and scaling of advanced data engineering platforms across AWS and GCP. This role involves end-to-end ownership of data products, mentoring engineers, and ensuring high standards of data quality and reliability to empower data-driven decisions for a global anime and manga audience.
Responsibilities
- Serve as a subject-matter expert for key datasets by addressing stakeholder inquiries, clarifying data lineage and assumptions, and supporting accurate data interpretation.
- Lead data projects from start to finish, including scoping, design, implementation, deployment, and ongoing iteration, transforming raw data into analytics-ready formats.
- Design and implement scalable data pipelines on Databricks using Spark and SQL, prioritizing correctness, efficiency, and cost-effectiveness for both batch and streaming workloads.
- Create robust data models aligned with lakehouse and warehouse architectures to support analytics and self-service, defining entities, grains, dimensions, metrics, and data contracts.
- Integrate data from internal systems and third-party platforms, manage schema changes over time, and deliver clean, well-documented datasets for analytics teams.
- Define and enforce data quality and reliability practices, including testing, reconciliation, anomaly detection, SLAs/SLOs, monitoring, and incident response, with a focus on reducing detection and recovery times.
- Optimize Spark and SQL performance through tuning of joins, partitioning, file layout, clustering, caching strategies, and job configurations to eliminate bottlenecks.
- Collaborate with stakeholders across Product, Engineering, Growth, Finance, and Analytics to turn ambiguous business questions into clear data deliverables, communicating tradeoffs and aligning on solutions.
- Elevate engineering standards by establishing best practices for pipeline templates, CI/CD, code reviews, and operational procedures, and mentor engineers through technical leadership.
Requirements
- Minimum of 12 years of hands-on experience in data engineering or software development.
- Advanced proficiency in programming languages such as Python, Spark, and SQL.
- Experience using BI tools including Tableau, Looker, and Preset.
- Familiarity with event data collection platforms like Snowplow, Segment, Google Tag Manager, Tealium, and mParticle.
- Extensive experience across the full lifecycle of compute and orchestration tools such as Databricks, Airflow, and Talend.
- Background working with streaming OLAP engines including Druid and ClickHouse.
- Hands-on experience with AWS services such as EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, and Athena.
- Understanding of real-time data systems and experience with AI/ML-driven personalization products.
- Experience with Customer Data Platforms (CDPs) and Data Management Platforms (DMPs) to support comprehensive data strategies.
- Knowledge of high-security regulatory environments such as HIPAA or PCI, with a strong focus on data privacy and security.
- Proven ability to manage and process large-scale datasets, including terabytes of data and billions of records.
- Bachelor's degree in Computer Science, Information Systems, or a related field.
Nice to Have
- Experience with Google Cloud Platform (GCP) services such as BigQuery, Google Storage, Looker, and Google Analytics.
Tech Stack
Databricks, Spark, SQL, Python, AWS (EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, Athena), GCP (BigQuery, Google Storage, Looker, Google Analytics), Airflow, Talend, Druid, ClickHouse, Snowplow, Segment, Google Tag Manager, Tealium, mParticle, Tableau, Looker, Preset
Benefits
- Competitive compensation package including base salary and annual performance bonus.
- Flexible time off policy to support work-life balance and personal well-being.
- Comprehensive medical, dental, vision, short-term disability, long-term disability, and life insurance coverage.
- Health Savings Account (HSA) program.
- Health care and dependent care Flexible Spending Accounts (FSA).
- 401(k) retirement plan with employer matching contributions.
- Employer-paid commuter benefits.
- Support programs for new parents.
- Pet insurance and pet-friendly office locations.
Compensation
Salary range: $221,000 - $277,000 USD (based on San Francisco location); actual pay varies by location, experience, and performance. Includes annual performance bonus and 401(k) with employer match. Equity details not provided.
Work Arrangement
Hybrid work model; positions available in Los Angeles or San Francisco.
Team
Part of the Center for Data and Insights (CDI), a service-oriented team providing data and insights across the organization; reports to the Senior Director, Data Engineering.
- Courage: Overcoming fear to enable individuals to bring their full selves to work.
- Curiosity: Fostering empathy, inclusion, and understanding through inquiry.
- Kaizen: Embracing a growth mindset and continuous improvement.
- Service: Supporting the community with humility, creating joy and a sense of belonging.
Additional Information
- The listed pay range applies specifically to San Francisco, CA.
- Actual compensation may vary based on location, experience, and performance.
- The company is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
- Crunchyroll, LLC operates as an independently managed joint venture between Sony Pictures Entertainment and Aniplex, a subsidiary of Sony Music Entertainment Japan, both part of Sony Group Corporation.
- Applicants should be aware of potential scams; official communication will only come from email addresses ending in @crunchyroll.com.
- For more information about the hiring process, refer to the Crunchyroll Hiring FAQs at https://help.crunchyroll.com/hc/en-us/articles/360040471712-Crunchyroll-Hiring-FAQs
Not specified
