The Staff Data Engineer will play a key role in building and scaling data engineering systems across AWS and GCP environments. This position focuses on delivering trustworthy, high-quality data to support analytics and business decisions. The role includes technical leadership, mentoring team members, and full lifecycle ownership of data products from design through iteration.
Responsibilities
- Serve as a technical authority for core datasets by answering stakeholder inquiries, clarifying data lineage and assumptions, and supporting accurate interpretation.
- Lead data initiatives from start to finish, including defining requirements, designing models, building pipelines, launching solutions, and refining analytics-ready datasets.
- Design and implement scalable data pipelines on Databricks using Spark and SQL, ensuring accuracy, efficiency, and cost-effectiveness for both batch and streaming workloads.
- Create robust data models aligned with lakehouse and warehouse architectures to support analytics and self-service, defining key entities, grains, dimensions, metrics, and data contracts.
- Combine data from internal systems and third-party vendors, manage evolving schemas, and deliver clean, well-documented datasets for analytics teams.
- Implement data quality frameworks including testing, reconciliation, anomaly detection, SLAs/SLOs, monitoring, and incident response to improve detection and recovery times.
- Optimize Spark and SQL performance through tuning of joins, partitioning, file formats, clustering, caching, and job configurations to eliminate bottlenecks.
- Collaborate with Product, Engineering, Growth, Finance, and Analytics teams to turn ambiguous business questions into clear data deliverables, communicating tradeoffs and aligning on solutions.
- Elevate engineering standards by establishing best practices for pipeline templates, CI/CD, code reviews, and operational runbooks, while mentoring peers through technical leadership.
Requirements
- Minimum of 12 years of direct experience in data engineering or software development.
- Advanced proficiency in Python, Spark, and SQL.
- Experience using BI platforms such as Tableau, Looker, or Preset.
- Familiarity with event tracking tools including Snowplow, Segment, Google Tag Manager, Tealium, mParticle, and similar platforms.
- Deep experience implementing and managing compute and orchestration systems like Databricks, Airflow, and Talend.
- Hands-on work with streaming OLAP databases such as Druid or ClickHouse.
- Proven track record using AWS services including EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, and Athena.
- Understanding of real-time data architectures and AI/ML-driven personalization systems.
- Experience with Customer Data Platforms (CDPs) and Data Management Platforms (DMPs) to support enterprise-wide data strategies.
- Knowledge of high-compliance environments such as HIPAA or PCI, with strong emphasis on data privacy and security.
- Demonstrated ability to manage and process large datasets at terabyte scale and billions of records.
- Bachelor’s degree in Computer Science, Information Systems, or a related discipline.
Nice to Have
- Exposure to Google Cloud Platform services such as BigQuery, Google Storage, Looker, and Google Analytics.
Tech Stack
Databricks, Spark, SQL, Python, AWS (EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, Athena), GCP (BigQuery, Google Storage, Looker, Google Analytics), Airflow, Talend, Druid, ClickHouse, Snowplow, Segment, Google Tag Manager, Tealium, mParticle, Tableau, Looker, Preset
Benefits
- Competitive salary with annual performance-based bonus potential.
- Flexible time off policy supporting personal well-being and work-life balance.
- Comprehensive medical, dental, vision, short-term and long-term disability, and life insurance coverage.
- Health Savings Account (HSA) program.
- Health care and dependent care Flexible Spending Accounts (FSA).
- 401(k) retirement plan with employer matching contributions.
- Employer-subsidized commuter benefits.
- Support programs for new parents.
- Pet insurance and pet-friendly office locations.
Compensation
The Pay Range for this position is $200,000 - $249,000 USD annually. Actual pay will vary based on factors including, but not limited to location, experience, and performance. Performance bonuses, employer matched retirement savings, time-off programs, and progressive health benefits and perks.
Work Arrangement
hybrid — Los Angeles, San Francisco — Hybrid work model; applicants considered for Los Angeles or San Francisco locations.
Team
The Center for Data and Insights (CDI) operates as a service-oriented, horizontal team providing trusted, unbiased, and timely data insights across the organization. Reports to the Senior Director, Data Engineering.
- Courage: We believe that when we overcome fear, we enable our best selves.
- Curiosity: We are curious, which is the gateway to empathy, inclusion, and understanding.
- Kaizen: We have a growth mindset committed to constant forward progress.
- Service: We serve our community with humility, enabling joy and belonging for others.
Additional Information
- The company is an independently operated joint venture between a US-based subsidiary of Sony and Japan's Aniplex, itself a subsidiary of Sony Music Entertainment (Japan) Inc., both under the Tokyo-based Sony Group Corporation.
- Equal opportunity employer: does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
- Beware of scams: job applicants will only be contacted directly from @crunchyroll.com email accounts.
- Questions about hiring process? See: https://help.crunchyroll.com/hc/en-us/articles/360040471712-Crunchyroll-Hiring-FAQs
