Crunchyroll is hiring a Staff Data Engineer to play a crucial role in building a world-class Data Engineering team within our Center for Data and Insights (CDI). You will advance our data engineering capabilities across AWS and GCP ecosystems, working hands-on in data architecture, lake infrastructure, and orchestration while mentoring others.
What You'll Do
- Be a subject-matter expert on critical datasets: field stakeholder questions, explain lineage, and help partners interpret data accurately.
- Own projects end-to-end from scoping and design to implementation, launch, and iteration of data products.
- Architect and build scalable pipelines on Databricks using Spark and SQL for batch and streaming.
- Design strong data models that serve analytics and self-service use cases, defining entities, grains, and contracts.
- Integrate diverse data sources, manage schema evolution, and produce clean, well-documented curated datasets.
- Establish data quality and reliability standards including testing, monitoring, SLAs, and incident response.
- Performance tune Spark and SQL jobs, optimizing joins, partitioning, and file layout to remove bottlenecks.
- Partner with stakeholders across Product, Engineering, and Finance to translate ambiguous questions into concrete deliverables.
- Raise the engineering bar by setting patterns for pipeline templates, CI/CD, and code reviews while mentoring other engineers.
What We're Looking For
- 12+ years of hands-on experience in data engineering and/or software development.
- High skill in programming languages like Python, Spark, and SQL.
- Comprehensive expertise across the entire lifecycle of compute and orchestration tools like Databricks, Airflow, and Talend.
- Experience using AWS services including EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, and Athena.
- Experience managing large-scale data sets, handling Terabytes of data and billions of records.
- Bachelor's Degree in Computer Science, Information Systems, or a related field.
Nice to Have
- Comfort using BI tools like Tableau, Looker, or Preset.
- Proficient with event data collection tools such as Snowplow, Segment, Google Tag Manager, Tealium, or mParticle.
- Experience with streaming OLAP engines like Druid or ClickHouse.
- Exposure to GCP services like BigQuery, Google Storage, Looker, and Google Analytics.
- Understanding of building real-time data systems and AI/ML personalization products.
- Experience with Customer Data Platforms (CDPs) and Data Management Platforms (DMPs).
- Familiarity with high-security environments like HIPAA or PCI.
Technical Stack
- Languages & Core: Python, Spark, SQL
- Platforms: Databricks, AWS (EMR Spark, Redshift, Kinesis, Lambda, Glue, S3, Athena), GCP (BigQuery, Google Storage, Looker, Google Analytics)
- Orchestration & Tools: Airflow, Talend, Druid, ClickHouse
- Analytics & Collection: Tableau, Looker, Preset, Snowplow, Segment, Google Tag Manager, Tealium, mParticle
Team & Environment
You will be part of the Center for Data and Insights (CDI), a service-oriented horizontal organization, and will report to the Senior Director of Data Engineering.
Benefits & Compensation
- Salary: $200,000—$249,000 USD plus annual performance bonus potential.
- Flexible time off policies.
- Generous medical, dental, vision, STD, LTD, and life insurance.
- Health Saving Account (HSA) program.
- Health care and dependent care FSA.
- 401(k) plan with employer match.
- Employer-paid commuter benefit.
- Support program for new parents.
- Pet insurance; some of our offices are pet friendly.
Work Mode
This is a hybrid position based in Los Angeles or San Francisco.
Crunchyroll is an equal opportunity employer and values diversity. Pursuant to applicable law, we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
