Responsibilities
- Architect the full lifecycle of a next-generation data platform, spanning event ingestion, stream processing, storage tiers, and API delivery
- Record technical choices, compromises, and transition plans with formal documentation standards equivalent to an RFC process
- Lead the development of all architectural layers including event intake, stream transformation, real-time data serving, analytical storage, query execution, and API interfaces
- Build and deploy a real-time data pipeline from source ingestion through enrichment to end-user access
- Define service-level objectives for speed, response time, and accuracy, and create operational procedures ensuring reliability sufficient to supplant existing batch systems
- Engineer scalable streaming solutions handling thousands of concurrent clients, enforcing fault tolerance, backpressure handling, and data correctness as strict requirements
- Revamp the existing cost modeling system to enable high-cardinality, multi-axis cost allocation while avoiding excessive storage and compute overhead
- Implement incremental data updates using modern open table formats to minimize full rebuilds and significantly cut infrastructure costs
- Evaluate current query systems, complete ongoing migrations, and guide future evolution of query processing components
- Optimize query performance through techniques like partition pruning, predicate filtering, and execution planning, while preparing for tenfold data growth
- Transform a legacy batch-based cost attribution system into a near-instant engine that assigns usage costs by team, feature, and customer in seconds
- Reevaluate data enrichment, lineage tracking, and consistency assurances within a streaming-first environment
- Collaborate with product, infrastructure, and analytics teams to shape a long-term roadmap for the data platform
- Gain alignment among engineering leaders on core technology investments such as table formats, stream processing tools, query engines, and schema governance
- Engage in system design reviews, establish engineering patterns, and guide senior engineers through code collaboration and structured feedback
- Elevate team capabilities by improving technical excellence through mentorship and shared ownership
