Responsibilities
- Design and enhance a streaming lakehouse architecture that serves as the core data foundation for all internal users.
- Develop and manage distributed data pipelines that ensure low-latency and highly reliable data transfer.
- Take ownership of durable workflows that orchestrate intricate data flows across multiple systems.
- Define and refine the platform's API layer, enabling data producers and consumers to interact without managing infrastructure.
- Lead assessments and integrations of third-party data platforms, actively engaging in architectural decisions.
- Help build a self-service and agentic data layer accessible to humans, automated systems, and AI agents.
- Collaborate with data engineers and analysts on data contracts, governance policies, and lineage tracking.
- Construct and sustain data infrastructure optimized for artificial intelligence and machine learning applications.
- Utilize AI-powered coding tools and large language models to speed up development and improve code quality.
- Operate within a regulated domain where compliance, auditability, and data governance influence all technical designs.
Compensation
Competitive salary and benefits package
Work Arrangement
Hybrid or remote options available
Team
Part of the data platform team focused on enabling scalable, reliable, and AI-driven data solutions
Responsibilities
- Design and evolve Sword’s streaming lakehouse - the foundation that every data consumer in the company depends on.
- Build and operate distributed streaming pipelines that move data at low latency and high reliability.
- Own the durable workflows that coordinate complex data movement across systems.
- Shape the platform’s API surface - the interface producers and consumers use so they never need to touch infrastructure.
- Drive evaluations and integrations with vendor data platforms, sitting inside the architectural trade-offs rather than just consuming the output.
- Contribute to the self-service and agentic layer: interfaces designed to be consumed by humans, systems, and AI agents alike.
- Partner with data engineers and analysts on contracts, governance, and lineage.
- Build and maintain AI-ready data infrastructure that powers ML and AI-driven products across Sword.
- Leverage AI coding assistants and LLMs to accelerate development, automate documentation, and raise code quality.
- Work in a regulated environment where audit, compliance, and governance are part of every design.
Available for qualified candidates