Responsibilities
- Design and manage an internal platform for provisioning AI models, simplifying access to various LLMs and MCP Servers via tools like LiteLLM.
- Set up comprehensive observability, logging, and alerting for LLMs using platforms such as Datadog and Langfuse.
- Enforce model governance by implementing security, data privacy, rate limiting, and strict cost management for LLM APIs.
- Work closely with embedded AI software engineers to support cloud-native architectures and integrate agentic workflows.
- Develop and maintain infrastructure to monitor the reliability and performance of production AI systems.
Requirements
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
- Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
- Strong experience with cloud infrastructure, preferably AWS, and Infrastructure as Code using Terraform.
- Proficiency in at least one programming language such as Python or Go, along with experience in CI/CD pipelines and containerization with Docker.
- Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
- Experience with or strong willingness to learn LLM gateways, observability platforms, and telemetry tools like LiteLLM, Langfuse, and Datadog.
- Strong problem-solving skills, a sense of humor, and the ability to thrive in an ego-free environment as an embedded platform expert within a cross-functional Data Science and AI team.
Benefits
- Be part of one of the fastest-growing and most visible Fintech startups in Europe, creating innovative services that have a substantial impact on customers' lives.
- Work with an international, diverse, inclusive, and ever-growing team that loves creating the best products for clients.
- Be productive with the latest hardware and tools.
- Learn and grow by joining in-house knowledge sharing or career development sessions and using an individual Education Budget.
- Learn and experience German culture first hand by joining free German language classes.
- International relocation support is provided if required.
- Opportunity to work from abroad.
- Benefit from an attractive compensation package and from the company pension scheme.
- Monthly contribution of 50% for the 'Deutschland Jobticket'.
- Say goodbye to order commissions and hello to a complimentary subscription of Scalable Capital's PRIME+ Broker.
- Enjoy flexible and discounted sports activities with Urban Sports Club.
Compensation
Attractive compensation package with company pension scheme
Work Arrangement
Opportunity to work from abroad
Team
Cross-functional Data Science and AI team
Other
- International relocation support is provided if required.
- Opportunity to work from abroad.
- Free German language classes.
International relocation support is provided if required
