Responsibilities
- AI Evaluation & Validation: Define and maintain, in collaboration with the AI Team Lead, a structured framework for evaluating AI tools, models, and vendors - covering capability, reliability, bias, and explainability. Conduct structured proof-of-concepts (PoCs) and benchmark assessments for AI solutions under consideration. Produce clear validation reports with go/no-go recommendations for stakeholders. Stay up to date with the evolving AI landscape (LLMs, agents, automation tools) and proactively surface relevant opportunities.
- Integration Support: Partner with engineering and product teams to design sound AI integration patterns aligned with Qualifyze's technical architecture. Define and enforce best practices. Support teams through the full integration lifecycle, from architecture review to post-deployment monitoring.
- Security & Compliance: Assess AI tools and integrations against information security policies, data privacy regulations (GDPR, ISO 27001, ISO 27701), and sector-specific requirements. Collaborate with the InfoSec team to evaluate risks such as data leakage, prompt injection, model poisoning, and third-party dependencies. Maintain an AI risk register and ensure mitigations are properly documented and tracked. Contribute to the company's AI governance policy and ensure it remains current as the regulatory landscape (e.g., EU AI Act, ISO 42001, GAMP5) evolves.
- Cost Governance: Define usage guidelines and guardrails to prevent cost overruns in AI-heavy workloads. Partner with Finance and Engineering to forecast AI spend and identify optimisation opportunities (model selection, caching, batching strategies).
- Enablement & Culture: Act as an internal AI advisor aligned with team working agreements, running workshops, writing guidelines, and creating resources that help teams use AI confidently and responsibly. Champion a culture of responsible AI adoption across the company.
Requirements
- 3+ years of experience in a technical role involving AI/ML systems, software engineering, or data engineering.
- Hands-on experience with LLM-based solutions (OpenAI, Anthropic, Mistral, or similar) and cloud AI services (AWS or GCP).
- Strong understanding of information security principles, particularly as they apply to AI systems (data handling, access controls, third-party risk).
- Familiarity with data privacy regulations and compliance frameworks.
- Ability to communicate technical findings clearly to both engineering teams and business stakeholders.
- Structured, methodical mindset.
Nice to Have
- Experience in regulated industries (pharma, life sciences, healthcare, or fintech).
- Knowledge of the EU AI Act, ISO 42001 or other AI governance frameworks.
- Background in FinOps or cloud cost management.
- Experience building internal tooling or developer enablement programs.
Benefits
- Competitive, annually reviewed compensation package.
- Country vacation package that increases with your tenure.
- Country specific benefits offering incl. private health care, fitness and meal allowances.
- Annual personal development budget to increase your impact.
- Hybrid working mode, plus up to 3 months of the year work from anywhere.
- All the best kit and tools to work effectively.
- Annual in person all company event and celebration in Europe.
- Working with an exceptional team, doing some of the best work of your career.
Work Arrangement
Hybrid
Additional Information
- At Qualifyze we actively support the power of diversity, uniting complementary talents and perspectives to address new challenges. Our collective strengths help us to find innovative solutions and turn difficulties into opportunities. We will encourage you to bring your authentic self to work, fostering an inclusive environment where everyone belongs and feels heard. We are an equal opportunity employer and we welcome applications from candidates of all backgrounds, regardless of race, ethnicity, gender identity, sexual orientation, marital status, religion, disability, or age. Our hiring practices are rooted in fairness and respect, and we strive to create a culture where everyone feels valued and empowered.
