San Mateo, United States of America Hybrid Full-time USD 250,000 – 350,000 / year

Prophecy is hiring an AI/ML Engineer (Mid-level to Principal)

Responsibilities

  • Design and implement comprehensive AI agent systems, including breaking down complex problems, retrieving relevant context, handling errors, and ensuring high-quality outputs.
  • Define performance standards, develop evaluation frameworks, and lead continuous improvement initiatives.
  • Manage retrieval-augmented generation (RAG) pipelines, leveraging vector and graph-based methods, along with knowledge representations that support accurate reasoning over customer data structures, lineage, and meaning.
  • Lead the AI development for converting natural language to production-ready code transformations, covering prompt engineering, model selection, fine-tuning, and output verification.
  • Bridge the gap between experimental AI solutions and scalable production systems by optimizing for latency, throughput, observability, and making strategic decisions on model refinement versus system redesign.

Work Arrangement

Hybrid — San Mateo

Other

  • Work 2–3 days per week in the San Mateo office.
  • Employer covers 99% of employee health insurance premiums and 75% for dependents.
  • Monthly $200 stipend for remote work setup, wellness activities, gym memberships, massages, facials, and similar expenses.
  • Flexible paid time off policy.
  • Professional growth and development funding available.
  • Company-provided Long Term Disability, Life Insurance, FSA/HSA options, dental, and vision coverage.
  • Opportunity to shape and influence a cutting-edge technology platform.
  • Full ownership of project lifecycle from design to deployment.
  • Benefits and perks may differ based on country of employment.
  • Employer is an Equal Opportunity Employer, considering all applicants regardless of race, colour, religion, sex, national origin, age, disability, or veteran status.
About company
Prophecy

Prophecy is an AI-powered data preparation and analysis platform that enables business users to accelerate insights from raw data through AI-generated, low-code data workflows. The platform allows users to describe business goals in natural language, and its AI agents automatically generate visual data pipelines that users can inspect, refine, and validate.

Designed for both business and platform teams, Prophecy integrates with major cloud data platforms like Databricks, Snowflake, and BigQuery, enabling end-to-end data execution with enterprise governance and scalability. It supports agentic data prep and analysis, where AI agents handle data joining, filtering, and segmentation based on user intent, making advanced data workflows accessible to non-technical users.

Originally built as a powerful ETL design environment on Apache Spark, Prophecy evolved to incorporate AI agents that assist with finding data, co-developing pipelines, generating documentation, and resolving errors. The platform is trusted by global enterprises including HSBC, JP Morgan, Microsoft, and Toyota, and is led by a team with deep expertise in distributed systems and visual data development.

All jobs at Prophecy Visit website
Job Details
Category data
Posted 3 hours ago