Sumo Logic is looking for a Senior Machine Learning Engineer II to build the intelligence behind the next generation of agentic AI systems. You will combine machine learning, prompt engineering, and rigorous evaluation to create autonomous AI agents that help organizations understand and act on their data in real time.
What You'll Do
- Design, implement, and optimize agentic AI components, including context engineering, memory management, and prompts.
- Develop and maintain golden datasets by defining sourcing strategies, working with data vendors, and ensuring quality and representativeness at scale.
- Prototype and evaluate novel prompting strategies and reasoning chains for model reliability and interpretability.
- Collaborate cross-functionally with product, data, and infrastructure teams to deliver end-to-end AI-powered insights.
- Operate autonomously in a fast-paced, ambiguous environment—defining scope, setting milestones, and driving outcomes.
- Ensure reliability, performance, and observability of deployed agents through rigorous testing and continuous improvement.
- Maintain a strong bias for action—delivering incremental, well-tested improvements that directly enhance customer experience.
What We're Looking For
- B.Tech, M.Tech, or Ph.D. in Computer Science, Data Science, or a related field.
- 4-6 years of hands-on industry experience with demonstrable ownership and delivery.
- Strong understanding of machine learning fundamentals, data pipelines, and model evaluation.
- Proficiency in Python and ML/data libraries (NumPy, pandas, scikit-learn).
- Working knowledge of LLM core concepts, prompt design, and agentic design patterns.
- Prior experience building and deploying AI agents or LLM applications in production.
- Familiarity with modern agentic AI frameworks (e.g., LangGraph, LangChain, CrewAI).
- Experience with ML infrastructure and tooling (PyTorch, MLflow, Airflow, Docker, AWS).
- Exposure to LLM Ops—infrastructure optimization, observability, latency, and cost monitoring.
- Strong communication skills and a passion for shaping emerging AI paradigms.
Nice to Have
- Authored research/white papers and published in conferences.
- Mentored junior engineers in guiding ML applications.
Technical Stack
- Languages & Libraries: Python, NumPy, pandas, scikit-learn, PyTorch
- Infrastructure & Ops: MLflow, Airflow, Docker, AWS
- Frameworks: LangGraph, LangChain, CrewAI
Team & Environment
You will join a small, high-impact team driving the development of our agentic AI capabilities.
Benefits & Compensation
- Salary: $148,000 - $173,200
Work Mode
This role follows a local-country work mode and is open to candidates located in the United States.
Sumo Logic is an equal opportunity employer.





