Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
- 5+ years of experience in MLOps
- At least 2 years working specifically with LLMOps pipelines for large language models
- Proven experience in deploying, managing, and optimizing machine learning models in cloud environments at scale
- Strong problem-solving abilities and a passion for building scalable, production-grade AI systems
- MLOps & LLMOps Expertise: Solid understanding of MLOps best practices and LLMOps workflows for large language models, ensuring seamless integration of AI systems into production environments
- Cloud Infrastructure & Deployment: Extensive experience with cloud platforms (AWS, GCP, Azure) for deploying and scaling ML/LLM solutions. Expertise in containerization (Docker, Kubernetes) for model deployment and orchestration
- CI/CD Pipelines & Automation: Proficiency in developing and managing CI/CD pipelines for machine learning models using tools like Jenkins, GitLab CI, or CircleCI, and automation tools like Terraform or Ansible
- Model Serving & Monitoring: Hands-on experience deploying models using frameworks such as TensorFlow Serving, TorchServe, Kubeflow, or MLflow. Strong understanding of model monitoring and alerting (e.g., Prometheus, Grafana)
- Machine Learning Frameworks: Strong knowledge of popular machine learning frameworks like TensorFlow, PyTorch, Hugging Face, and others, with a particular focus on deploying and fine-tuning large language models (e.g., GPT, BERT)
- Data Engineering & Pipelines: Expertise in building and managing robust data pipelines using tools like Apache Kafka, Apache Airflow, or Apache Beam to support ML and LLM workflows
- Performance Optimization: Ability to optimize the performance of AI models, including working with distributed systems, model compression, and hardware acceleration (GPUs, TPUs)
- Security & Governance: Deep understanding of security and governance best practices for AI systems, including model versioning, compliance with privacy regulations (GDPR), and ethical AI frameworks
- Programming & Scripting: Strong programming skills in Python
Nice to Have
- Experience with AI and Generative AI technologies is a plus