Rockefeller Philanthropy Advisors is hiring a Senior AI Engineer - Data & Infrastructure for Multimodal Models. You will design and implement scalable, high-throughput data pipelines to support cutting-edge multimodal AI research, collaborating closely with model researchers.

What You'll Do

Build and scale data infrastructure optimized for large-scale video and multimodal content processing across GPU clusters.
Design preprocessing algorithms for video, audio, text, and image modalities to enable efficient extraction, synchronization, and normalization.
Develop automated pipelines for large-scale video dataset acquisition, managing diverse formats, annotations, and embedded audio.
Architect systems for scalable evaluation, including prompt-based scoring, perceptual metrics, caption generation, and retrieval diagnostics.
Collaborate with research teams to co-design model architectures and training schedules across pretraining and fine-tuning stages.
Optimize distributed data loading and pipeline throughput for training at scale, ensuring robustness across model variants.
Manage infrastructure for experiment tracking, model versioning, and deployment workflows integrated with production and research platforms.
Support backend engineering for seamless integration of data and model workflows from prototyping to inference.

What We're Looking For

Proficient in Python with strong programming skills in backend, infrastructure, and data tooling.
Minimum 2+ years experience building and maintaining petabyte-scale data pipelines and distributed systems across thousands of GPUs.
Hands-on expertise in orchestration frameworks such as Kubernetes and SLURM for high-throughput workloads.
Proven ability to architect and maintain large-scale distributed data processing and delivery systems.
Experience collaborating with AI researchers and understanding model training requirements.
Strong problem-solving, analytical, and debugging skills in complex infrastructure environments.

Nice to Have

Familiarity with multimodal datasets (video, image, audio, text) and processing pipelines.
Experience in building video foundation infrastructure in collaboration with LLM or video AI teams.

Technical Stack

Python
Kubernetes
SLURM

Team & Environment

You will collaborate directly with research teams in a collaborative, high-performing, and innovation-driven team culture.

Benefits & Compensation

Competitive salary and performance-based incentives.
Flexible working environment with remote options.
Opportunities to work on AI research with global impact.
Access to state-of-the-art infrastructure and GPU clusters.
Professional growth and career development in AI and infrastructure engineering.
Collaborative, high-performing, and innovation-driven team culture.