Data Pipeline Development
Design, build, and maintain ETL/ELT pipelines in Databricks to ingest, clean, and transform data from diverse product sources.
Construct gold layer tables in the Lakehouse architecture that serve both machine learning model training and real-time APIs.
Monitor data quality, lineage, and reliability using Databricks best practices.
AI-Driven Data Access Enablement
Collaborate with AI/ML teams to ensure data is modeled and structured to support natural language prompts and semantic retrieval using 1st and 3rd party data sources, vector search and Unity Catalog metadata.
Help build data interfaces and agent tools to interact with structured data and AI agents to retrieve and analyze customer data with role-based permissions.
API & Serverless Backend Integration
Work with backend engineers to design and implement serverless APIs (e.g., via AWS Lambda with TypeScript) that expose gold tables to frontend applications.
Ensure APIs are performant, scalable, and designed with data security and compliance in mind.
Utilize Databricks and other APIs to implement provisioning, deployment, security and monitoring frameworks for scaling up data pipelines, AI endpoints, and security models for multi-tenancy.
Apply on company website Cairo, Cairo Governorate, Egypt Remote (Global) Full-time
XTREME GRAPHICS LIMITED is hiring a Senior Data Engineer
Landing international contracts?
Invoice globally with an EU company
GloPay creates an Estonian partnership for you automatically. Your clients get proper invoices, you keep 95% of payments. Setup takes 5 minutes, works in 100+ currencies.
EU-registered company for compliance
Multi-currency invoicing & payments
Expense tracking & tax reports
Money in your bank in 1 business day
5% per invoice • No subscriptions