United Kingdom Hybrid

DATAPAO is hiring a Senior AI Engineer (Databricks) - UK

About the Role

DATAPAO is seeking a Senior AI Engineer with strong expertise in Databricks to join their team in the UK. The role involves delivering high-impact AI and data engineering solutions for clients, leveraging proven technologies and best practices in scalable data platforms.

What You'll Do

  • Design and implement scalable AI and machine learning solutions on Databricks
  • Collaborate with data engineers and data scientists to build end-to-end data pipelines
  • Lead technical delivery of complex data and AI projects for clients
  • Mentor junior engineers and promote best practices in code quality and architecture
  • Work closely with stakeholders to understand business requirements and translate them into technical solutions
  • Contribute to the development of reusable frameworks and accelerators for AI and data engineering
  • Ensure solutions meet performance, security, and compliance standards

What We're Looking For

  • Professional experience with Databricks platform (Databricks Lakehouse, Delta Lake, Databricks SQL, Databricks ML)
  • Strong proficiency in Python and PySpark for large-scale data processing
  • Experience building and deploying machine learning models in production environments
  • Solid understanding of cloud platforms (AWS, Azure, or GCP)
  • Hands-on experience with data engineering tools and frameworks (e.g., Apache Spark, Airflow, dbt)
  • Proven ability to lead technical projects and mentor team members
  • Excellent communication and client-facing skills
  • Bachelor’s degree in Computer Science, Engineering, or a related field

Nice to Have

  • Master’s or PhD in Computer Science, Data Science, or related discipline
  • Databricks certifications (e.g., Databricks Certified Data Scientist, Databricks Certified Developer)
  • Experience with MLOps tools (MLflow, Kubeflow, Seldon)
  • Familiarity with containerization and orchestration (Docker, Kubernetes)
  • Knowledge of data governance, data lineage, and data security best practices
  • Experience working in consulting or professional services environments
  • Contributions to open-source projects or publications in AI/data engineering

Technical Stack

Databricks, Delta Lake, Apache Spark, Python, PySpark, MLflow, Airflow, dbt, AWS, Azure, GCP, Docker, Kubernetes, SQL, MLlib, TensorFlow, PyTorch

Team & Environment

Join a growing engineering team with multiple client delivery squads. Work within cross-functional delivery teams including data engineers, data scientists, and solution architects, reporting to the Head of Engineering. Our culture values data-driven passion, collaboration, growth, client focus, technical excellence, continuous learning, and an inclusive, supportive environment.

Benefits & Compensation

  • Competitive salary range of £80,000 - £110,000 per year
  • Annual performance bonus
  • Flexible working hours and remote-first policy
  • Comprehensive health and dental insurance
  • Generous paid time off (30 days annual leave + bank holidays)
  • Professional development budget for courses, certifications, and conferences
  • Relocation support for candidates moving to the UK
  • Access to internal training programs and mentorship
  • Wellness stipend for gym memberships or mental health services
  • Company-wide retreats and team-building events
  • Employee stock options or equity participation

Work Mode

Hybrid role based in the UK, with flexible working hours and the option to work remotely. Occasional travel to client sites or offices may be required.

DATAPAO is an equal opportunity employer committed to diversity and inclusion in the workplace.

Required Skills
DatabricksDelta LakeApache SparkPythonPySparkMLflowAirflowdbtAWSAzuremachine learningdata engineeringcloud platformslarge-scale data processingDatabricks ML DatabricksDelta LakeApache SparkPythonPySparkMLflowAirflowdbtAWSAzuremachine learningdata engineeringcloud platformslarge-scale data processingDatabricks ML
Freelancing without stability?

Get steady projects, keep your freedom

Iglu connects you with international clients and handles contracts, payments, and admin. You get consistent work and flexibility — no more chasing invoices or worrying about gaps.

Consistent client projects
Contract & payment management
Flexible work schedule
Revenue-sharing compensation
See open positions
Work from anywhere
About company
DATAPAO
A leading Data Engineering and AI consulting company specializing in end-to-end data solutions, powered by Databricks and focused on high-impact client delivery.
All jobs at DATAPAO Visit website
Job Details
Category data
Posted 2 hours ago