About the Role
Senior Data Engineer responsible for designing and implementing scalable data solutions using Databricks and cloud technologies in an agile, collaborative environment.
Responsibilities
- Design and implement modern data architectures, including Medallion Architecture and Data Lakehouse patterns.
- Develop and optimize batch and streaming data pipelines using Kafka, Spark/Databricks, and cloud services such as Azure Data Factory.
- Integrate and utilize core Databricks components like Unity Catalog and AI/BI Genie.
- Ensure data and AI governance, security, and compliance within cloud-based data platforms.
- Support the development and delivery of customer demonstrations and contribute to presales activities.
- Collaborate with cross-functional teams in agile project environments using Scrum or Kanban methodologies.
- Lead DevOps practices, including CI/CD pipelines and automation using Terraform and infrastructure-as-code tools.
- Work closely with clients and internal stakeholders to translate technical solutions into business value.
Requirements
- Bachelor’s or master’s degree in Computer Science, Business Informatics, Mathematics, Physics, Statistics, or a related field.
- Several years of hands-on experience building data engineering solutions with Databricks, Apache Spark, SQL, and cloud platforms.
- Proven knowledge of Big Data architectures, including Data Lakes, Delta Lakes, data warehouses, ETL/ELT processes, and streaming technologies.
- Strong programming and automation skills in Python, Scala, SQL, Terraform, and CI/CD systems.
- Fluent in both written and spoken German and English.
Nice to Have
- Familiarity with MLOps, DBT, or Infrastructure-as-Code (IaC) practices.
Tech Stack
Databricks, Apache Spark, Kafka, Azure Data Factory, Unity Catalog, AI/BI Genie, Delta Lake, Data Lakehouse, Medallion Architecture, Python, Scala, SQL, Terraform, CI/CD, Cloud platforms, ETL/ELT, Streaming technologies, Data governance, Security and compliance, DevOps
Compensation
Not specified
Work Arrangement
Not specified
Team
Collaborative environment working across functional teams in agile project settings.
Company Culture
- Agile project delivery using Scrum or Kanban
- Cross-functional collaboration
- Client-focused solution development
- Emphasis on technical excellence and automation
- Integration of data and AI governance
Additional Information
- Role involves direct interaction with customers and internal stakeholders.
- Involvement in presales activities and customer demo preparation.
Not specified
