Responsibilities
- Develop and manage reliable data pipelines within Databricks
- Design and apply scalable Lakehouse and Medallion Architecture frameworks
- Organize data into coherent business-focused domains
- Implement and sustain Bronze, Silver, and Gold data tiers
- Construct Gold-tier datasets to serve applications, reports, and analytical needs
- Ingest and process data from various source systems, with a focus on SAP
- Establish data quality controls, monitoring systems, and validation procedures
- Assist in data modeling, database design, storage strategies, and performance tuning
- Participate in defining data governance, security, and access control policies
- Help create or maintain CI/CD pipelines for automated data workflows
- Support reporting initiatives, primarily using Power BI or Databricks tools
- Prepare the data platform to support upcoming AI and advanced analytics projects
- Simplify onboarding processes for business users accessing the data platform
- Collaborate closely with infrastructure, architecture, business units, reporting, and data teams
Requirements
- Multiple years of experience as a Senior Data Engineer or in a similar position
- Proven expertise in developing and managing data pipelines using Databricks
- Strong grasp of Lakehouse and Medallion Architecture principles
- Hands-on experience with cloud-based data platforms, preferably on Azure
- Solid understanding of data quality, governance, security, and access controls
- Background in data modeling, database systems, storage technologies, and performance optimization
- Familiarity with CI/CD practices in data engineering contexts
- In-depth knowledge of the Databricks ecosystem and associated tools
- Ability to organize complex data environments into scalable, maintainable solutions
- Senior-level independence and structured problem-solving approach
- Excellent communication skills with both technical and non-technical stakeholders
Nice to Have
- Prior experience working with SAP data sources is highly desirable
- Background in insurance, reinsurance, finance, or actuarial domains is a plus
- Familiarity with Power BI or Databricks reporting tools is advantageous
Work Arrangement
Remote (Worldwide)
